Nov 03 20:11:22 devstack cinder-volume[76156]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 03 20:11:22 devstack cinder-volume[76156]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 20:11:22 devstack cinder-volume[76156]: we strongly recommend against using it for new projects. Nov 03 20:11:22 devstack cinder-volume[76156]: If you are already using Eventlet, we recommend migrating to a different Nov 03 20:11:22 devstack cinder-volume[76156]: framework. For more detail see Nov 03 20:11:22 devstack cinder-volume[76156]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 20:11:22 devstack cinder-volume[76156]: import eventlet # noqa Nov 03 20:11:24 devstack cinder-volume[76156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76156) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 20:11:24 devstack cinder-volume[76156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76156) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 20:11:24 devstack cinder-volume[76156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76156) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 20:11:25 devstack cinder-volume[76156]: INFO dbcounter [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] Registered counter for database cinder Nov 03 20:11:25 devstack cinder-volume[76156]: DEBUG oslo_db.sqlalchemy.engines [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76156) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 20:11:26 devstack cinder-volume[76156]: DEBUG dbcounter [-] [76156] Writer thread running {{(pid=76156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 20:11:26 devstack cinder-volume[76156]: INFO cinder.rpc [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 03 20:11:26 devstack cinder-volume[76156]: INFO cinder.rpc [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 03 20:11:26 devstack cinder-volume[76156]: DEBUG oslo_db.sqlalchemy.engines [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76156) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 20:11:26 devstack cinder-volume[76156]: INFO cinder.volume.manager [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] Determined volume DB was empty at startup. Nov 03 20:11:26 devstack cinder-volume[76156]: DEBUG cinder.volume.manager [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76156) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 03 20:11:26 devstack cinder-volume[76156]: INFO cinder.volume.manager [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 03 20:11:26 devstack cinder-volume[76156]: WARNING stevedore.named [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 20:11:26 devstack cinder-volume[76156]: WARNING castellan.key_manager [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 20:11:26 devstack cinder-volume[76156]: WARNING cinder.keymgr.conf_key_mgr [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 20:11:26 devstack cinder-volume[76156]: DEBUG cinder.volume.drivers.lvm [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76156) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 03 20:11:26 devstack cinder-volume[76156]: DEBUG oslo_concurrency.processutils [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:11:26 devstack cinder-volume[76156]: DEBUG oslo_concurrency.processutils [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] CMD "cinder-rtstool verify" returned: 0 in 0.403s {{(pid=76156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:11:26 devstack cinder-volume[76156]: DEBUG oslo_db.sqlalchemy.engines [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76156) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 20:11:26 devstack cinder-volume[76156]: INFO cinder.rpc [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 03 20:11:26 devstack cinder-volume[76156]: INFO cinder.rpc [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 03 20:11:26 devstack cinder-volume[76156]: WARNING stevedore.named [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 20:11:26 devstack cinder-volume[76156]: WARNING castellan.key_manager [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 20:11:26 devstack cinder-volume[76156]: INFO cinder.volume.manager [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 03 20:11:26 devstack cinder-volume[76156]: DEBUG oslo_db.sqlalchemy.engines [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76156) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 20:11:27 devstack cinder-volume[76156]: INFO oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] Starting 1 workers Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] Started child 76318 {{(pid=76156) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] Full set of CONF: {{(pid=76156) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] ******************************************************************************** {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] Configuration options gathered from: {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] ================================================================================ {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] allow_availability_zone_fallback = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] allow_compression_on_image_upload = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] allowed_direct_url_schemes = [] {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] api_rate_limit = True {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] auth_strategy = keystone {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] az_cache_duration = 3600 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_availability_zone = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76318]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_host = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_name = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_stats_polling_interval = 60 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backup_api_class = cinder.backup.api.API {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backup_name_template = backup-%s {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backup_use_same_host = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backup_use_temp_snapshot = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] chap_password = **** {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] chap_username = {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] cinder_internal_tenant_project_id = 1191cf37b1364535a784e8e6b01582cb {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] cinder_internal_tenant_user_id = 6c974cb5dc614b28afc3f5382be5016d {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] cloned_volume_same_az = True {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] cluster = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] compression_format = gzip {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] compute_api_class = cinder.compute.nova.API {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] config_dir = [] {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] config_source = [] {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] control_exchange = openstack {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] debug = True {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] default_availability_zone = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] default_group_type = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] default_volume_type = lvmdriver-1 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] disk_geometry = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] driver_client_cert = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] driver_client_cert_key = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] driver_data_namespace = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] driver_ssl_cert_path = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] driver_ssl_cert_verify = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] driver_use_ssl = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] enable_force_upload = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] enable_new_services = True {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] enable_unsupported_driver = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] enabled_backends = ['lvmdriver-1'] {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] enforce_multipath_for_image_xfer = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] filter_function = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] glance_api_insecure = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] glance_api_servers = ['http://192.168.122.118/image'] {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] glance_api_ssl_compression = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] glance_ca_certificates_file = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] glance_catalog_info = image:glance:publicURL {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] glance_certfile = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] glance_keyfile = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] glance_num_retries = 3 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] glance_request_timeout = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] goodness_function = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] graceful_shutdown_timeout = 5 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] group_api_class = cinder.group.api.API {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] host = devstack {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] image_compress_on_upload = True {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] image_conversion_address_space_limit = 1 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] image_conversion_cpu_limit = 60 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] image_conversion_disable = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] image_introspection_address_space_limit = 1 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] image_introspection_cpu_limit = 60 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] image_upload_use_cinder_backend = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] image_upload_use_internal_tenant = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] image_volume_cache_enabled = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] image_volume_cache_max_count = 0 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] image_volume_cache_max_size_gb = 0 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] init_host_max_objects_retrieval = 0 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] instance_format = [instance: %(uuid)s] {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] iscsi_target_flags = {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] iscsi_write_cache = on {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] iser_helper = tgtadm {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] iser_ip_address = 192.168.122.118 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] iser_port = 3260 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] log_color = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] log_config_append = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] log_dir = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] log_file = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] log_options = True {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] log_rotate_interval = 1 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] log_rotate_interval_type = days {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] log_rotation_type = none {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] max_age = 0 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] max_logfile_count = 30 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] max_logfile_size_mb = 200 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] max_over_subscription_ratio = 20.0 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] message_reap_interval = 86400 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] message_ttl = 2592000 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] migration_create_volume_timeout_secs = 300 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] monkey_patch = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] monkey_patch_modules = [] {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] my_ip = 192.168.122.118 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] no_snapshot_gb_quota = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] num_iser_scan_tries = 3 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] num_shell_tries = 3 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] num_volume_device_scan_tries = 3 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] nvmeof_conn_info_version = 1 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] nvmet_ns_id = 10 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] nvmet_port_id = 1 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] osapi_max_limit = 1000 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] osapi_volume_ext_list = [] {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] osapi_volume_listen = 0.0.0.0 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] osapi_volume_listen_port = 8776 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] osapi_volume_use_ssl = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] osapi_volume_workers = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] per_volume_size_limit = -1 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] periodic_fuzzy_delay = 60 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] periodic_interval = 60 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] project_id_regex = [0-9a-f\-]+ {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] public_endpoint = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] publish_errors = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] quota_backup_gigabytes = 1000 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] quota_backups = 10 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] quota_gigabytes = 1000 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] quota_groups = 10 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] quota_snapshots = 10 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] quota_volumes = 10 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76318]: INFO cinder.volume.manager [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] rate_limit_burst = 0 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] rate_limit_except_level = CRITICAL {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] rate_limit_interval = 0 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] reinit_driver_count = 3 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] replication_device = **** {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] report_discard_supported = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] report_interval = 120 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] reservation_clean_interval = 86400 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] reservation_expire = 86400 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] reserved_image_namespaces = [] {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] reserved_percentage = 0 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] rpc_response_timeout = 120 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] run_external_periodic_tasks = True {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] scst_target_driver = iscsi {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] scst_target_iqn_name = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] service_down_time = 720 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] shell_completion = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] snapshot_name_template = snapshot-%s {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] snapshot_same_host = True {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] split_loggers = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] state_path = /opt/stack/data/cinder {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] storage_availability_zone = nova {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] storage_protocol = iSCSI {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] syslog_log_facility = LOG_USER {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] target_helper = lioadm {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] target_ip_address = 192.168.122.118 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] target_port = 3260 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] target_protocol = iscsi {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] target_secondary_ip_addresses = [] {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] trace_flags = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] transfer_api_class = cinder.transfer.api.API {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] transport_url = **** {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] until_refresh = 0 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] use_chap_auth = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] use_default_quota_class = True {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] use_journal = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] use_json = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] use_multipath_for_image_xfer = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] use_stderr = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] use_syslog = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] verify_glance_signatures = enabled {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] volume_api_class = cinder.volume.api.API {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] volume_backend_name = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] volume_clear = zero {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] volume_clear_ionice = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] volume_clear_size = 0 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] volume_copy_bps_limit = 0 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] volume_dd_blocksize = 1M {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] volume_name_template = volume-%s {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] volume_service_inithost_offload = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] volume_usage_audit_period = month {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] zoning_mode = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_concurrency.disable_process_locking = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] keystone_authtoken.auth_section = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] keystone_authtoken.auth_type = password {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] keystone_authtoken.auth_version = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] keystone_authtoken.cache = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] keystone_authtoken.certfile = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] keystone_authtoken.delay_auth_decision = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] keystone_authtoken.http_connect_timeout = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] keystone_authtoken.include_service_catalog = True {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] keystone_authtoken.insecure = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] keystone_authtoken.interface = public {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] keystone_authtoken.keyfile = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] keystone_authtoken.memcache_password = **** {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.045s {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] keystone_authtoken.memcache_username = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] keystone_authtoken.region_name = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] keystone_authtoken.service_token_roles_required = True {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] keystone_authtoken.service_type = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] keystone_authtoken.token_cache_time = 300 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.118/identity {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] cache.backend = dogpile.cache.null {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] cache.backend_argument = **** {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] cache.backend_expiration_time = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] cache.config_prefix = cache.oslo {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] cache.debug_cache_backend = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] cache.enable_retry_client = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] cache.enable_socket_keepalive = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] cache.enabled = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] cache.expiration_time = 600 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] cache.hashclient_retry_attempts = 2 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] cache.memcache_dead_retry = 300 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] cache.memcache_pool_maxsize = 10 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] cache.memcache_sasl_enabled = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] cache.password = **** {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] cache.proxies = [] {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] cache.redis_db = 0 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] cache.redis_sentinel_service_name = mymaster {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] cache.redis_server = localhost:6379 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] cache.retry_attempts = 2 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] cache.retry_delay = 0.0 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] cache.socket_keepalive_count = 1 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] cache.socket_keepalive_idle = 1 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] cache.socket_keepalive_interval = 1 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] cache.socket_timeout = 1.0 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] cache.tls_allowed_ciphers = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] cache.tls_cafile = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] cache.tls_certfile = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] cache.tls_enabled = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] cache.tls_keyfile = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] cache.username = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] coordination.backend_url = **** {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] database.asyncio_connection = **** {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] database.asyncio_slave_connection = **** {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] database.backend = sqlalchemy {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] database.connection = **** {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] database.connection_debug = 0 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] database.connection_parameters = {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] database.connection_recycle_time = 3600 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] database.connection_trace = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] database.db_inc_retry_interval = True {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] database.db_max_retries = 20 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] database.db_max_retry_interval = 10 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] database.db_retry_interval = 1 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] database.max_overflow = 50 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] database.max_pool_size = 5 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] database.max_retries = 10 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] database.mysql_wsrep_sync_wait = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] database.pool_timeout = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] database.retry_interval = 10 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] database.slave_connection = **** {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] database.sqlite_synchronous = True {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] database.synchronous_reader = True {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] database.use_db_reconnect = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_tracing.insecure = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] profiler.connection_string = messaging:// {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] profiler.enabled = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] profiler.es_doc_type = notification {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] profiler.es_scroll_size = 10000 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] profiler.es_scroll_time = 2m {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] profiler.filter_error_trace = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] profiler.hmac_keys = **** {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] profiler.sentinel_service_name = mymaster {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] profiler.socket_timeout = 0.1 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] profiler.trace_requests = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] profiler.trace_sqlalchemy = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] profiler_jaeger.process_tags = {} {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] profiler_jaeger.service_name_prefix = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] profiler_otlp.service_name_prefix = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_policy.enforce_new_defaults = True {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_policy.policy_default_rule = default {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_policy.policy_file = policy.yaml {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_policy.remote_timeout = 60.0 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] privsep_osbrick.group = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] privsep_osbrick.helper_command = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] privsep_osbrick.user = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] cinder_sys_admin.group = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] cinder_sys_admin.helper_command = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] cinder_sys_admin.user = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] service_user.auth_section = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] service_user.auth_type = password {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] service_user.cafile = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] service_user.certfile = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] service_user.collect_timing = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] service_user.insecure = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] service_user.keyfile = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] service_user.send_service_user_token = True {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] service_user.split_loggers = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] service_user.timeout = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] service_user.tls_ciphers = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] service_user.tls_min_version = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] glance.auth_section = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] glance.auth_type = password {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] glance.certfile = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] glance.collect_timing = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] glance.insecure = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] glance.keyfile = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] glance.region_name = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] glance.split_loggers = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] glance.timeout = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] glance.tls_ciphers = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] glance.tls_min_version = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.backend_availability_zone = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.chap_password = **** {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.chap_username = {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.disk_geometry = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.driver_client_cert = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.driver_client_cert_key = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.driver_data_namespace = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.driver_use_ssl = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.enable_unsupported_driver = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.extra_capabilities = {} {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.filter_function = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.goodness_function = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.iscsi_target_flags = {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.iscsi_write_cache = on {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.iser_helper = tgtadm {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.iser_ip_address = 192.168.122.118 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.iser_port = 3260 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.lvm_mirrors = 0 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.lvm_share_target = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack sudo[76322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 03 20:11:27 devstack sudo[76322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.lvm_type = auto {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.num_shell_tries = 3 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.nvmet_port_id = 1 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.replication_device = **** {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.report_discard_supported = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.reserved_percentage = 0 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.scst_target_driver = iscsi {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.scst_target_iqn_name = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.storage_protocol = iSCSI {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.target_helper = tgtadm {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.target_ip_address = 192.168.122.118 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.target_port = 3260 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.target_protocol = iscsi {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.trace_flags = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.unique_fqdn_network = True {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.use_chap_auth = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.volume_backend_name = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.volume_clear = zero {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.volume_clear_ionice = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.volume_clear_size = 0 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.volume_group = cinder-volumes {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_reports.file_event_handler = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_reports.log_dir = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.backend_availability_zone = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.backend_host = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.chap_password = **** {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.chap_username = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.chiscsi_conf = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.disk_geometry = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.driver_client_cert = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.driver_data_namespace = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.driver_use_ssl = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.extra_capabilities = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.filter_function = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.goodness_function = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.iser_helper = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.iser_ip_address = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.iser_port = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.iser_target_prefix = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.lvm_conf_file = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.lvm_mirrors = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.lvm_share_target = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.lvm_type = auto {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.num_shell_tries = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.nvmet_port_id = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.replication_device = **** {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.report_discard_supported = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.reserved_percentage = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.scst_target_driver = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.storage_protocol = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.target_helper = lioadm {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.target_ip_address = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.target_port = 3260 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.target_protocol = iscsi {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.trace_flags = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.use_chap_auth = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.volume_clear = zero {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.volume_clear_size = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] lvmdriver-1.volumes_dir = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_rabbit.ssl = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_rabbit.ssl_version = {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_notifications.driver = [] {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_notifications.retry = -1 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] oslo_messaging_notifications.transport_url = **** {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] key_manager.fixed_key = **** {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] barbican.barbican_api_version = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] barbican.barbican_endpoint = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] barbican.barbican_endpoint_type = public {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] barbican.barbican_region_name = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] barbican.cafile = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] barbican.certfile = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] barbican.collect_timing = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] barbican.insecure = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] barbican.keyfile = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] barbican.number_of_retries = 60 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] barbican.retry_delay = 1 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] barbican.send_service_user_token = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] barbican.split_loggers = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] barbican.timeout = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] barbican.tls_ciphers = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] barbican.tls_min_version = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] barbican.verify_ssl = True {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] barbican.verify_ssl_path = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] barbican_service_user.auth_section = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] barbican_service_user.auth_type = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] barbican_service_user.cafile = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] barbican_service_user.certfile = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] barbican_service_user.collect_timing = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] barbican_service_user.insecure = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] barbican_service_user.keyfile = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] barbican_service_user.split_loggers = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] barbican_service_user.timeout = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] barbican_service_user.tls_ciphers = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] barbican_service_user.tls_min_version = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] vault.approle_role_id = **** {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] vault.approle_secret_id = **** {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] vault.auth_method = approle {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] vault.auth_path = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] vault.kv_mountpoint = secret {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] vault.kv_path = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] vault.kv_version = 2 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] vault.namespace = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] vault.root_token_id = **** {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] vault.ssl_ca_crt_file = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] vault.timeout = 60.0 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] vault.token_file = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] vault.token_role = None {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] vault.use_ssl = False {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:11:27 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] ******************************************************************************** {{(pid=76156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 03 20:11:27 devstack sudo[76322]: pam_unix(sudo:session): session closed for user root Nov 03 20:11:27 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.351s {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:11:27 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:11:27 devstack sudo[76366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 20:11:27 devstack sudo[76366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:11:27 devstack sudo[76366]: pam_unix(sudo:session): session closed for user root Nov 03 20:11:27 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.308s {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:11:27 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 20:11:27 devstack cinder-volume[76318]: INFO cinder.brick.local_dev.lvm [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 03 20:11:27 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:11:27 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:11:27 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:11:27 devstack sudo[76485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 20:11:27 devstack sudo[76485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:11:28 devstack sudo[76485]: pam_unix(sudo:session): session closed for user root Nov 03 20:11:28 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.343s {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:11:28 devstack cinder-volume[76318]: DEBUG cinder.brick.local_dev.lvm [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76318) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 03 20:11:28 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:11:28 devstack sudo[76556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 20:11:28 devstack sudo[76556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:11:28 devstack sudo[76556]: pam_unix(sudo:session): session closed for user root Nov 03 20:11:28 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.557s {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:11:28 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:11:28 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:11:28 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:11:28 devstack sudo[76753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 20:11:28 devstack sudo[76753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:11:29 devstack sudo[76753]: pam_unix(sudo:session): session closed for user root Nov 03 20:11:29 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:11:29 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:11:29 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:11:29 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:11:29 devstack sudo[76845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 03 20:11:29 devstack sudo[76845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:11:29 devstack sudo[76845]: pam_unix(sudo:session): session closed for user root Nov 03 20:11:29 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.311s {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:11:29 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:11:29 devstack sudo[76937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 20:11:29 devstack sudo[76937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:11:29 devstack sudo[76937]: pam_unix(sudo:session): session closed for user root Nov 03 20:11:29 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:11:29 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:11:29 devstack sudo[76940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 20:11:29 devstack sudo[76940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:11:30 devstack sudo[76940]: pam_unix(sudo:session): session closed for user root Nov 03 20:11:30 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.349s {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:11:30 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:11:30 devstack sudo[77025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 20:11:30 devstack sudo[77025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:11:30 devstack sudo[77025]: pam_unix(sudo:session): session closed for user root Nov 03 20:11:30 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:11:30 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:11:30 devstack sudo[77032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 20:11:30 devstack sudo[77032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:11:30 devstack sudo[77032]: pam_unix(sudo:session): session closed for user root Nov 03 20:11:30 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.350s {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:11:30 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:11:30 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:11:30 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:11:30 devstack sudo[77118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 20:11:30 devstack sudo[77118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:11:30 devstack sudo[77118]: pam_unix(sudo:session): session closed for user root Nov 03 20:11:30 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:11:30 devstack cinder-volume[76318]: INFO cinder.volume.drivers.lvm [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 03 20:11:30 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:11:30 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:11:30 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:11:30 devstack sudo[77123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 20:11:30 devstack sudo[77123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:11:31 devstack sudo[77123]: pam_unix(sudo:session): session closed for user root Nov 03 20:11:31 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:11:31 devstack cinder-volume[76318]: DEBUG cinder.volume.drivers.lvm [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Updating volume stats {{(pid=76318) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 20:11:31 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:11:31 devstack sudo[77132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 20:11:31 devstack sudo[77132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:11:31 devstack sudo[77132]: pam_unix(sudo:session): session closed for user root Nov 03 20:11:31 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:11:31 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:11:31 devstack sudo[77135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 20:11:31 devstack sudo[77135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:11:31 devstack sudo[77135]: pam_unix(sudo:session): session closed for user root Nov 03 20:11:31 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:11:31 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:11:31 devstack sudo[77138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 20:11:31 devstack sudo[77138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:11:31 devstack sudo[77138]: pam_unix(sudo:session): session closed for user root Nov 03 20:11:32 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:11:32 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:11:32 devstack sudo[77141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 20:11:32 devstack sudo[77141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:11:32 devstack sudo[77141]: pam_unix(sudo:session): session closed for user root Nov 03 20:11:32 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.300s {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:11:32 devstack cinder-volume[76318]: INFO cinder.volume.driver [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Driver hasn't implemented _init_vendor_properties() Nov 03 20:11:32 devstack cinder-volume[76318]: DEBUG cinder.volume.driver [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76318) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 03 20:11:32 devstack cinder-volume[76318]: DEBUG oslo_db.sqlalchemy.engines [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76318) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 20:11:32 devstack cinder-volume[76318]: DEBUG dbcounter [-] [76318] Writer thread running {{(pid=76318) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 20:11:32 devstack cinder-volume[76318]: DEBUG cinder.db.api [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Building query based on filter {{(pid=76318) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 03 20:11:32 devstack cinder-volume[76318]: DEBUG cinder.image.image_utils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76318) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 03 20:11:32 devstack cinder-volume[76318]: INFO cinder.keymgr.migration [None req-fa8cbca1-1c20-493d-bb45-9fb183ab99c7 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 03 20:11:32 devstack cinder-volume[76318]: DEBUG cinder.volume.drivers.lvm [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Updating volume stats {{(pid=76318) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 20:11:32 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:11:32 devstack sudo[77144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 20:11:32 devstack sudo[77144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:11:32 devstack sudo[77144]: pam_unix(sudo:session): session closed for user root Nov 03 20:11:32 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:11:32 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:11:32 devstack sudo[77147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 20:11:32 devstack sudo[77147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:11:32 devstack sudo[77147]: pam_unix(sudo:session): session closed for user root Nov 03 20:11:32 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:11:32 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:11:33 devstack sudo[77152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 20:11:33 devstack sudo[77152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:11:33 devstack sudo[77152]: pam_unix(sudo:session): session closed for user root Nov 03 20:11:33 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.288s {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:11:33 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:11:33 devstack sudo[77155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 20:11:33 devstack sudo[77155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:11:33 devstack sudo[77155]: pam_unix(sudo:session): session closed for user root Nov 03 20:11:33 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:11:33 devstack cinder-volume[76318]: DEBUG cinder.manager [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Notifying Schedulers of capabilities ... {{(pid=76318) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:11:33 devstack cinder-volume[76318]: INFO cinder.volume.manager [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Driver initialization completed successfully. Nov 03 20:11:33 devstack cinder-volume[76318]: INFO cinder.manager [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Initiating service 2 cleanup Nov 03 20:11:33 devstack cinder-volume[76318]: INFO cinder.manager [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Service 2 cleanup completed. Nov 03 20:11:33 devstack cinder-volume[76318]: DEBUG cinder.service [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Creating RPC server for service cinder-volume {{(pid=76318) start /opt/stack/cinder/cinder/service.py:231}} Nov 03 20:11:33 devstack cinder-volume[76318]: DEBUG cinder.service [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76318) start /opt/stack/cinder/cinder/service.py:237}} Nov 03 20:11:33 devstack cinder-volume[76318]: INFO cinder.volume.manager [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 03 20:11:33 devstack cinder-volume[76318]: DEBUG cinder.volume.drivers.lvm [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Updating volume stats {{(pid=76318) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 20:11:33 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:11:33 devstack sudo[77159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 20:11:33 devstack sudo[77159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:11:34 devstack sudo[77159]: pam_unix(sudo:session): session closed for user root Nov 03 20:11:34 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:11:34 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:11:34 devstack sudo[77162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 20:11:34 devstack sudo[77162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:11:34 devstack sudo[77162]: pam_unix(sudo:session): session closed for user root Nov 03 20:11:34 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:11:34 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:11:34 devstack sudo[77170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 20:11:34 devstack sudo[77170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:11:34 devstack sudo[77170]: pam_unix(sudo:session): session closed for user root Nov 03 20:11:34 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:11:34 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:11:34 devstack sudo[77173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 20:11:34 devstack sudo[77173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:11:34 devstack sudo[77173]: pam_unix(sudo:session): session closed for user root Nov 03 20:11:34 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:11:34 devstack cinder-volume[76318]: INFO cinder.volume.manager [None req-f4f3f01a-30ee-4eed-b1d2-662af66c1f5c None None] Driver post RPC initialization completed successfully. Nov 03 20:11:37 devstack cinder-volume[76156]: DEBUG dbcounter [-] [76156] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:11:40 devstack cinder-volume[76318]: DEBUG oslo_service.periodic_task [None req-03321991-0921-4775-896f-e366f2b93c5e None None] Running periodic task VolumeManager._thread_info {{(pid=76318) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:11:40 devstack cinder-volume[76318]: DEBUG cinder.volume.manager [None req-03321991-0921-4775-896f-e366f2b93c5e None None] thread count: 6 {{(pid=76318) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:11:40 devstack cinder-volume[76318]: DEBUG cinder.volume.manager [None req-03321991-0921-4775-896f-e366f2b93c5e None None] thread info: [<_MainThread(MainThread, started 136120847966336)>, , , , , ] {{(pid=76318) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:11:44 devstack cinder-volume[76318]: DEBUG dbcounter [-] [76318] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76318) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:11:44 devstack cinder-volume[76318]: DEBUG dbcounter [-] [76318] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76318) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:12:40 devstack cinder-volume[76318]: DEBUG oslo_service.periodic_task [None req-03321991-0921-4775-896f-e366f2b93c5e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76318) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:12:40 devstack cinder-volume[76318]: DEBUG cinder.volume.drivers.lvm [None req-03321991-0921-4775-896f-e366f2b93c5e None None] Updating volume stats {{(pid=76318) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 20:12:40 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-03321991-0921-4775-896f-e366f2b93c5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:12:40 devstack sudo[79422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 20:12:40 devstack sudo[79422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:12:41 devstack sudo[79422]: pam_unix(sudo:session): session closed for user root Nov 03 20:12:41 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-03321991-0921-4775-896f-e366f2b93c5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:12:41 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-03321991-0921-4775-896f-e366f2b93c5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:12:41 devstack sudo[79428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 20:12:41 devstack sudo[79428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:12:41 devstack sudo[79428]: pam_unix(sudo:session): session closed for user root Nov 03 20:12:41 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-03321991-0921-4775-896f-e366f2b93c5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:12:41 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-03321991-0921-4775-896f-e366f2b93c5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:12:41 devstack sudo[79432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 20:12:41 devstack sudo[79432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:12:41 devstack sudo[79432]: pam_unix(sudo:session): session closed for user root Nov 03 20:12:41 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-03321991-0921-4775-896f-e366f2b93c5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:12:41 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-03321991-0921-4775-896f-e366f2b93c5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:12:41 devstack sudo[79435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 20:12:41 devstack sudo[79435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:12:41 devstack sudo[79435]: pam_unix(sudo:session): session closed for user root Nov 03 20:12:41 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-03321991-0921-4775-896f-e366f2b93c5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:12:41 devstack cinder-volume[76318]: DEBUG cinder.manager [None req-03321991-0921-4775-896f-e366f2b93c5e None None] Notifying Schedulers of capabilities ... {{(pid=76318) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:12:41 devstack cinder-volume[76318]: DEBUG oslo_service.periodic_task [None req-03321991-0921-4775-896f-e366f2b93c5e None None] Running periodic task VolumeManager._thread_info {{(pid=76318) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:12:41 devstack cinder-volume[76318]: DEBUG cinder.volume.manager [None req-03321991-0921-4775-896f-e366f2b93c5e None None] thread count: 6 {{(pid=76318) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:12:41 devstack cinder-volume[76318]: DEBUG cinder.volume.manager [None req-03321991-0921-4775-896f-e366f2b93c5e None None] thread info: [<_MainThread(MainThread, started 136120847966336)>, , , , , ] {{(pid=76318) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:13:40 devstack cinder-volume[76318]: DEBUG oslo_service.periodic_task [None req-03321991-0921-4775-896f-e366f2b93c5e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76318) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:13:40 devstack cinder-volume[76318]: DEBUG cinder.volume.drivers.lvm [None req-03321991-0921-4775-896f-e366f2b93c5e None None] Updating volume stats {{(pid=76318) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 20:13:40 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-03321991-0921-4775-896f-e366f2b93c5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:13:40 devstack sudo[82590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 20:13:40 devstack sudo[82590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:13:41 devstack sudo[82590]: pam_unix(sudo:session): session closed for user root Nov 03 20:13:41 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-03321991-0921-4775-896f-e366f2b93c5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:13:41 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-03321991-0921-4775-896f-e366f2b93c5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:13:41 devstack sudo[82634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 20:13:41 devstack sudo[82634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:13:41 devstack sudo[82634]: pam_unix(sudo:session): session closed for user root Nov 03 20:13:41 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-03321991-0921-4775-896f-e366f2b93c5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:13:41 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-03321991-0921-4775-896f-e366f2b93c5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:13:41 devstack sudo[82638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 20:13:41 devstack sudo[82638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:13:41 devstack sudo[82638]: pam_unix(sudo:session): session closed for user root Nov 03 20:13:41 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-03321991-0921-4775-896f-e366f2b93c5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:13:41 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-03321991-0921-4775-896f-e366f2b93c5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:13:41 devstack sudo[82645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 20:13:41 devstack sudo[82645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:13:41 devstack sudo[82645]: pam_unix(sudo:session): session closed for user root Nov 03 20:13:41 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-03321991-0921-4775-896f-e366f2b93c5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:13:41 devstack cinder-volume[76318]: DEBUG cinder.manager [None req-03321991-0921-4775-896f-e366f2b93c5e None None] Notifying Schedulers of capabilities ... {{(pid=76318) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:13:41 devstack cinder-volume[76318]: DEBUG oslo_service.periodic_task [None req-03321991-0921-4775-896f-e366f2b93c5e None None] Running periodic task VolumeManager._thread_info {{(pid=76318) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:13:41 devstack cinder-volume[76318]: DEBUG cinder.volume.manager [None req-03321991-0921-4775-896f-e366f2b93c5e None None] thread count: 6 {{(pid=76318) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:13:41 devstack cinder-volume[76318]: DEBUG cinder.volume.manager [None req-03321991-0921-4775-896f-e366f2b93c5e None None] thread info: [<_MainThread(MainThread, started 136120847966336)>, , , , , ] {{(pid=76318) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:13:44 devstack cinder-volume[76318]: DEBUG dbcounter [-] [76318] Writing DB stats cinder:SELECT=1 {{(pid=76318) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:13:44 devstack cinder-volume[76318]: DEBUG dbcounter [-] [76318] Writing DB stats cinder:UPDATE=1 {{(pid=76318) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:14:40 devstack cinder-volume[76318]: DEBUG oslo_service.periodic_task [None req-03321991-0921-4775-896f-e366f2b93c5e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76318) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:14:40 devstack cinder-volume[76318]: DEBUG cinder.volume.drivers.lvm [None req-03321991-0921-4775-896f-e366f2b93c5e None None] Updating volume stats {{(pid=76318) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 20:14:40 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-03321991-0921-4775-896f-e366f2b93c5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:14:40 devstack sudo[84741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 20:14:40 devstack sudo[84741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:14:41 devstack sudo[84741]: pam_unix(sudo:session): session closed for user root Nov 03 20:14:41 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-03321991-0921-4775-896f-e366f2b93c5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:14:41 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-03321991-0921-4775-896f-e366f2b93c5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:14:41 devstack sudo[84745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 20:14:41 devstack sudo[84745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:14:41 devstack sudo[84745]: pam_unix(sudo:session): session closed for user root Nov 03 20:14:41 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-03321991-0921-4775-896f-e366f2b93c5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:14:41 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-03321991-0921-4775-896f-e366f2b93c5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:14:41 devstack sudo[84763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 20:14:41 devstack sudo[84763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:14:41 devstack sudo[84763]: pam_unix(sudo:session): session closed for user root Nov 03 20:14:41 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-03321991-0921-4775-896f-e366f2b93c5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:14:41 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-03321991-0921-4775-896f-e366f2b93c5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:14:41 devstack sudo[84772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 20:14:41 devstack sudo[84772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:14:41 devstack sudo[84772]: pam_unix(sudo:session): session closed for user root Nov 03 20:14:41 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-03321991-0921-4775-896f-e366f2b93c5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:14:41 devstack cinder-volume[76318]: DEBUG cinder.manager [None req-03321991-0921-4775-896f-e366f2b93c5e None None] Notifying Schedulers of capabilities ... {{(pid=76318) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:14:41 devstack cinder-volume[76318]: DEBUG oslo_service.periodic_task [None req-03321991-0921-4775-896f-e366f2b93c5e None None] Running periodic task VolumeManager._thread_info {{(pid=76318) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:14:41 devstack cinder-volume[76318]: DEBUG cinder.volume.manager [None req-03321991-0921-4775-896f-e366f2b93c5e None None] thread count: 6 {{(pid=76318) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:14:41 devstack cinder-volume[76318]: DEBUG cinder.volume.manager [None req-03321991-0921-4775-896f-e366f2b93c5e None None] thread info: [<_MainThread(MainThread, started 136120847966336)>, , , , , ] {{(pid=76318) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:15:40 devstack cinder-volume[76318]: DEBUG oslo_service.periodic_task [None req-03321991-0921-4775-896f-e366f2b93c5e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76318) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:15:40 devstack cinder-volume[76318]: DEBUG cinder.volume.drivers.lvm [None req-03321991-0921-4775-896f-e366f2b93c5e None None] Updating volume stats {{(pid=76318) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 20:15:40 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-03321991-0921-4775-896f-e366f2b93c5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:15:40 devstack sudo[85949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 20:15:40 devstack sudo[85949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:15:41 devstack sudo[85949]: pam_unix(sudo:session): session closed for user root Nov 03 20:15:41 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-03321991-0921-4775-896f-e366f2b93c5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:15:41 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-03321991-0921-4775-896f-e366f2b93c5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:15:41 devstack sudo[85953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 20:15:41 devstack sudo[85953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:15:41 devstack sudo[85953]: pam_unix(sudo:session): session closed for user root Nov 03 20:15:41 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-03321991-0921-4775-896f-e366f2b93c5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:15:41 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-03321991-0921-4775-896f-e366f2b93c5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:15:41 devstack sudo[85967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 20:15:41 devstack sudo[85967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:15:41 devstack sudo[85967]: pam_unix(sudo:session): session closed for user root Nov 03 20:15:41 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-03321991-0921-4775-896f-e366f2b93c5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:15:41 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-03321991-0921-4775-896f-e366f2b93c5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:15:41 devstack sudo[85970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 20:15:41 devstack sudo[85970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:15:41 devstack sudo[85970]: pam_unix(sudo:session): session closed for user root Nov 03 20:15:41 devstack cinder-volume[76318]: DEBUG oslo_concurrency.processutils [None req-03321991-0921-4775-896f-e366f2b93c5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:15:41 devstack cinder-volume[76318]: DEBUG cinder.manager [None req-03321991-0921-4775-896f-e366f2b93c5e None None] Notifying Schedulers of capabilities ... {{(pid=76318) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:15:41 devstack cinder-volume[76318]: DEBUG oslo_service.periodic_task [None req-03321991-0921-4775-896f-e366f2b93c5e None None] Running periodic task VolumeManager._thread_info {{(pid=76318) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:15:41 devstack cinder-volume[76318]: DEBUG cinder.volume.manager [None req-03321991-0921-4775-896f-e366f2b93c5e None None] thread count: 6 {{(pid=76318) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:15:41 devstack cinder-volume[76318]: DEBUG cinder.volume.manager [None req-03321991-0921-4775-896f-e366f2b93c5e None None] thread info: [<_MainThread(MainThread, started 136120847966336)>, , , , , ] {{(pid=76318) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:15:44 devstack cinder-volume[76318]: DEBUG dbcounter [-] [76318] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76318) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:15:53 devstack cinder-volume[76156]: INFO oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] Caught SIGTERM, stopping children Nov 03 20:15:53 devstack cinder-volume[76156]: DEBUG oslo_concurrency.lockutils [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] Acquiring lock "singleton_lock" {{(pid=76156) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 20:15:53 devstack cinder-volume[76156]: DEBUG oslo_concurrency.lockutils [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] Acquired lock "singleton_lock" {{(pid=76156) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 20:15:53 devstack cinder-volume[76156]: DEBUG oslo_concurrency.lockutils [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] Releasing lock "singleton_lock" {{(pid=76156) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 20:15:53 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] Stop services. {{(pid=76156) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 03 20:15:53 devstack cinder-volume[76156]: DEBUG oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] Killing children. {{(pid=76156) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 03 20:15:53 devstack cinder-volume[76156]: INFO oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] Waiting on 1 children to exit Nov 03 20:15:58 devstack cinder-volume[76318]: DEBUG oslo_concurrency.lockutils [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] Acquiring lock "singleton_lock" {{(pid=76318) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 20:15:58 devstack cinder-volume[76318]: DEBUG oslo_concurrency.lockutils [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] Acquired lock "singleton_lock" {{(pid=76318) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 20:15:58 devstack cinder-volume[76318]: DEBUG oslo_concurrency.lockutils [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] Releasing lock "singleton_lock" {{(pid=76318) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 20:15:58 devstack cinder-volume[76318]: WARNING amqp [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 20:15:58 devstack cinder-volume[76318]: WARNING amqp [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 20:15:58 devstack cinder-volume[76156]: INFO oslo_service.backend._eventlet.service [None req-1e70d19b-c281-436d-aae5-64ade0a56bbe None None] Child 76318 exited with status 0 Nov 03 20:15:59 devstack cinder-volume[86404]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 03 20:15:59 devstack cinder-volume[86404]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 20:15:59 devstack cinder-volume[86404]: we strongly recommend against using it for new projects. Nov 03 20:15:59 devstack cinder-volume[86404]: If you are already using Eventlet, we recommend migrating to a different Nov 03 20:15:59 devstack cinder-volume[86404]: framework. For more detail see Nov 03 20:15:59 devstack cinder-volume[86404]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 20:15:59 devstack cinder-volume[86404]: import eventlet # noqa Nov 03 20:16:01 devstack cinder-volume[86404]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86404) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 20:16:01 devstack cinder-volume[86404]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86404) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 20:16:01 devstack cinder-volume[86404]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86404) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 20:16:01 devstack cinder-volume[86404]: INFO dbcounter [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] Registered counter for database cinder Nov 03 20:16:01 devstack cinder-volume[86404]: DEBUG oslo_db.sqlalchemy.engines [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86404) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG dbcounter [-] [86404] Writer thread running {{(pid=86404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 20:16:02 devstack cinder-volume[86404]: INFO cinder.rpc [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 03 20:16:02 devstack cinder-volume[86404]: INFO cinder.rpc [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_db.sqlalchemy.engines [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86404) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 20:16:02 devstack cinder-volume[86404]: INFO cinder.volume.manager [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] Determined volume DB was empty at startup. Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG cinder.volume.manager [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86404) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 03 20:16:02 devstack cinder-volume[86404]: INFO cinder.volume.manager [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 03 20:16:02 devstack cinder-volume[86404]: WARNING stevedore.named [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 20:16:02 devstack cinder-volume[86404]: WARNING castellan.key_manager [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 20:16:02 devstack cinder-volume[86404]: WARNING cinder.keymgr.conf_key_mgr [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 20:16:02 devstack cinder-volume[86404]: INFO cinder.volume.manager [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_db.sqlalchemy.engines [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86404) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 20:16:02 devstack cinder-volume[86404]: INFO oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] Starting 1 workers Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] Started child 86628 {{(pid=86404) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] Full set of CONF: {{(pid=86404) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] ******************************************************************************** {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] Configuration options gathered from: {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] ================================================================================ {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] allow_availability_zone_fallback = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] allow_compression_on_image_upload = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] allowed_direct_url_schemes = [] {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] api_rate_limit = True {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] auth_strategy = keystone {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_availability_zone = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_host = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_name = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_stats_polling_interval = 60 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backup_api_class = cinder.backup.api.API {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backup_name_template = backup-%s {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backup_use_same_host = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backup_use_temp_snapshot = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] chap_password = **** {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] chap_username = {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] cinder_internal_tenant_project_id = 1191cf37b1364535a784e8e6b01582cb {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] cinder_internal_tenant_user_id = 6c974cb5dc614b28afc3f5382be5016d {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] cluster = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] compression_format = gzip {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] compute_api_class = cinder.compute.nova.API {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] config_dir = [] {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] config_source = [] {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] control_exchange = openstack {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] debug = True {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] default_availability_zone = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86628]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] default_group_type = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] default_volume_type = QuobyteHD {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] disk_geometry = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] driver_client_cert = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] driver_client_cert_key = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] driver_data_namespace = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] driver_ssl_cert_path = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] driver_ssl_cert_verify = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] driver_use_ssl = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] enable_new_services = True {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] enable_unsupported_driver = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] enabled_backends = ['QuobyteHD'] {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] enforce_multipath_for_image_xfer = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] filter_function = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] glance_api_insecure = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] glance_api_servers = ['http://192.168.122.118/image'] {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] glance_api_ssl_compression = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] glance_ca_certificates_file = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] glance_catalog_info = image:glance:publicURL {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] glance_certfile = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] glance_keyfile = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] glance_num_retries = 3 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] glance_request_timeout = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] goodness_function = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] graceful_shutdown_timeout = 5 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] group_api_class = cinder.group.api.API {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] host = devstack {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] image_compress_on_upload = True {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] image_conversion_address_space_limit = 1 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] image_conversion_cpu_limit = 60 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] image_conversion_disable = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] image_introspection_address_space_limit = 1 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] image_introspection_cpu_limit = 60 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] image_upload_use_cinder_backend = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] image_upload_use_internal_tenant = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] image_volume_cache_enabled = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] image_volume_cache_max_count = 0 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] image_volume_cache_max_size_gb = 0 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] init_host_max_objects_retrieval = 0 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] instance_format = [instance: %(uuid)s] {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] iscsi_target_flags = {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] iscsi_write_cache = on {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] iser_helper = tgtadm {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] iser_ip_address = 192.168.122.118 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] iser_port = 3260 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] log_color = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] log_config_append = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] log_dir = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] log_file = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] log_options = True {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] log_rotate_interval = 1 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] log_rotate_interval_type = days {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] log_rotation_type = none {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] max_age = 0 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] max_logfile_count = 30 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] max_logfile_size_mb = 200 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] max_over_subscription_ratio = 20.0 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] message_reap_interval = 86400 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] message_ttl = 2592000 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] migration_create_volume_timeout_secs = 300 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] monkey_patch = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] monkey_patch_modules = [] {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] my_ip = 192.168.122.118 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] no_snapshot_gb_quota = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] num_iser_scan_tries = 3 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] num_shell_tries = 3 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] num_volume_device_scan_tries = 3 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] nvmeof_conn_info_version = 1 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] nvmet_ns_id = 10 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] nvmet_port_id = 1 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] osapi_max_limit = 1000 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] osapi_volume_ext_list = [] {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] osapi_volume_listen = 0.0.0.0 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] osapi_volume_listen_port = 8776 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] osapi_volume_use_ssl = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] osapi_volume_workers = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] per_volume_size_limit = -1 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-d5f70dc7-cb0a-4543-b042-892308e8e43e None None] Starting volume driver QuobyteDriver (1.2.1) Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] periodic_fuzzy_delay = 60 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] periodic_interval = 60 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] project_id_regex = [0-9a-f\-]+ {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-d5f70dc7-cb0a-4543-b042-892308e8e43e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86628) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] public_endpoint = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] publish_errors = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] quota_backup_gigabytes = 1000 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] quota_backups = 10 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] quota_gigabytes = 1000 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] quota_groups = 10 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] quota_snapshots = 10 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] quota_volumes = 10 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] rate_limit_burst = 0 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] rate_limit_except_level = CRITICAL {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] rate_limit_interval = 0 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] reinit_driver_count = 3 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] replication_device = **** {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] report_discard_supported = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] report_interval = 120 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] reservation_clean_interval = 86400 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] reservation_expire = 86400 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] reserved_image_namespaces = [] {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] reserved_percentage = 0 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] rpc_response_timeout = 120 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] run_external_periodic_tasks = True {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] scst_target_driver = iscsi {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] scst_target_iqn_name = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] service_down_time = 720 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] shell_completion = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] snapshot_name_template = snapshot-%s {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] split_loggers = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] state_path = /opt/stack/data/cinder {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] storage_availability_zone = nova {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] storage_protocol = iSCSI {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] syslog_log_facility = LOG_USER {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] target_helper = lioadm {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] target_ip_address = 192.168.122.118 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] target_port = 3260 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] target_protocol = iscsi {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] target_secondary_ip_addresses = [] {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] trace_flags = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] transfer_api_class = cinder.transfer.api.API {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] transport_url = **** {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] until_refresh = 0 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] use_chap_auth = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] use_default_quota_class = True {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] use_journal = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] use_json = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] use_multipath_for_image_xfer = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] use_stderr = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] use_syslog = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] verify_glance_signatures = enabled {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] volume_api_class = cinder.volume.api.API {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] volume_backend_name = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] volume_clear = zero {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] volume_clear_ionice = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] volume_clear_size = 0 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] volume_copy_bps_limit = 0 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] volume_dd_blocksize = 1M {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] volume_name_template = volume-%s {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] volume_service_inithost_offload = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] volume_usage_audit_period = month {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] zoning_mode = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_concurrency.disable_process_locking = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] keystone_authtoken.auth_section = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] keystone_authtoken.auth_type = password {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] keystone_authtoken.auth_version = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] keystone_authtoken.cache = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] keystone_authtoken.certfile = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] keystone_authtoken.delay_auth_decision = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] keystone_authtoken.http_connect_timeout = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] keystone_authtoken.include_service_catalog = True {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] keystone_authtoken.insecure = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] keystone_authtoken.interface = public {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] keystone_authtoken.keyfile = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] keystone_authtoken.memcache_password = **** {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] keystone_authtoken.memcache_username = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] keystone_authtoken.region_name = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] keystone_authtoken.service_token_roles_required = True {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] keystone_authtoken.service_type = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] keystone_authtoken.token_cache_time = 300 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.118/identity {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] cache.backend = dogpile.cache.null {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] cache.backend_argument = **** {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] cache.backend_expiration_time = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] cache.config_prefix = cache.oslo {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] cache.debug_cache_backend = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] cache.enable_retry_client = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] cache.enable_socket_keepalive = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] cache.enabled = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] cache.expiration_time = 600 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] cache.hashclient_retry_attempts = 2 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] cache.memcache_dead_retry = 300 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] cache.memcache_pool_maxsize = 10 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] cache.memcache_sasl_enabled = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] cache.password = **** {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] cache.proxies = [] {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] cache.redis_db = 0 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] cache.redis_sentinel_service_name = mymaster {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] cache.redis_server = localhost:6379 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] cache.retry_attempts = 2 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] cache.retry_delay = 0.0 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] cache.socket_keepalive_count = 1 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] cache.socket_keepalive_idle = 1 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] cache.socket_keepalive_interval = 1 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] cache.socket_timeout = 1.0 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] cache.tls_allowed_ciphers = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] cache.tls_cafile = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] cache.tls_certfile = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] cache.tls_enabled = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] cache.tls_keyfile = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] cache.username = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] coordination.backend_url = **** {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] database.asyncio_connection = **** {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] database.asyncio_slave_connection = **** {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] database.backend = sqlalchemy {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] database.connection = **** {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] database.connection_debug = 0 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] database.connection_parameters = {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] database.connection_recycle_time = 3600 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] database.connection_trace = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] database.db_inc_retry_interval = True {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] database.db_max_retries = 20 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] database.db_max_retry_interval = 10 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] database.db_retry_interval = 1 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] database.max_overflow = 50 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] database.max_pool_size = 5 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] database.max_retries = 10 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] database.mysql_wsrep_sync_wait = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] database.pool_timeout = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] database.retry_interval = 10 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] database.slave_connection = **** {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] database.sqlite_synchronous = True {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] database.synchronous_reader = True {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] database.use_db_reconnect = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_tracing.insecure = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] profiler.connection_string = messaging:// {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] profiler.enabled = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] profiler.es_doc_type = notification {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] profiler.es_scroll_size = 10000 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] profiler.es_scroll_time = 2m {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] profiler.filter_error_trace = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] profiler.hmac_keys = **** {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] profiler.sentinel_service_name = mymaster {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] profiler.socket_timeout = 0.1 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] profiler.trace_requests = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] profiler.trace_sqlalchemy = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] profiler_jaeger.process_tags = {} {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] profiler_jaeger.service_name_prefix = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] profiler_otlp.service_name_prefix = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_policy.enforce_new_defaults = True {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_policy.policy_default_rule = default {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_policy.policy_file = policy.yaml {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_policy.remote_timeout = 60.0 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] privsep_osbrick.group = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] privsep_osbrick.helper_command = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] privsep_osbrick.user = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] cinder_sys_admin.group = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] cinder_sys_admin.helper_command = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] cinder_sys_admin.user = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] service_user.auth_section = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] service_user.auth_type = password {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] service_user.cafile = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] service_user.certfile = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] service_user.collect_timing = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] service_user.insecure = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] service_user.keyfile = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] service_user.send_service_user_token = True {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] service_user.split_loggers = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] service_user.timeout = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] service_user.tls_ciphers = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] service_user.tls_min_version = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] glance.auth_section = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] glance.auth_type = password {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] glance.certfile = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] glance.collect_timing = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] glance.insecure = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] glance.keyfile = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] glance.region_name = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] glance.split_loggers = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] glance.timeout = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] glance.tls_ciphers = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] glance.tls_min_version = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.backend_availability_zone = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.chap_password = **** {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.chap_username = {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.disk_geometry = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.driver_client_cert = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.driver_client_cert_key = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.driver_data_namespace = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.driver_use_ssl = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.enable_unsupported_driver = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.extra_capabilities = {} {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.filter_function = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.goodness_function = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.iscsi_target_flags = {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.iscsi_write_cache = on {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.iser_helper = tgtadm {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.iser_ip_address = 192.168.122.118 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.iser_port = 3260 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.nas_host = {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.nas_login = admin {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.nas_mount_options = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.nas_password = **** {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.nas_private_key = {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.nas_share_path = {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.nas_ssh_port = 22 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.num_shell_tries = 3 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d5f70dc7-cb0a-4543-b042-892308e8e43e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86628) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.nvmet_port_id = 1 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.quobyte [None req-d5f70dc7-cb0a-4543-b042-892308e8e43e None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.quobyte_client_cfg = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.quobyte [None req-d5f70dc7-cb0a-4543-b042-892308e8e43e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d5f70dc7-cb0a-4543-b042-892308e8e43e None None] Running cmd (subprocess): mount.quobyte {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.quobyte_volume_url = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.replication_device = **** {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.report_discard_supported = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.reserved_percentage = 0 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.scst_target_driver = iscsi {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.scst_target_iqn_name = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.storage_protocol = iSCSI {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.target_helper = tgtadm {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.target_ip_address = 192.168.122.118 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.target_port = 3260 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.target_protocol = iscsi {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.trace_flags = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.unique_fqdn_network = True {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.use_chap_auth = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.volume_backend_name = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.volume_clear = zero {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.volume_clear_ionice = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.volume_clear_size = 0 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_reports.file_event_handler = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_reports.log_dir = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.backend_availability_zone = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.backend_host = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.chap_password = **** {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.chap_username = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.chiscsi_conf = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.disk_geometry = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.driver_client_cert = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.driver_client_cert_key = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.driver_data_namespace = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.driver_use_ssl = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.extra_capabilities = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.filter_function = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.goodness_function = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.iscsi_target_flags = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.iscsi_write_cache = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.iser_helper = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.iser_ip_address = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.iser_port = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.iser_target_prefix = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.nas_host = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.nas_login = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.nas_mount_options = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.nas_password = **** {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.nas_private_key = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.nas_share_path = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.nas_ssh_port = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.num_shell_tries = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.nvmet_ns_id = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.nvmet_port_id = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.replication_device = **** {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.report_discard_supported = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.reserved_percentage = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.scst_target_driver = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.storage_protocol = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.target_helper = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.target_ip_address = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.target_port = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.target_prefix = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.target_protocol = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.trace_flags = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.unique_fqdn_network = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.use_chap_auth = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.volume_clear = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.volume_clear_ionice = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.volume_clear_size = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] QuobyteHD.volumes_dir = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_rabbit.ssl = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_rabbit.ssl_version = {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_notifications.driver = [] {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_notifications.retry = -1 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] oslo_messaging_notifications.transport_url = **** {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] key_manager.fixed_key = **** {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] barbican.barbican_api_version = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] barbican.barbican_endpoint = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] barbican.barbican_endpoint_type = public {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] barbican.barbican_region_name = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] barbican.cafile = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] barbican.certfile = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] barbican.collect_timing = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] barbican.insecure = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] barbican.keyfile = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] barbican.number_of_retries = 60 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] barbican.retry_delay = 1 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] barbican.send_service_user_token = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] barbican.split_loggers = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] barbican.timeout = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] barbican.tls_ciphers = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] barbican.tls_min_version = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] barbican.verify_ssl = True {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] barbican.verify_ssl_path = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] barbican_service_user.auth_section = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] barbican_service_user.auth_type = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] barbican_service_user.cafile = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] barbican_service_user.certfile = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] barbican_service_user.collect_timing = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] barbican_service_user.insecure = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] barbican_service_user.keyfile = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] barbican_service_user.split_loggers = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] barbican_service_user.timeout = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] barbican_service_user.tls_ciphers = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] barbican_service_user.tls_min_version = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] vault.approle_role_id = **** {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] vault.approle_secret_id = **** {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] vault.auth_method = approle {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] vault.auth_path = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] vault.kv_mountpoint = secret {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] vault.kv_path = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] vault.kv_version = 2 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] vault.namespace = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] vault.root_token_id = **** {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] vault.ssl_ca_crt_file = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] vault.timeout = 60.0 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] vault.token_file = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] vault.token_role = None {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] vault.use_ssl = False {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:02 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] ******************************************************************************** {{(pid=86404) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 03 20:16:02 devstack quobyte-client[86633]: Reading configuration file: /etc/quobyte/client.cfg Nov 03 20:16:02 devstack quobyte-client[86633]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 03 20:16:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d5f70dc7-cb0a-4543-b042-892308e8e43e None None] CMD "mount.quobyte" returned: 1 in 0.102s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:16:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d5f70dc7-cb0a-4543-b042-892308e8e43e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:16:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d5f70dc7-cb0a-4543-b042-892308e8e43e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:16:02 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d5f70dc7-cb0a-4543-b042-892308e8e43e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:16:02 devstack cinder-volume[86628]: INFO cinder.volume.drivers.quobyte [None req-d5f70dc7-cb0a-4543-b042-892308e8e43e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 ... Nov 03 20:16:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d5f70dc7-cb0a-4543-b042-892308e8e43e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 -c /etc/quobyte/client-cinder.cfg {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:16:02 devstack sudo[86634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 -c /etc/quobyte/client-cinder.cfg Nov 03 20:16:02 devstack sudo[86634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:16:03 devstack sudo[86634]: pam_unix(sudo:session): session closed for user root Nov 03 20:16:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d5f70dc7-cb0a-4543-b042-892308e8e43e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.397s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:16:03 devstack cinder-volume[86628]: INFO cinder.volume.drivers.quobyte [None req-d5f70dc7-cb0a-4543-b042-892308e8e43e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 succeeded Nov 03 20:16:03 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d5f70dc7-cb0a-4543-b042-892308e8e43e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:16:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d5f70dc7-cb0a-4543-b042-892308e8e43e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.410s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:16:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d5f70dc7-cb0a-4543-b042-892308e8e43e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:16:03 devstack sudo[86736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:16:03 devstack sudo[86736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:16:03 devstack sudo[86736]: pam_unix(sudo:session): session closed for user root Nov 03 20:16:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d5f70dc7-cb0a-4543-b042-892308e8e43e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.235s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:16:03 devstack cinder-volume[86628]: INFO cinder.volume.driver [None req-d5f70dc7-cb0a-4543-b042-892308e8e43e None None] Driver hasn't implemented _init_vendor_properties() Nov 03 20:16:03 devstack cinder-volume[86628]: DEBUG cinder.volume.driver [None req-d5f70dc7-cb0a-4543-b042-892308e8e43e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6631889343262, 'free_capacity_gb': 1773.6631889343262, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86628) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 03 20:16:03 devstack cinder-volume[86628]: DEBUG oslo_db.sqlalchemy.engines [None req-d5f70dc7-cb0a-4543-b042-892308e8e43e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86628) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 20:16:03 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writer thread running {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 20:16:03 devstack cinder-volume[86628]: DEBUG cinder.db.api [None req-d5f70dc7-cb0a-4543-b042-892308e8e43e None None] Building query based on filter {{(pid=86628) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 03 20:16:03 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-d5f70dc7-cb0a-4543-b042-892308e8e43e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86628) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 03 20:16:03 devstack cinder-volume[86628]: INFO cinder.keymgr.migration [None req-e3f9373b-af57-47f1-bd14-a11059f1361d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 03 20:16:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d5f70dc7-cb0a-4543-b042-892308e8e43e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:16:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d5f70dc7-cb0a-4543-b042-892308e8e43e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:16:03 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d5f70dc7-cb0a-4543-b042-892308e8e43e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:16:03 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d5f70dc7-cb0a-4543-b042-892308e8e43e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:16:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d5f70dc7-cb0a-4543-b042-892308e8e43e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:16:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d5f70dc7-cb0a-4543-b042-892308e8e43e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:16:03 devstack sudo[86739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:16:03 devstack sudo[86739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:16:03 devstack sudo[86739]: pam_unix(sudo:session): session closed for user root Nov 03 20:16:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d5f70dc7-cb0a-4543-b042-892308e8e43e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.232s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:16:04 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-d5f70dc7-cb0a-4543-b042-892308e8e43e None None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:16:04 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-d5f70dc7-cb0a-4543-b042-892308e8e43e None None] Driver initialization completed successfully. Nov 03 20:16:04 devstack cinder-volume[86628]: INFO cinder.manager [None req-d5f70dc7-cb0a-4543-b042-892308e8e43e None None] Initiating service 3 cleanup Nov 03 20:16:04 devstack cinder-volume[86628]: INFO cinder.manager [None req-d5f70dc7-cb0a-4543-b042-892308e8e43e None None] Service 3 cleanup completed. Nov 03 20:16:04 devstack cinder-volume[86628]: DEBUG cinder.service [None req-d5f70dc7-cb0a-4543-b042-892308e8e43e None None] Creating RPC server for service cinder-volume {{(pid=86628) start /opt/stack/cinder/cinder/service.py:231}} Nov 03 20:16:04 devstack cinder-volume[86628]: DEBUG cinder.service [None req-d5f70dc7-cb0a-4543-b042-892308e8e43e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86628) start /opt/stack/cinder/cinder/service.py:237}} Nov 03 20:16:04 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-d5f70dc7-cb0a-4543-b042-892308e8e43e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 03 20:16:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d5f70dc7-cb0a-4543-b042-892308e8e43e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:16:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d5f70dc7-cb0a-4543-b042-892308e8e43e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:16:04 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d5f70dc7-cb0a-4543-b042-892308e8e43e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:16:04 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d5f70dc7-cb0a-4543-b042-892308e8e43e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:16:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d5f70dc7-cb0a-4543-b042-892308e8e43e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:16:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d5f70dc7-cb0a-4543-b042-892308e8e43e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:16:04 devstack sudo[86742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:16:04 devstack sudo[86742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:16:04 devstack sudo[86742]: pam_unix(sudo:session): session closed for user root Nov 03 20:16:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d5f70dc7-cb0a-4543-b042-892308e8e43e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.250s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:16:04 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-d5f70dc7-cb0a-4543-b042-892308e8e43e None None] Driver post RPC initialization completed successfully. Nov 03 20:16:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-dc37b07f-2c38-4c91-aa90-3e1e0f33bf4f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:16:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-dc37b07f-2c38-4c91-aa90-3e1e0f33bf4f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:16:08 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-dc37b07f-2c38-4c91-aa90-3e1e0f33bf4f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:16:08 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-dc37b07f-2c38-4c91-aa90-3e1e0f33bf4f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:16:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-dc37b07f-2c38-4c91-aa90-3e1e0f33bf4f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:16:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-dc37b07f-2c38-4c91-aa90-3e1e0f33bf4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:16:08 devstack sudo[86891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:16:08 devstack sudo[86891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:16:09 devstack sudo[86891]: pam_unix(sudo:session): session closed for user root Nov 03 20:16:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-dc37b07f-2c38-4c91-aa90-3e1e0f33bf4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.237s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:16:09 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-dc37b07f-2c38-4c91-aa90-3e1e0f33bf4f None None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:16:09 devstack cinder-volume[86404]: INFO oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] Caught SIGTERM, stopping children Nov 03 20:16:09 devstack cinder-volume[86404]: DEBUG oslo_concurrency.lockutils [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] Acquiring lock "singleton_lock" {{(pid=86404) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 20:16:09 devstack cinder-volume[86404]: DEBUG oslo_concurrency.lockutils [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] Acquired lock "singleton_lock" {{(pid=86404) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 20:16:09 devstack cinder-volume[86404]: DEBUG oslo_concurrency.lockutils [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] Releasing lock "singleton_lock" {{(pid=86404) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 20:16:09 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] Stop services. {{(pid=86404) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 03 20:16:09 devstack cinder-volume[86404]: DEBUG oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] Killing children. {{(pid=86404) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 03 20:16:09 devstack cinder-volume[86404]: INFO oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] Waiting on 1 children to exit Nov 03 20:16:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] Acquiring lock "singleton_lock" {{(pid=86628) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 20:16:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] Acquired lock "singleton_lock" {{(pid=86628) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 20:16:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] Releasing lock "singleton_lock" {{(pid=86628) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 20:16:12 devstack cinder-volume[86628]: WARNING amqp [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 20:16:12 devstack cinder-volume[86628]: WARNING amqp [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 20:16:12 devstack cinder-volume[86404]: INFO oslo_service.backend._eventlet.service [None req-74d421cc-73bf-4a9f-bb06-2626d8a06b2b None None] Child 86628 exited with status 0 Nov 03 20:16:13 devstack cinder-volume[86947]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 03 20:16:13 devstack cinder-volume[86947]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 20:16:13 devstack cinder-volume[86947]: we strongly recommend against using it for new projects. Nov 03 20:16:13 devstack cinder-volume[86947]: If you are already using Eventlet, we recommend migrating to a different Nov 03 20:16:13 devstack cinder-volume[86947]: framework. For more detail see Nov 03 20:16:13 devstack cinder-volume[86947]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 20:16:13 devstack cinder-volume[86947]: import eventlet # noqa Nov 03 20:16:15 devstack cinder-volume[86947]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86947) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 20:16:15 devstack cinder-volume[86947]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86947) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 20:16:15 devstack cinder-volume[86947]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86947) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 20:16:16 devstack cinder-volume[86947]: INFO dbcounter [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] Registered counter for database cinder Nov 03 20:16:16 devstack cinder-volume[86947]: DEBUG oslo_db.sqlalchemy.engines [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86947) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG dbcounter [-] [86947] Writer thread running {{(pid=86947) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 20:16:17 devstack cinder-volume[86947]: INFO cinder.rpc [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 03 20:16:17 devstack cinder-volume[86947]: INFO cinder.rpc [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_db.sqlalchemy.engines [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86947) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 20:16:17 devstack cinder-volume[86947]: INFO cinder.volume.manager [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] Determined volume DB was empty at startup. Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG cinder.volume.manager [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86947) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 03 20:16:17 devstack cinder-volume[86947]: WARNING stevedore.named [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 20:16:17 devstack cinder-volume[86947]: WARNING castellan.key_manager [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 20:16:17 devstack cinder-volume[86947]: WARNING cinder.keymgr.conf_key_mgr [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 20:16:17 devstack cinder-volume[86947]: INFO cinder.volume.manager [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_db.sqlalchemy.engines [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86947) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 20:16:17 devstack cinder-volume[86947]: INFO oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] Starting 1 workers Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] Started child 87248 {{(pid=86947) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] Full set of CONF: {{(pid=86947) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] ******************************************************************************** {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] Configuration options gathered from: {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] ================================================================================ {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] allow_availability_zone_fallback = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] allow_compression_on_image_upload = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] allowed_direct_url_schemes = [] {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] api_rate_limit = True {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] auth_strategy = keystone {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_availability_zone = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_host = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_name = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_stats_polling_interval = 60 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backup_api_class = cinder.backup.api.API {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backup_name_template = backup-%s {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[87248]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backup_use_same_host = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backup_use_temp_snapshot = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] chap_password = **** {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] chap_username = {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] cinder_internal_tenant_project_id = 1191cf37b1364535a784e8e6b01582cb {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] cinder_internal_tenant_user_id = 6c974cb5dc614b28afc3f5382be5016d {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] cluster = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] compression_format = gzip {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] compute_api_class = cinder.compute.nova.API {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] config_dir = [] {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] config_source = [] {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] control_exchange = openstack {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] debug = True {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] default_availability_zone = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] default_group_type = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] default_volume_type = QuobyteHD {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] disk_geometry = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] driver_client_cert = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] driver_client_cert_key = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] driver_data_namespace = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] driver_ssl_cert_path = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] driver_ssl_cert_verify = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] driver_use_ssl = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] enable_new_services = True {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] enable_unsupported_driver = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] enabled_backends = ['QuobyteHD'] {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] enforce_multipath_for_image_xfer = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] filter_function = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] glance_api_insecure = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] glance_api_servers = ['http://192.168.122.118/image'] {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] glance_api_ssl_compression = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] glance_ca_certificates_file = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] glance_catalog_info = image:glance:publicURL {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] glance_certfile = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] glance_keyfile = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] glance_num_retries = 3 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] glance_request_timeout = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] goodness_function = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] graceful_shutdown_timeout = 5 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] group_api_class = cinder.group.api.API {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] host = devstack {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] image_compress_on_upload = True {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] image_conversion_address_space_limit = 1 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] image_conversion_cpu_limit = 60 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] image_conversion_disable = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] image_introspection_address_space_limit = 1 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] image_introspection_cpu_limit = 60 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] image_upload_use_cinder_backend = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] image_upload_use_internal_tenant = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] image_volume_cache_enabled = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] image_volume_cache_max_count = 0 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] image_volume_cache_max_size_gb = 0 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] init_host_max_objects_retrieval = 0 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] instance_format = [instance: %(uuid)s] {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] iscsi_target_flags = {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] iscsi_write_cache = on {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] iser_helper = tgtadm {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] iser_ip_address = 192.168.122.118 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] iser_port = 3260 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] log_color = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] log_config_append = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] log_dir = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] log_file = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] log_options = True {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] log_rotate_interval = 1 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] log_rotate_interval_type = days {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] log_rotation_type = none {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] max_age = 0 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] max_logfile_count = 30 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] max_logfile_size_mb = 200 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] max_over_subscription_ratio = 20.0 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] message_reap_interval = 86400 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] message_ttl = 2592000 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] migration_create_volume_timeout_secs = 300 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] monkey_patch = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] monkey_patch_modules = [] {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] my_ip = 192.168.122.118 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] no_snapshot_gb_quota = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] num_iser_scan_tries = 3 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] num_shell_tries = 3 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] num_volume_device_scan_tries = 3 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] nvmeof_conn_info_version = 1 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] nvmet_ns_id = 10 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] nvmet_port_id = 1 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] osapi_max_limit = 1000 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] osapi_volume_ext_list = [] {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] osapi_volume_listen = 0.0.0.0 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] osapi_volume_listen_port = 8776 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] osapi_volume_use_ssl = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] osapi_volume_workers = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] per_volume_size_limit = -1 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] periodic_fuzzy_delay = 60 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] periodic_interval = 60 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] project_id_regex = [0-9a-f\-]+ {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] public_endpoint = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] publish_errors = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] quota_backup_gigabytes = 1000 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] quota_backups = 10 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] quota_gigabytes = 1000 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] quota_groups = 10 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] quota_snapshots = 10 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] quota_volumes = 10 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] rate_limit_burst = 0 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] rate_limit_except_level = CRITICAL {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] rate_limit_interval = 0 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] reinit_driver_count = 3 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] replication_device = **** {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] report_discard_supported = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] report_interval = 120 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] reservation_clean_interval = 86400 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] reservation_expire = 86400 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] reserved_image_namespaces = [] {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] reserved_percentage = 0 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] rpc_response_timeout = 120 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] run_external_periodic_tasks = True {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] scst_target_driver = iscsi {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] scst_target_iqn_name = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] service_down_time = 720 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] shell_completion = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] snapshot_name_template = snapshot-%s {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] split_loggers = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] state_path = /opt/stack/data/cinder {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] storage_availability_zone = nova {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] storage_protocol = iSCSI {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] syslog_log_facility = LOG_USER {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] target_helper = lioadm {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] target_ip_address = 192.168.122.118 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] target_port = 3260 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] target_protocol = iscsi {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] target_secondary_ip_addresses = [] {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] trace_flags = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] transfer_api_class = cinder.transfer.api.API {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] transport_url = **** {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] until_refresh = 0 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] use_chap_auth = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] use_default_quota_class = True {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] use_journal = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] use_json = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] use_multipath_for_image_xfer = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-34a10f1d-97e4-484b-b655-3661ec9f14a1 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] use_stderr = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-34a10f1d-97e4-484b-b655-3661ec9f14a1 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87248) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] use_syslog = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] verify_glance_signatures = enabled {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] volume_api_class = cinder.volume.api.API {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] volume_backend_name = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] volume_clear = zero {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] volume_clear_ionice = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] volume_clear_size = 0 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] volume_copy_bps_limit = 0 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] volume_dd_blocksize = 1M {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] volume_name_template = volume-%s {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] volume_service_inithost_offload = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] volume_usage_audit_period = month {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] zoning_mode = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_concurrency.disable_process_locking = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] keystone_authtoken.auth_section = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] keystone_authtoken.auth_type = password {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] keystone_authtoken.auth_version = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] keystone_authtoken.cache = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] keystone_authtoken.certfile = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] keystone_authtoken.delay_auth_decision = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] keystone_authtoken.http_connect_timeout = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] keystone_authtoken.include_service_catalog = True {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] keystone_authtoken.insecure = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] keystone_authtoken.interface = public {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] keystone_authtoken.keyfile = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] keystone_authtoken.memcache_password = **** {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] keystone_authtoken.memcache_username = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] keystone_authtoken.region_name = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] keystone_authtoken.service_token_roles_required = True {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] keystone_authtoken.service_type = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] keystone_authtoken.token_cache_time = 300 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.118/identity {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] cache.backend = dogpile.cache.null {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] cache.backend_argument = **** {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] cache.backend_expiration_time = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] cache.config_prefix = cache.oslo {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] cache.debug_cache_backend = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] cache.enable_retry_client = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] cache.enable_socket_keepalive = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] cache.enabled = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] cache.expiration_time = 600 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] cache.hashclient_retry_attempts = 2 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] cache.memcache_dead_retry = 300 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] cache.memcache_pool_maxsize = 10 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] cache.memcache_sasl_enabled = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] cache.password = **** {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] cache.proxies = [] {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] cache.redis_db = 0 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] cache.redis_sentinel_service_name = mymaster {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] cache.redis_server = localhost:6379 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] cache.retry_attempts = 2 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] cache.retry_delay = 0.0 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] cache.socket_keepalive_count = 1 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] cache.socket_keepalive_idle = 1 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] cache.socket_keepalive_interval = 1 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] cache.socket_timeout = 1.0 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] cache.tls_allowed_ciphers = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] cache.tls_cafile = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] cache.tls_certfile = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] cache.tls_enabled = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] cache.tls_keyfile = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] cache.username = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] coordination.backend_url = **** {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] database.asyncio_connection = **** {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] database.asyncio_slave_connection = **** {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] database.backend = sqlalchemy {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] database.connection = **** {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] database.connection_debug = 0 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] database.connection_parameters = {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] database.connection_recycle_time = 3600 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] database.connection_trace = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] database.db_inc_retry_interval = True {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] database.db_max_retries = 20 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] database.db_max_retry_interval = 10 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] database.db_retry_interval = 1 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] database.max_overflow = 50 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] database.max_pool_size = 5 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] database.max_retries = 10 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] database.mysql_wsrep_sync_wait = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] database.pool_timeout = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] database.retry_interval = 10 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] database.slave_connection = **** {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] database.sqlite_synchronous = True {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] database.synchronous_reader = True {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] database.use_db_reconnect = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_tracing.insecure = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] profiler.connection_string = messaging:// {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] profiler.enabled = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] profiler.es_doc_type = notification {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] profiler.es_scroll_size = 10000 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] profiler.es_scroll_time = 2m {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] profiler.filter_error_trace = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] profiler.hmac_keys = **** {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] profiler.sentinel_service_name = mymaster {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] profiler.socket_timeout = 0.1 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] profiler.trace_requests = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] profiler.trace_sqlalchemy = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] profiler_jaeger.process_tags = {} {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] profiler_jaeger.service_name_prefix = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] profiler_otlp.service_name_prefix = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_policy.enforce_new_defaults = True {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_policy.policy_default_rule = default {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_policy.policy_file = policy.yaml {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_policy.remote_timeout = 60.0 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] privsep_osbrick.group = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] privsep_osbrick.helper_command = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] privsep_osbrick.user = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] cinder_sys_admin.group = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] cinder_sys_admin.helper_command = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] cinder_sys_admin.user = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] service_user.auth_section = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] service_user.auth_type = password {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] service_user.cafile = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] service_user.certfile = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] service_user.collect_timing = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] service_user.insecure = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] service_user.keyfile = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] service_user.send_service_user_token = True {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] service_user.split_loggers = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] service_user.timeout = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] service_user.tls_ciphers = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] service_user.tls_min_version = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] glance.auth_section = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] glance.auth_type = password {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] glance.certfile = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] glance.collect_timing = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] glance.insecure = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] glance.keyfile = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] glance.region_name = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] glance.split_loggers = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] glance.timeout = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] glance.tls_ciphers = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] glance.tls_min_version = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.backend_availability_zone = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.chap_password = **** {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.chap_username = {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.disk_geometry = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.driver_client_cert = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.driver_client_cert_key = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.driver_data_namespace = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.driver_use_ssl = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.enable_unsupported_driver = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.extra_capabilities = {} {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.filter_function = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.goodness_function = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.iscsi_target_flags = {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.iscsi_write_cache = on {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.iser_helper = tgtadm {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.iser_ip_address = 192.168.122.118 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.iser_port = 3260 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.nas_host = {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.nas_login = admin {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.nas_mount_options = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.nas_password = **** {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.nas_private_key = {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.nas_share_path = {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.nas_ssh_port = 22 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.num_shell_tries = 3 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.nvmet_port_id = 1 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.quobyte_client_cfg = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.quobyte_volume_url = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.replication_device = **** {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.report_discard_supported = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.reserved_percentage = 0 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.scst_target_driver = iscsi {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.scst_target_iqn_name = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.storage_protocol = iSCSI {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.target_helper = tgtadm {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.target_ip_address = 192.168.122.118 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.target_port = 3260 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-34a10f1d-97e4-484b-b655-3661ec9f14a1 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87248) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.quobyte [None req-34a10f1d-97e4-484b-b655-3661ec9f14a1 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.target_protocol = iscsi {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.trace_flags = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.quobyte [None req-34a10f1d-97e4-484b-b655-3661ec9f14a1 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.unique_fqdn_network = True {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.use_chap_auth = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-34a10f1d-97e4-484b-b655-3661ec9f14a1 None None] Running cmd (subprocess): mount.quobyte {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.volume_backend_name = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.volume_clear = zero {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.volume_clear_ionice = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.volume_clear_size = 0 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_reports.file_event_handler = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_reports.log_dir = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.backend_availability_zone = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.backend_host = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.chap_password = **** {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.chap_username = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.chiscsi_conf = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.disk_geometry = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.driver_client_cert = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.driver_client_cert_key = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.driver_data_namespace = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.driver_use_ssl = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.extra_capabilities = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.filter_function = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.goodness_function = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.iscsi_target_flags = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.iscsi_write_cache = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.iser_helper = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.iser_ip_address = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.iser_port = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.iser_target_prefix = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.nas_host = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.nas_login = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.nas_mount_options = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.nas_password = **** {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.nas_private_key = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.nas_share_path = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.nas_ssh_port = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.num_shell_tries = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.nvmet_ns_id = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.nvmet_port_id = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.replication_device = **** {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.report_discard_supported = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.reserved_percentage = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.scst_target_driver = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.storage_protocol = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.target_helper = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.target_ip_address = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.target_port = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.target_prefix = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.target_protocol = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.trace_flags = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.unique_fqdn_network = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.use_chap_auth = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.volume_clear = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.volume_clear_ionice = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.volume_clear_size = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] QuobyteHD.volumes_dir = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_rabbit.ssl = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_rabbit.ssl_version = {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_notifications.driver = [] {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_notifications.retry = -1 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack quobyte-client[87249]: Reading configuration file: /etc/quobyte/client.cfg Nov 03 20:16:17 devstack quobyte-client[87249]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] oslo_messaging_notifications.transport_url = **** {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] key_manager.fixed_key = **** {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] barbican.barbican_api_version = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] barbican.barbican_endpoint = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-34a10f1d-97e4-484b-b655-3661ec9f14a1 None None] CMD "mount.quobyte" returned: 1 in 0.063s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] barbican.barbican_endpoint_type = public {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] barbican.barbican_region_name = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] barbican.cafile = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] barbican.certfile = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] barbican.collect_timing = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-34a10f1d-97e4-484b-b655-3661ec9f14a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] barbican.insecure = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-34a10f1d-97e4-484b-b655-3661ec9f14a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] barbican.keyfile = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-34a10f1d-97e4-484b-b655-3661ec9f14a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] barbican.number_of_retries = 60 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] barbican.retry_delay = 1 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] barbican.send_service_user_token = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] barbican.split_loggers = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] barbican.timeout = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] barbican.tls_ciphers = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] barbican.tls_min_version = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] barbican.verify_ssl = True {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] barbican.verify_ssl_path = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] barbican_service_user.auth_section = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] barbican_service_user.auth_type = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] barbican_service_user.cafile = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] barbican_service_user.certfile = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] barbican_service_user.collect_timing = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] barbican_service_user.insecure = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] barbican_service_user.keyfile = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] barbican_service_user.split_loggers = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] barbican_service_user.timeout = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] barbican_service_user.tls_ciphers = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] barbican_service_user.tls_min_version = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-34a10f1d-97e4-484b-b655-3661ec9f14a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] vault.approle_role_id = **** {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] vault.approle_secret_id = **** {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-34a10f1d-97e4-484b-b655-3661ec9f14a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] vault.auth_method = approle {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] vault.auth_path = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-34a10f1d-97e4-484b-b655-3661ec9f14a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] vault.kv_mountpoint = secret {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] vault.kv_path = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] vault.kv_version = 2 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] vault.namespace = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] vault.root_token_id = **** {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] vault.ssl_ca_crt_file = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] vault.timeout = 60.0 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] vault.token_file = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] vault.token_role = None {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] vault.use_ssl = False {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 20:16:17 devstack cinder-volume[86947]: DEBUG oslo_service.backend._eventlet.service [None req-6eb961b8-2bca-4471-9171-3511a0e5099d None None] ******************************************************************************** {{(pid=86947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 03 20:16:17 devstack sudo[87250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:16:17 devstack sudo[87250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:16:17 devstack sudo[87250]: pam_unix(sudo:session): session closed for user root Nov 03 20:16:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-34a10f1d-97e4-484b-b655-3661ec9f14a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.232s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:16:17 devstack cinder-volume[87248]: INFO cinder.volume.driver [None req-34a10f1d-97e4-484b-b655-3661ec9f14a1 None None] Driver hasn't implemented _init_vendor_properties() Nov 03 20:16:17 devstack cinder-volume[87248]: DEBUG cinder.volume.driver [None req-34a10f1d-97e4-484b-b655-3661ec9f14a1 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6631889343262, 'free_capacity_gb': 1773.6631889343262, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87248) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 03 20:16:18 devstack cinder-volume[87248]: DEBUG oslo_db.sqlalchemy.engines [None req-34a10f1d-97e4-484b-b655-3661ec9f14a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87248) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 20:16:18 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writer thread running {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 20:16:18 devstack cinder-volume[87248]: DEBUG cinder.db.api [None req-34a10f1d-97e4-484b-b655-3661ec9f14a1 None None] Building query based on filter {{(pid=87248) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 03 20:16:18 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-34a10f1d-97e4-484b-b655-3661ec9f14a1 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87248) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 03 20:16:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-34a10f1d-97e4-484b-b655-3661ec9f14a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:16:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-34a10f1d-97e4-484b-b655-3661ec9f14a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:16:18 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-34a10f1d-97e4-484b-b655-3661ec9f14a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:16:18 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-34a10f1d-97e4-484b-b655-3661ec9f14a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:16:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-34a10f1d-97e4-484b-b655-3661ec9f14a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:16:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-34a10f1d-97e4-484b-b655-3661ec9f14a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:16:18 devstack cinder-volume[87248]: INFO cinder.keymgr.migration [None req-7e3e7ea0-a79e-43d7-8a40-19d0f12b2236 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 03 20:16:18 devstack sudo[87261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:16:18 devstack sudo[87261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:16:18 devstack sudo[87261]: pam_unix(sudo:session): session closed for user root Nov 03 20:16:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-34a10f1d-97e4-484b-b655-3661ec9f14a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.246s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:16:18 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-34a10f1d-97e4-484b-b655-3661ec9f14a1 None None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:16:18 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-34a10f1d-97e4-484b-b655-3661ec9f14a1 None None] Driver initialization completed successfully. Nov 03 20:16:18 devstack cinder-volume[87248]: INFO cinder.manager [None req-34a10f1d-97e4-484b-b655-3661ec9f14a1 None None] Initiating service 3 cleanup Nov 03 20:16:18 devstack cinder-volume[87248]: INFO cinder.manager [None req-34a10f1d-97e4-484b-b655-3661ec9f14a1 None None] Service 3 cleanup completed. Nov 03 20:16:18 devstack cinder-volume[87248]: DEBUG cinder.service [None req-34a10f1d-97e4-484b-b655-3661ec9f14a1 None None] Creating RPC server for service cinder-volume {{(pid=87248) start /opt/stack/cinder/cinder/service.py:231}} Nov 03 20:16:18 devstack cinder-volume[87248]: DEBUG cinder.service [None req-34a10f1d-97e4-484b-b655-3661ec9f14a1 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87248) start /opt/stack/cinder/cinder/service.py:237}} Nov 03 20:16:18 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-34a10f1d-97e4-484b-b655-3661ec9f14a1 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 03 20:16:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-34a10f1d-97e4-484b-b655-3661ec9f14a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:16:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-34a10f1d-97e4-484b-b655-3661ec9f14a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:16:18 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-34a10f1d-97e4-484b-b655-3661ec9f14a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:16:18 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-34a10f1d-97e4-484b-b655-3661ec9f14a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:16:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-34a10f1d-97e4-484b-b655-3661ec9f14a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:16:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-34a10f1d-97e4-484b-b655-3661ec9f14a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:16:18 devstack sudo[87274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:16:18 devstack sudo[87274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:16:18 devstack sudo[87274]: pam_unix(sudo:session): session closed for user root Nov 03 20:16:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-34a10f1d-97e4-484b-b655-3661ec9f14a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.230s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:16:18 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-34a10f1d-97e4-484b-b655-3661ec9f14a1 None None] Driver post RPC initialization completed successfully. Nov 03 20:16:27 devstack cinder-volume[86947]: DEBUG dbcounter [-] [86947] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86947) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:16:28 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:SELECT=2 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:16:28 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:16:28 devstack cinder-volume[87248]: DEBUG oslo_service.periodic_task [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running periodic task VolumeManager._thread_info {{(pid=87248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:16:28 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] thread count: 6 {{(pid=87248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:16:28 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] thread info: [<_MainThread(MainThread, started 124862067372160)>, , , , , ] {{(pid=87248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:17:17 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dc3d336-28ec-4766-95b2-06079f2153db tempest-TaggedAttachmentsTest-803160323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:17:17 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1dc3d336-28ec-4766-95b2-06079f2153db tempest-TaggedAttachmentsTest-803160323 None] Flow 'volume_create_manager' (6888c84d-29d4-4ad4-a8e2-6af5e53dab00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:17:17 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1dc3d336-28ec-4766-95b2-06079f2153db tempest-TaggedAttachmentsTest-803160323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10991f00-4d7a-4723-a62d-4bb54ee9a716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:17:17 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1dc3d336-28ec-4766-95b2-06079f2153db tempest-TaggedAttachmentsTest-803160323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10991f00-4d7a-4723-a62d-4bb54ee9a716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1044471151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58c3866e-97f8-46d6-a07a-20bb2c289570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f7a6532779447a3b662a825509262c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:17:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:17:17Z,use_quota=True,user_id='9d835958ea504494b298f69730b5d8d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:17:17 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1dc3d336-28ec-4766-95b2-06079f2153db tempest-TaggedAttachmentsTest-803160323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7184970-4678-4cf9-a71b-d415fe1c6886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:17:17 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1dc3d336-28ec-4766-95b2-06079f2153db tempest-TaggedAttachmentsTest-803160323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7184970-4678-4cf9-a71b-d415fe1c6886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:17:17 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1dc3d336-28ec-4766-95b2-06079f2153db tempest-TaggedAttachmentsTest-803160323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (818a57b8-eca2-4583-95cf-9fc0c8d68f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:17:17 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1dc3d336-28ec-4766-95b2-06079f2153db tempest-TaggedAttachmentsTest-803160323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (818a57b8-eca2-4583-95cf-9fc0c8d68f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58c3866e-97f8-46d6-a07a-20bb2c289570', 'volume_name': 'volume-58c3866e-97f8-46d6-a07a-20bb2c289570', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:17:17 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1dc3d336-28ec-4766-95b2-06079f2153db tempest-TaggedAttachmentsTest-803160323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0478eee9-c618-423f-939c-082e55f4bfee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:17:17 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1dc3d336-28ec-4766-95b2-06079f2153db tempest-TaggedAttachmentsTest-803160323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0478eee9-c618-423f-939c-082e55f4bfee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:17:17 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1dc3d336-28ec-4766-95b2-06079f2153db tempest-TaggedAttachmentsTest-803160323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48cbb9f6-a59a-47d8-aa52-b7e7482fa1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:17:17 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-1dc3d336-28ec-4766-95b2-06079f2153db tempest-TaggedAttachmentsTest-803160323 None] Volume 58c3866e-97f8-46d6-a07a-20bb2c289570: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58c3866e-97f8-46d6-a07a-20bb2c289570', 'volume_size': 1} Nov 03 20:17:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1dc3d336-28ec-4766-95b2-06079f2153db tempest-TaggedAttachmentsTest-803160323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:17:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1dc3d336-28ec-4766-95b2-06079f2153db tempest-TaggedAttachmentsTest-803160323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:17:17 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-1dc3d336-28ec-4766-95b2-06079f2153db tempest-TaggedAttachmentsTest-803160323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1044471151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58c3866e-97f8-46d6-a07a-20bb2c289570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f7a6532779447a3b662a825509262c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:17:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:17:17Z,use_quota=True,user_id='9d835958ea504494b298f69730b5d8d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:17:17 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-1dc3d336-28ec-4766-95b2-06079f2153db tempest-TaggedAttachmentsTest-803160323 None] Creating volume 58c3866e-97f8-46d6-a07a-20bb2c289570 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:17:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1dc3d336-28ec-4766-95b2-06079f2153db tempest-TaggedAttachmentsTest-803160323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:17:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1dc3d336-28ec-4766-95b2-06079f2153db tempest-TaggedAttachmentsTest-803160323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:17:17 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-1dc3d336-28ec-4766-95b2-06079f2153db tempest-TaggedAttachmentsTest-803160323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:17:17 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-1dc3d336-28ec-4766-95b2-06079f2153db tempest-TaggedAttachmentsTest-803160323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:17:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1dc3d336-28ec-4766-95b2-06079f2153db tempest-TaggedAttachmentsTest-803160323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:17:17 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-1dc3d336-28ec-4766-95b2-06079f2153db tempest-TaggedAttachmentsTest-803160323 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:17:17 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-1dc3d336-28ec-4766-95b2-06079f2153db tempest-TaggedAttachmentsTest-803160323 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:17:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1dc3d336-28ec-4766-95b2-06079f2153db tempest-TaggedAttachmentsTest-803160323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-58c3866e-97f8-46d6-a07a-20bb2c289570 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:17:17 devstack sudo[87649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-58c3866e-97f8-46d6-a07a-20bb2c289570 1073741824 Nov 03 20:17:17 devstack sudo[87649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:17:18 devstack sudo[87649]: pam_unix(sudo:session): session closed for user root Nov 03 20:17:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1dc3d336-28ec-4766-95b2-06079f2153db tempest-TaggedAttachmentsTest-803160323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-58c3866e-97f8-46d6-a07a-20bb2c289570 1073741824" returned: 0 in 0.717s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:17:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1dc3d336-28ec-4766-95b2-06079f2153db tempest-TaggedAttachmentsTest-803160323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-58c3866e-97f8-46d6-a07a-20bb2c289570 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:17:18 devstack sudo[87968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-58c3866e-97f8-46d6-a07a-20bb2c289570 Nov 03 20:17:18 devstack sudo[87968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:17:18 devstack sudo[87968]: pam_unix(sudo:session): session closed for user root Nov 03 20:17:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1dc3d336-28ec-4766-95b2-06079f2153db tempest-TaggedAttachmentsTest-803160323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-58c3866e-97f8-46d6-a07a-20bb2c289570" returned: 0 in 0.280s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:17:18 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-1dc3d336-28ec-4766-95b2-06079f2153db tempest-TaggedAttachmentsTest-803160323 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:17:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1dc3d336-28ec-4766-95b2-06079f2153db tempest-TaggedAttachmentsTest-803160323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:17:18 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1dc3d336-28ec-4766-95b2-06079f2153db tempest-TaggedAttachmentsTest-803160323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48cbb9f6-a59a-47d8-aa52-b7e7482fa1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58c3866e-97f8-46d6-a07a-20bb2c289570', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:17:18 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1dc3d336-28ec-4766-95b2-06079f2153db tempest-TaggedAttachmentsTest-803160323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f655b3b4-b6f5-4012-9d6f-91d32acc4bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:17:18 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-1dc3d336-28ec-4766-95b2-06079f2153db tempest-TaggedAttachmentsTest-803160323 None] Volume volume-58c3866e-97f8-46d6-a07a-20bb2c289570 (58c3866e-97f8-46d6-a07a-20bb2c289570): created successfully Nov 03 20:17:18 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1dc3d336-28ec-4766-95b2-06079f2153db tempest-TaggedAttachmentsTest-803160323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f655b3b4-b6f5-4012-9d6f-91d32acc4bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:17:18 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1dc3d336-28ec-4766-95b2-06079f2153db tempest-TaggedAttachmentsTest-803160323 None] Flow 'volume_create_manager' (6888c84d-29d4-4ad4-a8e2-6af5e53dab00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:17:18 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-1dc3d336-28ec-4766-95b2-06079f2153db tempest-TaggedAttachmentsTest-803160323 None] Created volume successfully. Nov 03 20:17:28 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:17:28 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:17:28 devstack cinder-volume[87248]: DEBUG oslo_service.periodic_task [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:17:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:17:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:17:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:17:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:17:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:17:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:17:28 devstack sudo[88021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:17:28 devstack sudo[88021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:17:29 devstack sudo[88021]: pam_unix(sudo:session): session closed for user root Nov 03 20:17:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.484s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:17:29 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:17:29 devstack cinder-volume[87248]: DEBUG oslo_service.periodic_task [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running periodic task VolumeManager._thread_info {{(pid=87248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:17:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] thread count: 6 {{(pid=87248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:17:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] thread info: [<_MainThread(MainThread, started 124862067372160)>, , , , , ] {{(pid=87248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:17:45 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-0995fb95-5a75-4b00-b3b3-a59a5befecac tempest-VolumesAdminNegativeTest-632953272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:17:45 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0995fb95-5a75-4b00-b3b3-a59a5befecac tempest-VolumesAdminNegativeTest-632953272 None] Flow 'volume_create_manager' (365cd899-0826-4ed5-adf6-239f1ca1c8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:17:45 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0995fb95-5a75-4b00-b3b3-a59a5befecac tempest-VolumesAdminNegativeTest-632953272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7507eac-cb35-4380-96ad-80e8dc6b4c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:17:45 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0995fb95-5a75-4b00-b3b3-a59a5befecac tempest-VolumesAdminNegativeTest-632953272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7507eac-cb35-4380-96ad-80e8dc6b4c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:17:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1992118662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea013dab-36ca-4b6b-9441-c2172823895c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e47c5661bc144e20b5077f0d70243948',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:17:46Z,use_quota=True,user_id='8206601ef06a4ffc9e4b0d25e4740215',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:17:45 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0995fb95-5a75-4b00-b3b3-a59a5befecac tempest-VolumesAdminNegativeTest-632953272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68d1f5c3-cce8-4690-bc00-0f4c5a3c71e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:17:45 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0995fb95-5a75-4b00-b3b3-a59a5befecac tempest-VolumesAdminNegativeTest-632953272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68d1f5c3-cce8-4690-bc00-0f4c5a3c71e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:17:45 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0995fb95-5a75-4b00-b3b3-a59a5befecac tempest-VolumesAdminNegativeTest-632953272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35c91344-5ba7-49e9-95c5-a014f9281abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:17:45 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0995fb95-5a75-4b00-b3b3-a59a5befecac tempest-VolumesAdminNegativeTest-632953272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35c91344-5ba7-49e9-95c5-a014f9281abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea013dab-36ca-4b6b-9441-c2172823895c', 'volume_name': 'volume-ea013dab-36ca-4b6b-9441-c2172823895c', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:17:45 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0995fb95-5a75-4b00-b3b3-a59a5befecac tempest-VolumesAdminNegativeTest-632953272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08df08f7-dc13-458d-9f8f-8dd1cbcb8f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:17:45 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0995fb95-5a75-4b00-b3b3-a59a5befecac tempest-VolumesAdminNegativeTest-632953272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08df08f7-dc13-458d-9f8f-8dd1cbcb8f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:17:45 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0995fb95-5a75-4b00-b3b3-a59a5befecac tempest-VolumesAdminNegativeTest-632953272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2fb1db2-9208-416e-bad1-c4d09f4c1cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:17:45 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-0995fb95-5a75-4b00-b3b3-a59a5befecac tempest-VolumesAdminNegativeTest-632953272 None] Volume ea013dab-36ca-4b6b-9441-c2172823895c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea013dab-36ca-4b6b-9441-c2172823895c', 'volume_size': 1} Nov 03 20:17:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-0995fb95-5a75-4b00-b3b3-a59a5befecac tempest-VolumesAdminNegativeTest-632953272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:17:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-0995fb95-5a75-4b00-b3b3-a59a5befecac tempest-VolumesAdminNegativeTest-632953272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:17:45 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-0995fb95-5a75-4b00-b3b3-a59a5befecac tempest-VolumesAdminNegativeTest-632953272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:17:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1992118662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea013dab-36ca-4b6b-9441-c2172823895c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e47c5661bc144e20b5077f0d70243948',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:17:46Z,use_quota=True,user_id='8206601ef06a4ffc9e4b0d25e4740215',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:17:45 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-0995fb95-5a75-4b00-b3b3-a59a5befecac tempest-VolumesAdminNegativeTest-632953272 None] Creating volume ea013dab-36ca-4b6b-9441-c2172823895c {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:17:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-0995fb95-5a75-4b00-b3b3-a59a5befecac tempest-VolumesAdminNegativeTest-632953272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:17:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-0995fb95-5a75-4b00-b3b3-a59a5befecac tempest-VolumesAdminNegativeTest-632953272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:17:45 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-0995fb95-5a75-4b00-b3b3-a59a5befecac tempest-VolumesAdminNegativeTest-632953272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:17:45 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-0995fb95-5a75-4b00-b3b3-a59a5befecac tempest-VolumesAdminNegativeTest-632953272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:17:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-0995fb95-5a75-4b00-b3b3-a59a5befecac tempest-VolumesAdminNegativeTest-632953272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:17:45 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-0995fb95-5a75-4b00-b3b3-a59a5befecac tempest-VolumesAdminNegativeTest-632953272 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:17:45 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-0995fb95-5a75-4b00-b3b3-a59a5befecac tempest-VolumesAdminNegativeTest-632953272 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:17:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-0995fb95-5a75-4b00-b3b3-a59a5befecac tempest-VolumesAdminNegativeTest-632953272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ea013dab-36ca-4b6b-9441-c2172823895c 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:17:46 devstack sudo[88392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ea013dab-36ca-4b6b-9441-c2172823895c 1073741824 Nov 03 20:17:46 devstack sudo[88392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:17:47 devstack sudo[88392]: pam_unix(sudo:session): session closed for user root Nov 03 20:17:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-0995fb95-5a75-4b00-b3b3-a59a5befecac tempest-VolumesAdminNegativeTest-632953272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ea013dab-36ca-4b6b-9441-c2172823895c 1073741824" returned: 0 in 1.490s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:17:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-0995fb95-5a75-4b00-b3b3-a59a5befecac tempest-VolumesAdminNegativeTest-632953272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ea013dab-36ca-4b6b-9441-c2172823895c {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:17:47 devstack sudo[88404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ea013dab-36ca-4b6b-9441-c2172823895c Nov 03 20:17:47 devstack sudo[88404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:17:48 devstack sudo[88404]: pam_unix(sudo:session): session closed for user root Nov 03 20:17:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-0995fb95-5a75-4b00-b3b3-a59a5befecac tempest-VolumesAdminNegativeTest-632953272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ea013dab-36ca-4b6b-9441-c2172823895c" returned: 0 in 0.854s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:17:48 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-0995fb95-5a75-4b00-b3b3-a59a5befecac tempest-VolumesAdminNegativeTest-632953272 None] <== create_volume: return (2470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:17:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-0995fb95-5a75-4b00-b3b3-a59a5befecac tempest-VolumesAdminNegativeTest-632953272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.476s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:17:48 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0995fb95-5a75-4b00-b3b3-a59a5befecac tempest-VolumesAdminNegativeTest-632953272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2fb1db2-9208-416e-bad1-c4d09f4c1cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea013dab-36ca-4b6b-9441-c2172823895c', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:17:48 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0995fb95-5a75-4b00-b3b3-a59a5befecac tempest-VolumesAdminNegativeTest-632953272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9bc3990-aa80-4f27-b979-8f01096d312b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:17:48 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-0995fb95-5a75-4b00-b3b3-a59a5befecac tempest-VolumesAdminNegativeTest-632953272 None] Volume volume-ea013dab-36ca-4b6b-9441-c2172823895c (ea013dab-36ca-4b6b-9441-c2172823895c): created successfully Nov 03 20:17:48 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0995fb95-5a75-4b00-b3b3-a59a5befecac tempest-VolumesAdminNegativeTest-632953272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9bc3990-aa80-4f27-b979-8f01096d312b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:17:48 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0995fb95-5a75-4b00-b3b3-a59a5befecac tempest-VolumesAdminNegativeTest-632953272 None] Flow 'volume_create_manager' (365cd899-0826-4ed5-adf6-239f1ca1c8d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:17:48 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-0995fb95-5a75-4b00-b3b3-a59a5befecac tempest-VolumesAdminNegativeTest-632953272 None] Created volume successfully. Nov 03 20:17:50 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-73821c32-47bc-4ed0-982d-31ad6bcbc891 tempest-VolumesAdminNegativeTest-632953272 None] Acquiring lock "cinder-ea013dab-36ca-4b6b-9441-c2172823895c-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:17:50 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-73821c32-47bc-4ed0-982d-31ad6bcbc891 tempest-VolumesAdminNegativeTest-632953272 None] Lock "cinder-ea013dab-36ca-4b6b-9441-c2172823895c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:17:50 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-73821c32-47bc-4ed0-982d-31ad6bcbc891 tempest-VolumesAdminNegativeTest-632953272 None] Acquiring lock "cinder-quobyte-ea013dab-36ca-4b6b-9441-c2172823895c" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:17:50 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-73821c32-47bc-4ed0-982d-31ad6bcbc891 tempest-VolumesAdminNegativeTest-632953272 None] Lock "cinder-quobyte-ea013dab-36ca-4b6b-9441-c2172823895c" acquired by "delete_volume" :: waited 0.043s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:17:50 devstack cinder-volume[87248]: INFO oslo.privsep.daemon [None req-73821c32-47bc-4ed0-982d-31ad6bcbc891 tempest-VolumesAdminNegativeTest-632953272 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpi7601k6a/privsep.sock'] Nov 03 20:17:50 devstack sudo[88408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpi7601k6a/privsep.sock Nov 03 20:17:50 devstack sudo[88408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:17:53 devstack cinder-volume[87248]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 03 20:17:53 devstack cinder-volume[87248]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 20:17:53 devstack cinder-volume[87248]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 03 20:17:53 devstack cinder-volume[87248]: WARNING oslo.privsep.daemon [-] privsep log: Nov 03 20:17:53 devstack cinder-volume[87248]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 03 20:17:53 devstack cinder-volume[87248]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 03 20:17:53 devstack cinder-volume[87248]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 20:17:53 devstack cinder-volume[87248]: WARNING oslo.privsep.daemon [-] privsep log: Nov 03 20:17:53 devstack cinder-volume[87248]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 03 20:17:53 devstack sudo[88408]: pam_unix(sudo:session): session closed for user root Nov 03 20:17:53 devstack cinder-volume[87248]: INFO oslo.privsep.daemon [None req-73821c32-47bc-4ed0-982d-31ad6bcbc891 tempest-VolumesAdminNegativeTest-632953272 None] Spawned new privsep daemon via rootwrap Nov 03 20:17:53 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [None req-73821c32-47bc-4ed0-982d-31ad6bcbc891 tempest-VolumesAdminNegativeTest-632953272 None] Accepted privsep connection to /tmp/tmpi7601k6a/privsep.sock {{(pid=87248) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 03 20:17:53 devstack cinder-volume[87248]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 03 20:17:53 devstack cinder-volume[87248]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 03 20:17:53 devstack cinder-volume[87248]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 03 20:17:53 devstack cinder-volume[87248]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88454 Nov 03 20:17:53 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db8baf5-715a-408d-a59b-53f288e0e48b]: (2,) {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:17:53 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a65013c-9ce9-4f6f-8669-78c2a10590b4]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:17:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-73821c32-47bc-4ed0-982d-31ad6bcbc891 tempest-VolumesAdminNegativeTest-632953272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ea013dab-36ca-4b6b-9441-c2172823895c {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:17:54 devstack sudo[88457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ea013dab-36ca-4b6b-9441-c2172823895c Nov 03 20:17:54 devstack sudo[88457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:17:55 devstack sudo[88457]: pam_unix(sudo:session): session closed for user root Nov 03 20:17:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-73821c32-47bc-4ed0-982d-31ad6bcbc891 tempest-VolumesAdminNegativeTest-632953272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ea013dab-36ca-4b6b-9441-c2172823895c" returned: 0 in 1.456s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:17:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-73821c32-47bc-4ed0-982d-31ad6bcbc891 tempest-VolumesAdminNegativeTest-632953272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ea013dab-36ca-4b6b-9441-c2172823895c {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:17:55 devstack sudo[88523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ea013dab-36ca-4b6b-9441-c2172823895c Nov 03 20:17:55 devstack sudo[88523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:17:55 devstack sudo[88523]: pam_unix(sudo:session): session closed for user root Nov 03 20:17:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-73821c32-47bc-4ed0-982d-31ad6bcbc891 tempest-VolumesAdminNegativeTest-632953272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ea013dab-36ca-4b6b-9441-c2172823895c" returned: 0 in 0.616s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:17:55 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-73821c32-47bc-4ed0-982d-31ad6bcbc891 tempest-VolumesAdminNegativeTest-632953272 None] Lock "cinder-quobyte-ea013dab-36ca-4b6b-9441-c2172823895c" released by "delete_volume" :: held 5.222s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:17:56 devstack cinder-volume[87248]: WARNING cinder.quota [None req-73821c32-47bc-4ed0-982d-31ad6bcbc891 tempest-VolumesAdminNegativeTest-632953272 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:17:56 devstack cinder-volume[87248]: WARNING cinder.quota [None req-73821c32-47bc-4ed0-982d-31ad6bcbc891 tempest-VolumesAdminNegativeTest-632953272 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:17:56 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-73821c32-47bc-4ed0-982d-31ad6bcbc891 tempest-VolumesAdminNegativeTest-632953272 None] Created reservations ['bf92047c-d3b8-44ca-959e-97cd5e19ab6d', 'fd6c6038-e6ca-493b-a52f-e1f052d3c161', '03e4a097-472e-4372-a87a-b36a0e4ff50d', '234da646-dd78-4428-84c4-5d074d76d4d7'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:17:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-73821c32-47bc-4ed0-982d-31ad6bcbc891 tempest-VolumesAdminNegativeTest-632953272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:17:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-73821c32-47bc-4ed0-982d-31ad6bcbc891 tempest-VolumesAdminNegativeTest-632953272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:17:56 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-73821c32-47bc-4ed0-982d-31ad6bcbc891 tempest-VolumesAdminNegativeTest-632953272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:17:56 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-73821c32-47bc-4ed0-982d-31ad6bcbc891 tempest-VolumesAdminNegativeTest-632953272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:17:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-73821c32-47bc-4ed0-982d-31ad6bcbc891 tempest-VolumesAdminNegativeTest-632953272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:17:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-73821c32-47bc-4ed0-982d-31ad6bcbc891 tempest-VolumesAdminNegativeTest-632953272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:17:56 devstack sudo[88543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:17:56 devstack sudo[88543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:17:56 devstack sudo[88543]: pam_unix(sudo:session): session closed for user root Nov 03 20:17:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-73821c32-47bc-4ed0-982d-31ad6bcbc891 tempest-VolumesAdminNegativeTest-632953272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.481s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:17:56 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-73821c32-47bc-4ed0-982d-31ad6bcbc891 tempest-VolumesAdminNegativeTest-632953272 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:17:56 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-73821c32-47bc-4ed0-982d-31ad6bcbc891 tempest-VolumesAdminNegativeTest-632953272 None] Deleted volume successfully. Nov 03 20:17:56 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-73821c32-47bc-4ed0-982d-31ad6bcbc891 tempest-VolumesAdminNegativeTest-632953272 None] Lock "cinder-ea013dab-36ca-4b6b-9441-c2172823895c-delete_volume" released by "delete_volume" :: held 6.343s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:18:06 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:UPDATE=15,cinder:SELECT=6,cinder:INSERT=2 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:18:06 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:SELECT=8,cinder:UPDATE=7,cinder:DELETE=2,cinder:INSERT=3 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:18:08 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-64a11f7e-8764-4d4b-9368-348735deaa3f tempest-ServersNegativeTestJSON-1527581290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:18:08 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-64a11f7e-8764-4d4b-9368-348735deaa3f tempest-ServersNegativeTestJSON-1527581290 None] Flow 'volume_create_manager' (84925930-d089-4d22-9f50-588114d60bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:18:08 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-64a11f7e-8764-4d4b-9368-348735deaa3f tempest-ServersNegativeTestJSON-1527581290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dcbfabf-c70b-49ce-8330-98aff8caa030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:18:08 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-64a11f7e-8764-4d4b-9368-348735deaa3f tempest-ServersNegativeTestJSON-1527581290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dcbfabf-c70b-49ce-8330-98aff8caa030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-554168288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c523e14-9494-4105-a4fd-81dab94305ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f93409d12d0043d7bfd212c1d366046f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:18:08Z,use_quota=True,user_id='b32e89de598c41d9932e84482b9da157',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:18:08 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-64a11f7e-8764-4d4b-9368-348735deaa3f tempest-ServersNegativeTestJSON-1527581290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45984d20-c44a-4761-a358-572bc4b43411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:18:08 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-64a11f7e-8764-4d4b-9368-348735deaa3f tempest-ServersNegativeTestJSON-1527581290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45984d20-c44a-4761-a358-572bc4b43411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:18:08 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-64a11f7e-8764-4d4b-9368-348735deaa3f tempest-ServersNegativeTestJSON-1527581290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5080e1f5-52d5-4ca0-95ab-b141deeea23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:18:08 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-64a11f7e-8764-4d4b-9368-348735deaa3f tempest-ServersNegativeTestJSON-1527581290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5080e1f5-52d5-4ca0-95ab-b141deeea23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c523e14-9494-4105-a4fd-81dab94305ea', 'volume_name': 'volume-2c523e14-9494-4105-a4fd-81dab94305ea', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:18:08 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-64a11f7e-8764-4d4b-9368-348735deaa3f tempest-ServersNegativeTestJSON-1527581290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f62ce38c-ee3c-4bee-b0ab-38a33879a4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:18:08 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-64a11f7e-8764-4d4b-9368-348735deaa3f tempest-ServersNegativeTestJSON-1527581290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f62ce38c-ee3c-4bee-b0ab-38a33879a4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:18:08 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-64a11f7e-8764-4d4b-9368-348735deaa3f tempest-ServersNegativeTestJSON-1527581290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68362079-6135-4436-b43a-72d931af6068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:18:08 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-64a11f7e-8764-4d4b-9368-348735deaa3f tempest-ServersNegativeTestJSON-1527581290 None] Volume 2c523e14-9494-4105-a4fd-81dab94305ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c523e14-9494-4105-a4fd-81dab94305ea', 'volume_size': 1} Nov 03 20:18:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-64a11f7e-8764-4d4b-9368-348735deaa3f tempest-ServersNegativeTestJSON-1527581290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:18:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-64a11f7e-8764-4d4b-9368-348735deaa3f tempest-ServersNegativeTestJSON-1527581290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:18:08 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-64a11f7e-8764-4d4b-9368-348735deaa3f tempest-ServersNegativeTestJSON-1527581290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-554168288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c523e14-9494-4105-a4fd-81dab94305ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f93409d12d0043d7bfd212c1d366046f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:18:08Z,use_quota=True,user_id='b32e89de598c41d9932e84482b9da157',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:18:08 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-64a11f7e-8764-4d4b-9368-348735deaa3f tempest-ServersNegativeTestJSON-1527581290 None] Creating volume 2c523e14-9494-4105-a4fd-81dab94305ea {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:18:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-64a11f7e-8764-4d4b-9368-348735deaa3f tempest-ServersNegativeTestJSON-1527581290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:18:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-64a11f7e-8764-4d4b-9368-348735deaa3f tempest-ServersNegativeTestJSON-1527581290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:18:08 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-64a11f7e-8764-4d4b-9368-348735deaa3f tempest-ServersNegativeTestJSON-1527581290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:18:08 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-64a11f7e-8764-4d4b-9368-348735deaa3f tempest-ServersNegativeTestJSON-1527581290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:18:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-64a11f7e-8764-4d4b-9368-348735deaa3f tempest-ServersNegativeTestJSON-1527581290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:18:08 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-64a11f7e-8764-4d4b-9368-348735deaa3f tempest-ServersNegativeTestJSON-1527581290 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:18:08 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-64a11f7e-8764-4d4b-9368-348735deaa3f tempest-ServersNegativeTestJSON-1527581290 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:18:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-64a11f7e-8764-4d4b-9368-348735deaa3f tempest-ServersNegativeTestJSON-1527581290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2c523e14-9494-4105-a4fd-81dab94305ea 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:18:08 devstack sudo[88648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2c523e14-9494-4105-a4fd-81dab94305ea 1073741824 Nov 03 20:18:08 devstack sudo[88648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:18:08 devstack sudo[88648]: pam_unix(sudo:session): session closed for user root Nov 03 20:18:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-64a11f7e-8764-4d4b-9368-348735deaa3f tempest-ServersNegativeTestJSON-1527581290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2c523e14-9494-4105-a4fd-81dab94305ea 1073741824" returned: 0 in 0.497s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:18:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-64a11f7e-8764-4d4b-9368-348735deaa3f tempest-ServersNegativeTestJSON-1527581290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2c523e14-9494-4105-a4fd-81dab94305ea {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:18:08 devstack sudo[88654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2c523e14-9494-4105-a4fd-81dab94305ea Nov 03 20:18:08 devstack sudo[88654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:18:09 devstack sudo[88654]: pam_unix(sudo:session): session closed for user root Nov 03 20:18:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-64a11f7e-8764-4d4b-9368-348735deaa3f tempest-ServersNegativeTestJSON-1527581290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2c523e14-9494-4105-a4fd-81dab94305ea" returned: 0 in 0.354s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:18:09 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-64a11f7e-8764-4d4b-9368-348735deaa3f tempest-ServersNegativeTestJSON-1527581290 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:18:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-64a11f7e-8764-4d4b-9368-348735deaa3f tempest-ServersNegativeTestJSON-1527581290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:18:09 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-64a11f7e-8764-4d4b-9368-348735deaa3f tempest-ServersNegativeTestJSON-1527581290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68362079-6135-4436-b43a-72d931af6068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c523e14-9494-4105-a4fd-81dab94305ea', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:18:09 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-64a11f7e-8764-4d4b-9368-348735deaa3f tempest-ServersNegativeTestJSON-1527581290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7ae5bdd-1fe0-4a32-b4a5-81831dc4a524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:18:09 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-64a11f7e-8764-4d4b-9368-348735deaa3f tempest-ServersNegativeTestJSON-1527581290 None] Volume volume-2c523e14-9494-4105-a4fd-81dab94305ea (2c523e14-9494-4105-a4fd-81dab94305ea): created successfully Nov 03 20:18:09 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-64a11f7e-8764-4d4b-9368-348735deaa3f tempest-ServersNegativeTestJSON-1527581290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7ae5bdd-1fe0-4a32-b4a5-81831dc4a524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:18:09 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-64a11f7e-8764-4d4b-9368-348735deaa3f tempest-ServersNegativeTestJSON-1527581290 None] Flow 'volume_create_manager' (84925930-d089-4d22-9f50-588114d60bdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:18:09 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-64a11f7e-8764-4d4b-9368-348735deaa3f tempest-ServersNegativeTestJSON-1527581290 None] Created volume successfully. Nov 03 20:18:13 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-a55ad945-2e11-4fd4-8e7a-5b5ef449bcea tempest-ServersNegativeTestJSON-1527581290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:18:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a55ad945-2e11-4fd4-8e7a-5b5ef449bcea tempest-ServersNegativeTestJSON-1527581290 None] Flow 'volume_create_manager' (cc2e2aab-1249-46d9-8400-ec98631f4fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:18:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a55ad945-2e11-4fd4-8e7a-5b5ef449bcea tempest-ServersNegativeTestJSON-1527581290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63dd32f5-9396-4457-8e0e-6d9ecb4290e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:18:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a55ad945-2e11-4fd4-8e7a-5b5ef449bcea tempest-ServersNegativeTestJSON-1527581290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63dd32f5-9396-4457-8e0e-6d9ecb4290e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1245611094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f283402-5eb8-4eef-be21-36ea7c3815b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f93409d12d0043d7bfd212c1d366046f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:18:13Z,use_quota=True,user_id='b32e89de598c41d9932e84482b9da157',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:18:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a55ad945-2e11-4fd4-8e7a-5b5ef449bcea tempest-ServersNegativeTestJSON-1527581290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5e0944f-1203-458b-9bb6-18b79a48a76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:18:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a55ad945-2e11-4fd4-8e7a-5b5ef449bcea tempest-ServersNegativeTestJSON-1527581290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5e0944f-1203-458b-9bb6-18b79a48a76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:18:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a55ad945-2e11-4fd4-8e7a-5b5ef449bcea tempest-ServersNegativeTestJSON-1527581290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08c431a5-cb33-4e74-9643-7b7422e069b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:18:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a55ad945-2e11-4fd4-8e7a-5b5ef449bcea tempest-ServersNegativeTestJSON-1527581290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08c431a5-cb33-4e74-9643-7b7422e069b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f283402-5eb8-4eef-be21-36ea7c3815b5', 'volume_name': 'volume-1f283402-5eb8-4eef-be21-36ea7c3815b5', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:18:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a55ad945-2e11-4fd4-8e7a-5b5ef449bcea tempest-ServersNegativeTestJSON-1527581290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dbead25-b06b-4dd6-8dd4-5a12ac5f7dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:18:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a55ad945-2e11-4fd4-8e7a-5b5ef449bcea tempest-ServersNegativeTestJSON-1527581290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dbead25-b06b-4dd6-8dd4-5a12ac5f7dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:18:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a55ad945-2e11-4fd4-8e7a-5b5ef449bcea tempest-ServersNegativeTestJSON-1527581290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (459d120e-535e-4c0e-9ec5-a1b5ebb94555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:18:13 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-a55ad945-2e11-4fd4-8e7a-5b5ef449bcea tempest-ServersNegativeTestJSON-1527581290 None] Volume 1f283402-5eb8-4eef-be21-36ea7c3815b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f283402-5eb8-4eef-be21-36ea7c3815b5', 'volume_size': 1} Nov 03 20:18:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a55ad945-2e11-4fd4-8e7a-5b5ef449bcea tempest-ServersNegativeTestJSON-1527581290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:18:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a55ad945-2e11-4fd4-8e7a-5b5ef449bcea tempest-ServersNegativeTestJSON-1527581290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:18:13 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a55ad945-2e11-4fd4-8e7a-5b5ef449bcea tempest-ServersNegativeTestJSON-1527581290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1245611094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f283402-5eb8-4eef-be21-36ea7c3815b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f93409d12d0043d7bfd212c1d366046f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:18:13Z,use_quota=True,user_id='b32e89de598c41d9932e84482b9da157',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:18:13 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-a55ad945-2e11-4fd4-8e7a-5b5ef449bcea tempest-ServersNegativeTestJSON-1527581290 None] Creating volume 1f283402-5eb8-4eef-be21-36ea7c3815b5 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:18:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a55ad945-2e11-4fd4-8e7a-5b5ef449bcea tempest-ServersNegativeTestJSON-1527581290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:18:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a55ad945-2e11-4fd4-8e7a-5b5ef449bcea tempest-ServersNegativeTestJSON-1527581290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:18:13 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a55ad945-2e11-4fd4-8e7a-5b5ef449bcea tempest-ServersNegativeTestJSON-1527581290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:18:13 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a55ad945-2e11-4fd4-8e7a-5b5ef449bcea tempest-ServersNegativeTestJSON-1527581290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:18:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a55ad945-2e11-4fd4-8e7a-5b5ef449bcea tempest-ServersNegativeTestJSON-1527581290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:18:13 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a55ad945-2e11-4fd4-8e7a-5b5ef449bcea tempest-ServersNegativeTestJSON-1527581290 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:18:13 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-a55ad945-2e11-4fd4-8e7a-5b5ef449bcea tempest-ServersNegativeTestJSON-1527581290 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:18:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a55ad945-2e11-4fd4-8e7a-5b5ef449bcea tempest-ServersNegativeTestJSON-1527581290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f283402-5eb8-4eef-be21-36ea7c3815b5 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:18:13 devstack sudo[88662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f283402-5eb8-4eef-be21-36ea7c3815b5 1073741824 Nov 03 20:18:13 devstack sudo[88662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:18:14 devstack sudo[88662]: pam_unix(sudo:session): session closed for user root Nov 03 20:18:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a55ad945-2e11-4fd4-8e7a-5b5ef449bcea tempest-ServersNegativeTestJSON-1527581290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f283402-5eb8-4eef-be21-36ea7c3815b5 1073741824" returned: 0 in 0.561s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:18:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a55ad945-2e11-4fd4-8e7a-5b5ef449bcea tempest-ServersNegativeTestJSON-1527581290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f283402-5eb8-4eef-be21-36ea7c3815b5 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:18:14 devstack sudo[88678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f283402-5eb8-4eef-be21-36ea7c3815b5 Nov 03 20:18:14 devstack sudo[88678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:18:14 devstack sudo[88678]: pam_unix(sudo:session): session closed for user root Nov 03 20:18:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a55ad945-2e11-4fd4-8e7a-5b5ef449bcea tempest-ServersNegativeTestJSON-1527581290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f283402-5eb8-4eef-be21-36ea7c3815b5" returned: 0 in 0.311s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:18:14 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a55ad945-2e11-4fd4-8e7a-5b5ef449bcea tempest-ServersNegativeTestJSON-1527581290 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:18:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a55ad945-2e11-4fd4-8e7a-5b5ef449bcea tempest-ServersNegativeTestJSON-1527581290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:18:14 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a55ad945-2e11-4fd4-8e7a-5b5ef449bcea tempest-ServersNegativeTestJSON-1527581290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (459d120e-535e-4c0e-9ec5-a1b5ebb94555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f283402-5eb8-4eef-be21-36ea7c3815b5', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:18:14 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a55ad945-2e11-4fd4-8e7a-5b5ef449bcea tempest-ServersNegativeTestJSON-1527581290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbbc2b60-bc5f-4510-820b-2b38b800e983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:18:14 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-a55ad945-2e11-4fd4-8e7a-5b5ef449bcea tempest-ServersNegativeTestJSON-1527581290 None] Volume volume-1f283402-5eb8-4eef-be21-36ea7c3815b5 (1f283402-5eb8-4eef-be21-36ea7c3815b5): created successfully Nov 03 20:18:14 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a55ad945-2e11-4fd4-8e7a-5b5ef449bcea tempest-ServersNegativeTestJSON-1527581290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbbc2b60-bc5f-4510-820b-2b38b800e983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:18:14 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a55ad945-2e11-4fd4-8e7a-5b5ef449bcea tempest-ServersNegativeTestJSON-1527581290 None] Flow 'volume_create_manager' (cc2e2aab-1249-46d9-8400-ec98631f4fe4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:18:14 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-a55ad945-2e11-4fd4-8e7a-5b5ef449bcea tempest-ServersNegativeTestJSON-1527581290 None] Created volume successfully. Nov 03 20:18:19 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7aed3cbd-c8e0-404a-8a81-70f07c0621f6 tempest-ServersNegativeTestJSON-1527581290 None] Acquiring lock "cinder-1f283402-5eb8-4eef-be21-36ea7c3815b5-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:18:19 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7aed3cbd-c8e0-404a-8a81-70f07c0621f6 tempest-ServersNegativeTestJSON-1527581290 None] Lock "cinder-1f283402-5eb8-4eef-be21-36ea7c3815b5-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:18:19 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7aed3cbd-c8e0-404a-8a81-70f07c0621f6 tempest-ServersNegativeTestJSON-1527581290 None] Acquiring lock "cinder-quobyte-1f283402-5eb8-4eef-be21-36ea7c3815b5" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:18:19 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7aed3cbd-c8e0-404a-8a81-70f07c0621f6 tempest-ServersNegativeTestJSON-1527581290 None] Lock "cinder-quobyte-1f283402-5eb8-4eef-be21-36ea7c3815b5" acquired by "delete_volume" :: waited 0.024s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:18:19 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[7515137f-8ad6-4fce-b560-9e9a7bc06e49]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:18:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7aed3cbd-c8e0-404a-8a81-70f07c0621f6 tempest-ServersNegativeTestJSON-1527581290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f283402-5eb8-4eef-be21-36ea7c3815b5 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:18:19 devstack sudo[88704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f283402-5eb8-4eef-be21-36ea7c3815b5 Nov 03 20:18:19 devstack sudo[88704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:18:20 devstack sudo[88704]: pam_unix(sudo:session): session closed for user root Nov 03 20:18:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7aed3cbd-c8e0-404a-8a81-70f07c0621f6 tempest-ServersNegativeTestJSON-1527581290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f283402-5eb8-4eef-be21-36ea7c3815b5" returned: 0 in 0.869s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:18:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7aed3cbd-c8e0-404a-8a81-70f07c0621f6 tempest-ServersNegativeTestJSON-1527581290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f283402-5eb8-4eef-be21-36ea7c3815b5 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:18:20 devstack sudo[88749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f283402-5eb8-4eef-be21-36ea7c3815b5 Nov 03 20:18:20 devstack sudo[88749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:18:20 devstack sudo[88749]: pam_unix(sudo:session): session closed for user root Nov 03 20:18:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7aed3cbd-c8e0-404a-8a81-70f07c0621f6 tempest-ServersNegativeTestJSON-1527581290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f283402-5eb8-4eef-be21-36ea7c3815b5" returned: 0 in 0.594s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:18:20 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7aed3cbd-c8e0-404a-8a81-70f07c0621f6 tempest-ServersNegativeTestJSON-1527581290 None] Lock "cinder-quobyte-1f283402-5eb8-4eef-be21-36ea7c3815b5" released by "delete_volume" :: held 1.548s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:18:21 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-7aed3cbd-c8e0-404a-8a81-70f07c0621f6 tempest-ServersNegativeTestJSON-1527581290 None] Created reservations ['c21df0b1-1b82-4645-bd25-f93f668cb603', '287608b0-9dd5-4205-9b42-2d4a8b20f4b2', 'ed08cf5d-0b8d-49b9-8ffa-fbb4a4045412', '3b11d7d1-0e1a-41f5-9308-f40241a051d0'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:18:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7aed3cbd-c8e0-404a-8a81-70f07c0621f6 tempest-ServersNegativeTestJSON-1527581290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:18:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7aed3cbd-c8e0-404a-8a81-70f07c0621f6 tempest-ServersNegativeTestJSON-1527581290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:18:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-7aed3cbd-c8e0-404a-8a81-70f07c0621f6 tempest-ServersNegativeTestJSON-1527581290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:18:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-7aed3cbd-c8e0-404a-8a81-70f07c0621f6 tempest-ServersNegativeTestJSON-1527581290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:18:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7aed3cbd-c8e0-404a-8a81-70f07c0621f6 tempest-ServersNegativeTestJSON-1527581290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:18:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7aed3cbd-c8e0-404a-8a81-70f07c0621f6 tempest-ServersNegativeTestJSON-1527581290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:18:21 devstack sudo[88771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:18:21 devstack sudo[88771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:18:21 devstack sudo[88771]: pam_unix(sudo:session): session closed for user root Nov 03 20:18:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7aed3cbd-c8e0-404a-8a81-70f07c0621f6 tempest-ServersNegativeTestJSON-1527581290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.399s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:18:21 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-7aed3cbd-c8e0-404a-8a81-70f07c0621f6 tempest-ServersNegativeTestJSON-1527581290 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:18:21 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-7aed3cbd-c8e0-404a-8a81-70f07c0621f6 tempest-ServersNegativeTestJSON-1527581290 None] Deleted volume successfully. Nov 03 20:18:21 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7aed3cbd-c8e0-404a-8a81-70f07c0621f6 tempest-ServersNegativeTestJSON-1527581290 None] Lock "cinder-1f283402-5eb8-4eef-be21-36ea7c3815b5-delete_volume" released by "delete_volume" :: held 2.464s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:18:21 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-31b8dd49-b0ed-438e-a167-c28758243eb6 tempest-ServersNegativeTestJSON-1527581290 None] Acquiring lock "cinder-2c523e14-9494-4105-a4fd-81dab94305ea-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:18:21 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-31b8dd49-b0ed-438e-a167-c28758243eb6 tempest-ServersNegativeTestJSON-1527581290 None] Lock "cinder-2c523e14-9494-4105-a4fd-81dab94305ea-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:18:21 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-31b8dd49-b0ed-438e-a167-c28758243eb6 tempest-ServersNegativeTestJSON-1527581290 None] Acquiring lock "cinder-quobyte-2c523e14-9494-4105-a4fd-81dab94305ea" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:18:21 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-31b8dd49-b0ed-438e-a167-c28758243eb6 tempest-ServersNegativeTestJSON-1527581290 None] Lock "cinder-quobyte-2c523e14-9494-4105-a4fd-81dab94305ea" acquired by "delete_volume" :: waited 0.017s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:18:21 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[a706c87b-7f1d-4201-bde4-a89d80b7cb6d]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:18:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-31b8dd49-b0ed-438e-a167-c28758243eb6 tempest-ServersNegativeTestJSON-1527581290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2c523e14-9494-4105-a4fd-81dab94305ea {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:18:22 devstack sudo[88788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2c523e14-9494-4105-a4fd-81dab94305ea Nov 03 20:18:22 devstack sudo[88788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:18:22 devstack sudo[88788]: pam_unix(sudo:session): session closed for user root Nov 03 20:18:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-31b8dd49-b0ed-438e-a167-c28758243eb6 tempest-ServersNegativeTestJSON-1527581290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2c523e14-9494-4105-a4fd-81dab94305ea" returned: 0 in 0.485s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:18:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-31b8dd49-b0ed-438e-a167-c28758243eb6 tempest-ServersNegativeTestJSON-1527581290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2c523e14-9494-4105-a4fd-81dab94305ea {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:18:22 devstack sudo[88795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2c523e14-9494-4105-a4fd-81dab94305ea Nov 03 20:18:22 devstack sudo[88795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:18:22 devstack sudo[88795]: pam_unix(sudo:session): session closed for user root Nov 03 20:18:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-31b8dd49-b0ed-438e-a167-c28758243eb6 tempest-ServersNegativeTestJSON-1527581290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2c523e14-9494-4105-a4fd-81dab94305ea" returned: 0 in 0.549s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:18:22 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-31b8dd49-b0ed-438e-a167-c28758243eb6 tempest-ServersNegativeTestJSON-1527581290 None] Lock "cinder-quobyte-2c523e14-9494-4105-a4fd-81dab94305ea" released by "delete_volume" :: held 1.112s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:18:23 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-31b8dd49-b0ed-438e-a167-c28758243eb6 tempest-ServersNegativeTestJSON-1527581290 None] Created reservations ['89b347d9-c25e-4b9c-ba0a-e0d86ecbde5f', 'd0441921-f535-453b-ad08-9df87fe2e440', 'd8adce04-8e95-40b0-9e03-15362d199406', '735f55b5-2fc8-413c-ba4d-b0dd8fdefa22'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:18:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-31b8dd49-b0ed-438e-a167-c28758243eb6 tempest-ServersNegativeTestJSON-1527581290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:18:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-31b8dd49-b0ed-438e-a167-c28758243eb6 tempest-ServersNegativeTestJSON-1527581290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:18:23 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-31b8dd49-b0ed-438e-a167-c28758243eb6 tempest-ServersNegativeTestJSON-1527581290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:18:23 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-31b8dd49-b0ed-438e-a167-c28758243eb6 tempest-ServersNegativeTestJSON-1527581290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:18:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-31b8dd49-b0ed-438e-a167-c28758243eb6 tempest-ServersNegativeTestJSON-1527581290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:18:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-31b8dd49-b0ed-438e-a167-c28758243eb6 tempest-ServersNegativeTestJSON-1527581290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:18:23 devstack sudo[88804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:18:23 devstack sudo[88804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:18:23 devstack sudo[88804]: pam_unix(sudo:session): session closed for user root Nov 03 20:18:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-31b8dd49-b0ed-438e-a167-c28758243eb6 tempest-ServersNegativeTestJSON-1527581290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.308s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:18:23 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-31b8dd49-b0ed-438e-a167-c28758243eb6 tempest-ServersNegativeTestJSON-1527581290 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:18:23 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-31b8dd49-b0ed-438e-a167-c28758243eb6 tempest-ServersNegativeTestJSON-1527581290 None] Deleted volume successfully. Nov 03 20:18:23 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-31b8dd49-b0ed-438e-a167-c28758243eb6 tempest-ServersNegativeTestJSON-1527581290 None] Lock "cinder-2c523e14-9494-4105-a4fd-81dab94305ea-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:18:25 devstack cinder-volume[87248]: WARNING py.warnings [req-10212a70-ebb2-43ea-982b-c5a0dc5c190d req-0ea640eb-e8a4-476c-bad2-2b5fd85df738 tempest-TaggedAttachmentsTest-803160323 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Nov 03 20:18:25 devstack cinder-volume[87248]: .first() Nov 03 20:18:25 devstack cinder-volume[87248]: Nov 03 20:18:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-10212a70-ebb2-43ea-982b-c5a0dc5c190d req-0ea640eb-e8a4-476c-bad2-2b5fd85df738 tempest-TaggedAttachmentsTest-803160323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:18:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-10212a70-ebb2-43ea-982b-c5a0dc5c190d req-0ea640eb-e8a4-476c-bad2-2b5fd85df738 tempest-TaggedAttachmentsTest-803160323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:18:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-10212a70-ebb2-43ea-982b-c5a0dc5c190d req-0ea640eb-e8a4-476c-bad2-2b5fd85df738 tempest-TaggedAttachmentsTest-803160323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:18:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-10212a70-ebb2-43ea-982b-c5a0dc5c190d req-0ea640eb-e8a4-476c-bad2-2b5fd85df738 tempest-TaggedAttachmentsTest-803160323 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8', 'name': 'volume-58c3866e-97f8-46d6-a07a-20bb2c289570', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '86cde6a9-c505-4206-bd3b-c16859d9187f', 'enforce_multipath': True} {{(pid=87248) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 20:18:25 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-10212a70-ebb2-43ea-982b-c5a0dc5c190d req-0ea640eb-e8a4-476c-bad2-2b5fd85df738 tempest-TaggedAttachmentsTest-803160323 None] attachment_update completed successfully. Nov 03 20:18:28 devstack cinder-volume[87248]: DEBUG oslo_service.periodic_task [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:18:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:18:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:18:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:18:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:18:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:18:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:18:28 devstack sudo[89334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:18:28 devstack sudo[89334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:18:29 devstack sudo[89334]: pam_unix(sudo:session): session closed for user root Nov 03 20:18:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.327s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:18:29 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:18:30 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-6abf4d93-2eb0-44dc-8ae3-c0bee9bd8dfb req-eb8553db-9e88-40b6-8023-365e8e9190a9 tempest-TaggedAttachmentsTest-803160323 None] Terminate volume connection completed successfully. Nov 03 20:18:30 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-6abf4d93-2eb0-44dc-8ae3-c0bee9bd8dfb req-eb8553db-9e88-40b6-8023-365e8e9190a9 tempest-TaggedAttachmentsTest-803160323 None] Deleting attachment 86cde6a9-c505-4206-bd3b-c16859d9187f. {{(pid=87248) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 20:18:35 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:SELECT=20,cinder:UPDATE=26,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:18:40 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:UPDATE=22,cinder:SELECT=24,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:18:50 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b063515a-c5ed-49cc-abe8-9ccc7c4cf337 tempest-TaggedAttachmentsTest-803160323 None] Acquiring lock "cinder-58c3866e-97f8-46d6-a07a-20bb2c289570-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:18:50 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b063515a-c5ed-49cc-abe8-9ccc7c4cf337 tempest-TaggedAttachmentsTest-803160323 None] Lock "cinder-58c3866e-97f8-46d6-a07a-20bb2c289570-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:18:50 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b063515a-c5ed-49cc-abe8-9ccc7c4cf337 tempest-TaggedAttachmentsTest-803160323 None] Acquiring lock "cinder-quobyte-58c3866e-97f8-46d6-a07a-20bb2c289570" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:18:50 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b063515a-c5ed-49cc-abe8-9ccc7c4cf337 tempest-TaggedAttachmentsTest-803160323 None] Lock "cinder-quobyte-58c3866e-97f8-46d6-a07a-20bb2c289570" acquired by "delete_volume" :: waited 0.027s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:18:50 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[18815c9e-116d-483a-b727-c543d71b47f4]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:18:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b063515a-c5ed-49cc-abe8-9ccc7c4cf337 tempest-TaggedAttachmentsTest-803160323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-58c3866e-97f8-46d6-a07a-20bb2c289570 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:18:50 devstack sudo[89469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-58c3866e-97f8-46d6-a07a-20bb2c289570 Nov 03 20:18:50 devstack sudo[89469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:18:51 devstack sudo[89469]: pam_unix(sudo:session): session closed for user root Nov 03 20:18:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b063515a-c5ed-49cc-abe8-9ccc7c4cf337 tempest-TaggedAttachmentsTest-803160323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-58c3866e-97f8-46d6-a07a-20bb2c289570" returned: 0 in 0.458s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:18:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b063515a-c5ed-49cc-abe8-9ccc7c4cf337 tempest-TaggedAttachmentsTest-803160323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-58c3866e-97f8-46d6-a07a-20bb2c289570 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:18:51 devstack sudo[89475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-58c3866e-97f8-46d6-a07a-20bb2c289570 Nov 03 20:18:51 devstack sudo[89475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:18:51 devstack sudo[89475]: pam_unix(sudo:session): session closed for user root Nov 03 20:18:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b063515a-c5ed-49cc-abe8-9ccc7c4cf337 tempest-TaggedAttachmentsTest-803160323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-58c3866e-97f8-46d6-a07a-20bb2c289570" returned: 0 in 0.422s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:18:51 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b063515a-c5ed-49cc-abe8-9ccc7c4cf337 tempest-TaggedAttachmentsTest-803160323 None] Lock "cinder-quobyte-58c3866e-97f8-46d6-a07a-20bb2c289570" released by "delete_volume" :: held 0.966s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:18:51 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-b063515a-c5ed-49cc-abe8-9ccc7c4cf337 tempest-TaggedAttachmentsTest-803160323 None] Created reservations ['861753f0-aed3-4ffd-b88e-1021b17eac51', '135865bb-ad26-4ef3-ae0b-ad8e139e3163', 'dac4684d-7d2b-42a3-b1c2-6b69b03c77ca', '90cd6813-1ac5-4eb6-8253-e9328828c7a6'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:18:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b063515a-c5ed-49cc-abe8-9ccc7c4cf337 tempest-TaggedAttachmentsTest-803160323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:18:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b063515a-c5ed-49cc-abe8-9ccc7c4cf337 tempest-TaggedAttachmentsTest-803160323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:18:51 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-b063515a-c5ed-49cc-abe8-9ccc7c4cf337 tempest-TaggedAttachmentsTest-803160323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:18:51 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-b063515a-c5ed-49cc-abe8-9ccc7c4cf337 tempest-TaggedAttachmentsTest-803160323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:18:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b063515a-c5ed-49cc-abe8-9ccc7c4cf337 tempest-TaggedAttachmentsTest-803160323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:18:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b063515a-c5ed-49cc-abe8-9ccc7c4cf337 tempest-TaggedAttachmentsTest-803160323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:18:51 devstack sudo[89478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:18:51 devstack sudo[89478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:18:52 devstack sudo[89478]: pam_unix(sudo:session): session closed for user root Nov 03 20:18:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b063515a-c5ed-49cc-abe8-9ccc7c4cf337 tempest-TaggedAttachmentsTest-803160323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.267s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:18:52 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-b063515a-c5ed-49cc-abe8-9ccc7c4cf337 tempest-TaggedAttachmentsTest-803160323 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:18:52 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-b063515a-c5ed-49cc-abe8-9ccc7c4cf337 tempest-TaggedAttachmentsTest-803160323 None] Deleted volume successfully. Nov 03 20:18:52 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b063515a-c5ed-49cc-abe8-9ccc7c4cf337 tempest-TaggedAttachmentsTest-803160323 None] Lock "cinder-58c3866e-97f8-46d6-a07a-20bb2c289570-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:18:58 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fcdee6a-f993-426e-b26d-4772999b5131 tempest-ServerActionsTestOtherA-836700016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:18:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6fcdee6a-f993-426e-b26d-4772999b5131 tempest-ServerActionsTestOtherA-836700016 None] Flow 'volume_create_manager' (0d5c4130-2246-4eb0-a496-981a48559c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:18:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6fcdee6a-f993-426e-b26d-4772999b5131 tempest-ServerActionsTestOtherA-836700016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2506253e-b617-4cac-b6dd-1dd2b360c295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:18:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6fcdee6a-f993-426e-b26d-4772999b5131 tempest-ServerActionsTestOtherA-836700016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2506253e-b617-4cac-b6dd-1dd2b360c295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1961533733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5061afd4-d0a0-4715-809b-d47a7c2b83e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45424ab9fd1245dc853d8bd68503846e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:18:59Z,use_quota=True,user_id='e2249889f62c48e3bfb18526317bb6e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:18:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6fcdee6a-f993-426e-b26d-4772999b5131 tempest-ServerActionsTestOtherA-836700016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60b586db-d1c5-4ae9-bff4-89a5177a970a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:18:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6fcdee6a-f993-426e-b26d-4772999b5131 tempest-ServerActionsTestOtherA-836700016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60b586db-d1c5-4ae9-bff4-89a5177a970a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:18:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6fcdee6a-f993-426e-b26d-4772999b5131 tempest-ServerActionsTestOtherA-836700016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0c30ff1-6f55-4c55-a584-75451a83a91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:18:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6fcdee6a-f993-426e-b26d-4772999b5131 tempest-ServerActionsTestOtherA-836700016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0c30ff1-6f55-4c55-a584-75451a83a91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5061afd4-d0a0-4715-809b-d47a7c2b83e4', 'volume_name': 'volume-5061afd4-d0a0-4715-809b-d47a7c2b83e4', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:18:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6fcdee6a-f993-426e-b26d-4772999b5131 tempest-ServerActionsTestOtherA-836700016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b3047ce-bce2-46ef-af86-9bea658de188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:18:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6fcdee6a-f993-426e-b26d-4772999b5131 tempest-ServerActionsTestOtherA-836700016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b3047ce-bce2-46ef-af86-9bea658de188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:18:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6fcdee6a-f993-426e-b26d-4772999b5131 tempest-ServerActionsTestOtherA-836700016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2334da55-5a43-421a-88f8-e59ff6ab758f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:18:58 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-6fcdee6a-f993-426e-b26d-4772999b5131 tempest-ServerActionsTestOtherA-836700016 None] Volume 5061afd4-d0a0-4715-809b-d47a7c2b83e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5061afd4-d0a0-4715-809b-d47a7c2b83e4', 'volume_size': 1} Nov 03 20:18:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6fcdee6a-f993-426e-b26d-4772999b5131 tempest-ServerActionsTestOtherA-836700016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:18:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6fcdee6a-f993-426e-b26d-4772999b5131 tempest-ServerActionsTestOtherA-836700016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:18:58 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-6fcdee6a-f993-426e-b26d-4772999b5131 tempest-ServerActionsTestOtherA-836700016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1961533733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5061afd4-d0a0-4715-809b-d47a7c2b83e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45424ab9fd1245dc853d8bd68503846e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:18:59Z,use_quota=True,user_id='e2249889f62c48e3bfb18526317bb6e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:18:58 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-6fcdee6a-f993-426e-b26d-4772999b5131 tempest-ServerActionsTestOtherA-836700016 None] Creating volume 5061afd4-d0a0-4715-809b-d47a7c2b83e4 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:18:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6fcdee6a-f993-426e-b26d-4772999b5131 tempest-ServerActionsTestOtherA-836700016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:18:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6fcdee6a-f993-426e-b26d-4772999b5131 tempest-ServerActionsTestOtherA-836700016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:18:58 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-6fcdee6a-f993-426e-b26d-4772999b5131 tempest-ServerActionsTestOtherA-836700016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:18:58 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-6fcdee6a-f993-426e-b26d-4772999b5131 tempest-ServerActionsTestOtherA-836700016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:18:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6fcdee6a-f993-426e-b26d-4772999b5131 tempest-ServerActionsTestOtherA-836700016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:18:58 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-6fcdee6a-f993-426e-b26d-4772999b5131 tempest-ServerActionsTestOtherA-836700016 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:18:58 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-6fcdee6a-f993-426e-b26d-4772999b5131 tempest-ServerActionsTestOtherA-836700016 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:18:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6fcdee6a-f993-426e-b26d-4772999b5131 tempest-ServerActionsTestOtherA-836700016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5061afd4-d0a0-4715-809b-d47a7c2b83e4 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:18:58 devstack sudo[89597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5061afd4-d0a0-4715-809b-d47a7c2b83e4 1073741824 Nov 03 20:18:58 devstack sudo[89597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:18:59 devstack sudo[89597]: pam_unix(sudo:session): session closed for user root Nov 03 20:18:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6fcdee6a-f993-426e-b26d-4772999b5131 tempest-ServerActionsTestOtherA-836700016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5061afd4-d0a0-4715-809b-d47a7c2b83e4 1073741824" returned: 0 in 0.610s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:18:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6fcdee6a-f993-426e-b26d-4772999b5131 tempest-ServerActionsTestOtherA-836700016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5061afd4-d0a0-4715-809b-d47a7c2b83e4 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:18:59 devstack sudo[89603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5061afd4-d0a0-4715-809b-d47a7c2b83e4 Nov 03 20:18:59 devstack sudo[89603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:19:00 devstack sudo[89603]: pam_unix(sudo:session): session closed for user root Nov 03 20:19:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6fcdee6a-f993-426e-b26d-4772999b5131 tempest-ServerActionsTestOtherA-836700016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5061afd4-d0a0-4715-809b-d47a7c2b83e4" returned: 0 in 0.571s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:19:00 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-6fcdee6a-f993-426e-b26d-4772999b5131 tempest-ServerActionsTestOtherA-836700016 None] <== create_volume: return (1246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:19:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6fcdee6a-f993-426e-b26d-4772999b5131 tempest-ServerActionsTestOtherA-836700016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.248s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:19:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6fcdee6a-f993-426e-b26d-4772999b5131 tempest-ServerActionsTestOtherA-836700016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2334da55-5a43-421a-88f8-e59ff6ab758f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5061afd4-d0a0-4715-809b-d47a7c2b83e4', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:19:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6fcdee6a-f993-426e-b26d-4772999b5131 tempest-ServerActionsTestOtherA-836700016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (072544ed-bf3f-47d6-a103-28a6c15be65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:19:00 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-6fcdee6a-f993-426e-b26d-4772999b5131 tempest-ServerActionsTestOtherA-836700016 None] Volume volume-5061afd4-d0a0-4715-809b-d47a7c2b83e4 (5061afd4-d0a0-4715-809b-d47a7c2b83e4): created successfully Nov 03 20:19:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6fcdee6a-f993-426e-b26d-4772999b5131 tempest-ServerActionsTestOtherA-836700016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (072544ed-bf3f-47d6-a103-28a6c15be65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:19:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6fcdee6a-f993-426e-b26d-4772999b5131 tempest-ServerActionsTestOtherA-836700016 None] Flow 'volume_create_manager' (0d5c4130-2246-4eb0-a496-981a48559c71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:19:00 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-6fcdee6a-f993-426e-b26d-4772999b5131 tempest-ServerActionsTestOtherA-836700016 None] Created volume successfully. Nov 03 20:19:00 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-e83ad51a-db57-4753-b3f0-f2cef145a0c0 tempest-DeleteServersTestJSON-1633433155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:19:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e83ad51a-db57-4753-b3f0-f2cef145a0c0 tempest-DeleteServersTestJSON-1633433155 None] Flow 'volume_create_manager' (e6b70a3a-89a6-445e-bfe6-d488664cbc95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:19:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e83ad51a-db57-4753-b3f0-f2cef145a0c0 tempest-DeleteServersTestJSON-1633433155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f880ebf-54c1-42f3-b9ad-426fdfbdb6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:19:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e83ad51a-db57-4753-b3f0-f2cef145a0c0 tempest-DeleteServersTestJSON-1633433155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f880ebf-54c1-42f3-b9ad-426fdfbdb6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-30544098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aea67515-26f3-4b45-a1f9-befc8fe5f6b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be3e97e6af494f9087ad36a73d3213c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:19:01Z,use_quota=True,user_id='e44181ed91b44b3b8696a2c980433d76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:19:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e83ad51a-db57-4753-b3f0-f2cef145a0c0 tempest-DeleteServersTestJSON-1633433155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d16313dd-97b7-4277-a984-82bf1a2c8d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:19:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e83ad51a-db57-4753-b3f0-f2cef145a0c0 tempest-DeleteServersTestJSON-1633433155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d16313dd-97b7-4277-a984-82bf1a2c8d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:19:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e83ad51a-db57-4753-b3f0-f2cef145a0c0 tempest-DeleteServersTestJSON-1633433155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (564829bd-01f6-4d1c-b054-931729e2037b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:19:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e83ad51a-db57-4753-b3f0-f2cef145a0c0 tempest-DeleteServersTestJSON-1633433155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (564829bd-01f6-4d1c-b054-931729e2037b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aea67515-26f3-4b45-a1f9-befc8fe5f6b9', 'volume_name': 'volume-aea67515-26f3-4b45-a1f9-befc8fe5f6b9', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:19:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e83ad51a-db57-4753-b3f0-f2cef145a0c0 tempest-DeleteServersTestJSON-1633433155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c902d61f-d9e9-454b-a66f-6230083a03c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:19:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e83ad51a-db57-4753-b3f0-f2cef145a0c0 tempest-DeleteServersTestJSON-1633433155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c902d61f-d9e9-454b-a66f-6230083a03c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:19:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e83ad51a-db57-4753-b3f0-f2cef145a0c0 tempest-DeleteServersTestJSON-1633433155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c11f7590-4146-4b60-b836-f188038c7fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:19:00 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-e83ad51a-db57-4753-b3f0-f2cef145a0c0 tempest-DeleteServersTestJSON-1633433155 None] Volume aea67515-26f3-4b45-a1f9-befc8fe5f6b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aea67515-26f3-4b45-a1f9-befc8fe5f6b9', 'volume_size': 1} Nov 03 20:19:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e83ad51a-db57-4753-b3f0-f2cef145a0c0 tempest-DeleteServersTestJSON-1633433155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:19:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e83ad51a-db57-4753-b3f0-f2cef145a0c0 tempest-DeleteServersTestJSON-1633433155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:19:00 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e83ad51a-db57-4753-b3f0-f2cef145a0c0 tempest-DeleteServersTestJSON-1633433155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-30544098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aea67515-26f3-4b45-a1f9-befc8fe5f6b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be3e97e6af494f9087ad36a73d3213c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:19:01Z,use_quota=True,user_id='e44181ed91b44b3b8696a2c980433d76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:19:00 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-e83ad51a-db57-4753-b3f0-f2cef145a0c0 tempest-DeleteServersTestJSON-1633433155 None] Creating volume aea67515-26f3-4b45-a1f9-befc8fe5f6b9 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:19:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e83ad51a-db57-4753-b3f0-f2cef145a0c0 tempest-DeleteServersTestJSON-1633433155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:19:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e83ad51a-db57-4753-b3f0-f2cef145a0c0 tempest-DeleteServersTestJSON-1633433155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:19:00 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e83ad51a-db57-4753-b3f0-f2cef145a0c0 tempest-DeleteServersTestJSON-1633433155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:19:00 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e83ad51a-db57-4753-b3f0-f2cef145a0c0 tempest-DeleteServersTestJSON-1633433155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:19:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e83ad51a-db57-4753-b3f0-f2cef145a0c0 tempest-DeleteServersTestJSON-1633433155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:19:00 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e83ad51a-db57-4753-b3f0-f2cef145a0c0 tempest-DeleteServersTestJSON-1633433155 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:19:00 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-e83ad51a-db57-4753-b3f0-f2cef145a0c0 tempest-DeleteServersTestJSON-1633433155 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:19:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e83ad51a-db57-4753-b3f0-f2cef145a0c0 tempest-DeleteServersTestJSON-1633433155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-aea67515-26f3-4b45-a1f9-befc8fe5f6b9 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:19:00 devstack sudo[89606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-aea67515-26f3-4b45-a1f9-befc8fe5f6b9 1073741824 Nov 03 20:19:00 devstack sudo[89606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:19:01 devstack sudo[89606]: pam_unix(sudo:session): session closed for user root Nov 03 20:19:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e83ad51a-db57-4753-b3f0-f2cef145a0c0 tempest-DeleteServersTestJSON-1633433155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-aea67515-26f3-4b45-a1f9-befc8fe5f6b9 1073741824" returned: 0 in 0.557s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:19:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e83ad51a-db57-4753-b3f0-f2cef145a0c0 tempest-DeleteServersTestJSON-1633433155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-aea67515-26f3-4b45-a1f9-befc8fe5f6b9 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:19:01 devstack sudo[89619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-aea67515-26f3-4b45-a1f9-befc8fe5f6b9 Nov 03 20:19:01 devstack sudo[89619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:19:01 devstack sudo[89619]: pam_unix(sudo:session): session closed for user root Nov 03 20:19:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e83ad51a-db57-4753-b3f0-f2cef145a0c0 tempest-DeleteServersTestJSON-1633433155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-aea67515-26f3-4b45-a1f9-befc8fe5f6b9" returned: 0 in 0.272s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:19:01 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e83ad51a-db57-4753-b3f0-f2cef145a0c0 tempest-DeleteServersTestJSON-1633433155 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:19:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e83ad51a-db57-4753-b3f0-f2cef145a0c0 tempest-DeleteServersTestJSON-1633433155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:19:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e83ad51a-db57-4753-b3f0-f2cef145a0c0 tempest-DeleteServersTestJSON-1633433155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c11f7590-4146-4b60-b836-f188038c7fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aea67515-26f3-4b45-a1f9-befc8fe5f6b9', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:19:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e83ad51a-db57-4753-b3f0-f2cef145a0c0 tempest-DeleteServersTestJSON-1633433155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac1d62d1-60c6-450f-aac4-e330aa47ebb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:19:01 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-e83ad51a-db57-4753-b3f0-f2cef145a0c0 tempest-DeleteServersTestJSON-1633433155 None] Volume volume-aea67515-26f3-4b45-a1f9-befc8fe5f6b9 (aea67515-26f3-4b45-a1f9-befc8fe5f6b9): created successfully Nov 03 20:19:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e83ad51a-db57-4753-b3f0-f2cef145a0c0 tempest-DeleteServersTestJSON-1633433155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac1d62d1-60c6-450f-aac4-e330aa47ebb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:19:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e83ad51a-db57-4753-b3f0-f2cef145a0c0 tempest-DeleteServersTestJSON-1633433155 None] Flow 'volume_create_manager' (e6b70a3a-89a6-445e-bfe6-d488664cbc95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:19:01 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-e83ad51a-db57-4753-b3f0-f2cef145a0c0 tempest-DeleteServersTestJSON-1633433155 None] Created volume successfully. Nov 03 20:19:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-dbbe938d-7f6d-4941-8401-a512c7e0c281 req-adab46d6-0b6a-41d0-9da3-d8d3bc7ba6a3 tempest-DeleteServersTestJSON-1633433155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:19:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-dbbe938d-7f6d-4941-8401-a512c7e0c281 req-adab46d6-0b6a-41d0-9da3-d8d3bc7ba6a3 tempest-DeleteServersTestJSON-1633433155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:19:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-dbbe938d-7f6d-4941-8401-a512c7e0c281 req-adab46d6-0b6a-41d0-9da3-d8d3bc7ba6a3 tempest-DeleteServersTestJSON-1633433155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:19:05 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-dbbe938d-7f6d-4941-8401-a512c7e0c281 req-adab46d6-0b6a-41d0-9da3-d8d3bc7ba6a3 tempest-DeleteServersTestJSON-1633433155 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8', 'name': 'volume-aea67515-26f3-4b45-a1f9-befc8fe5f6b9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd097c012-cc41-4d10-9a11-2a542d5a12df', 'enforce_multipath': True} {{(pid=87248) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 20:19:05 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-dbbe938d-7f6d-4941-8401-a512c7e0c281 req-adab46d6-0b6a-41d0-9da3-d8d3bc7ba6a3 tempest-DeleteServersTestJSON-1633433155 None] attachment_update completed successfully. Nov 03 20:19:10 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-6b49f64d-366c-4ce5-912b-e5cfcb4adc20 req-9846d421-f65c-43e2-966e-4043174dbbab tempest-DeleteServersTestJSON-1633433155 None] Terminate volume connection completed successfully. Nov 03 20:19:10 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-6b49f64d-366c-4ce5-912b-e5cfcb4adc20 req-9846d421-f65c-43e2-966e-4043174dbbab tempest-DeleteServersTestJSON-1633433155 None] Deleting attachment d097c012-cc41-4d10-9a11-2a542d5a12df. {{(pid=87248) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 20:19:14 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1b7997db-695f-4430-a848-168f3fd5de09 tempest-DeleteServersTestJSON-1633433155 None] Acquiring lock "cinder-aea67515-26f3-4b45-a1f9-befc8fe5f6b9-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:19:14 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1b7997db-695f-4430-a848-168f3fd5de09 tempest-DeleteServersTestJSON-1633433155 None] Lock "cinder-aea67515-26f3-4b45-a1f9-befc8fe5f6b9-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:19:14 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1b7997db-695f-4430-a848-168f3fd5de09 tempest-DeleteServersTestJSON-1633433155 None] Acquiring lock "cinder-quobyte-aea67515-26f3-4b45-a1f9-befc8fe5f6b9" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:19:15 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1b7997db-695f-4430-a848-168f3fd5de09 tempest-DeleteServersTestJSON-1633433155 None] Lock "cinder-quobyte-aea67515-26f3-4b45-a1f9-befc8fe5f6b9" acquired by "delete_volume" :: waited 0.056s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:19:15 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e1a57a-bab6-4b6e-a79d-a9479bc2c04b]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:19:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1b7997db-695f-4430-a848-168f3fd5de09 tempest-DeleteServersTestJSON-1633433155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-aea67515-26f3-4b45-a1f9-befc8fe5f6b9 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:19:15 devstack sudo[90278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-aea67515-26f3-4b45-a1f9-befc8fe5f6b9 Nov 03 20:19:15 devstack sudo[90278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:19:15 devstack sudo[90278]: pam_unix(sudo:session): session closed for user root Nov 03 20:19:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1b7997db-695f-4430-a848-168f3fd5de09 tempest-DeleteServersTestJSON-1633433155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-aea67515-26f3-4b45-a1f9-befc8fe5f6b9" returned: 0 in 0.828s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:19:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1b7997db-695f-4430-a848-168f3fd5de09 tempest-DeleteServersTestJSON-1633433155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-aea67515-26f3-4b45-a1f9-befc8fe5f6b9 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:19:16 devstack sudo[90291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-aea67515-26f3-4b45-a1f9-befc8fe5f6b9 Nov 03 20:19:16 devstack sudo[90291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:19:16 devstack sudo[90291]: pam_unix(sudo:session): session closed for user root Nov 03 20:19:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1b7997db-695f-4430-a848-168f3fd5de09 tempest-DeleteServersTestJSON-1633433155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-aea67515-26f3-4b45-a1f9-befc8fe5f6b9" returned: 0 in 0.409s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:19:16 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1b7997db-695f-4430-a848-168f3fd5de09 tempest-DeleteServersTestJSON-1633433155 None] Lock "cinder-quobyte-aea67515-26f3-4b45-a1f9-befc8fe5f6b9" released by "delete_volume" :: held 1.390s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:19:16 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-1b7997db-695f-4430-a848-168f3fd5de09 tempest-DeleteServersTestJSON-1633433155 None] Created reservations ['e2b94f93-7afc-4cfe-8e9c-cd52ff4efc31', 'c6bc52af-bcfc-4ec8-87ff-decdf82b2f2c', '139c2528-2ad1-49b1-8539-3113762efd10', '004ca243-d582-44d7-a0a5-353eb66f7273'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:19:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1b7997db-695f-4430-a848-168f3fd5de09 tempest-DeleteServersTestJSON-1633433155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:19:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1b7997db-695f-4430-a848-168f3fd5de09 tempest-DeleteServersTestJSON-1633433155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:19:16 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-1b7997db-695f-4430-a848-168f3fd5de09 tempest-DeleteServersTestJSON-1633433155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:19:16 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-1b7997db-695f-4430-a848-168f3fd5de09 tempest-DeleteServersTestJSON-1633433155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:19:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1b7997db-695f-4430-a848-168f3fd5de09 tempest-DeleteServersTestJSON-1633433155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:19:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1b7997db-695f-4430-a848-168f3fd5de09 tempest-DeleteServersTestJSON-1633433155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:19:16 devstack sudo[90295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:19:16 devstack sudo[90295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:19:17 devstack sudo[90295]: pam_unix(sudo:session): session closed for user root Nov 03 20:19:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1b7997db-695f-4430-a848-168f3fd5de09 tempest-DeleteServersTestJSON-1633433155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.586s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:19:17 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-1b7997db-695f-4430-a848-168f3fd5de09 tempest-DeleteServersTestJSON-1633433155 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:19:17 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-1b7997db-695f-4430-a848-168f3fd5de09 tempest-DeleteServersTestJSON-1633433155 None] Deleted volume successfully. Nov 03 20:19:17 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1b7997db-695f-4430-a848-168f3fd5de09 tempest-DeleteServersTestJSON-1633433155 None] Lock "cinder-aea67515-26f3-4b45-a1f9-befc8fe5f6b9-delete_volume" released by "delete_volume" :: held 2.444s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:19:21 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [req-f9dd0165-bc88-45e8-99da-26d8322faae0 req-303c33d0-b2bc-4650-a74d-191bd1204e64 tempest-VolumesSnapshotsTestJSON-1977314237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:19:21 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-f9dd0165-bc88-45e8-99da-26d8322faae0 req-303c33d0-b2bc-4650-a74d-191bd1204e64 tempest-VolumesSnapshotsTestJSON-1977314237 None] Flow 'volume_create_manager' (aadfc2ea-0e5d-41f9-87e0-84a008473379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:19:21 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-f9dd0165-bc88-45e8-99da-26d8322faae0 req-303c33d0-b2bc-4650-a74d-191bd1204e64 tempest-VolumesSnapshotsTestJSON-1977314237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1f8257c-e8ce-4baa-815f-5785600dd06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:19:21 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-f9dd0165-bc88-45e8-99da-26d8322faae0 req-303c33d0-b2bc-4650-a74d-191bd1204e64 tempest-VolumesSnapshotsTestJSON-1977314237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1f8257c-e8ce-4baa-815f-5785600dd06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-27425039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6606e93b-755c-4f12-ba68-dec1c72c6107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='689fb7392ec04a12bcf306ab1656b3ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:19:22Z,use_quota=True,user_id='a5b55473c2bb42528dc0c3c064de09ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:19:21 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-f9dd0165-bc88-45e8-99da-26d8322faae0 req-303c33d0-b2bc-4650-a74d-191bd1204e64 tempest-VolumesSnapshotsTestJSON-1977314237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa4034be-d21d-4fbc-adf4-cd53ad7a68ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:19:21 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-f9dd0165-bc88-45e8-99da-26d8322faae0 req-303c33d0-b2bc-4650-a74d-191bd1204e64 tempest-VolumesSnapshotsTestJSON-1977314237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa4034be-d21d-4fbc-adf4-cd53ad7a68ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:19:21 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-f9dd0165-bc88-45e8-99da-26d8322faae0 req-303c33d0-b2bc-4650-a74d-191bd1204e64 tempest-VolumesSnapshotsTestJSON-1977314237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5412ec40-22df-42c2-9aa3-2efd0dc5ecf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:19:21 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-f9dd0165-bc88-45e8-99da-26d8322faae0 req-303c33d0-b2bc-4650-a74d-191bd1204e64 tempest-VolumesSnapshotsTestJSON-1977314237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5412ec40-22df-42c2-9aa3-2efd0dc5ecf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6606e93b-755c-4f12-ba68-dec1c72c6107', 'volume_name': 'volume-6606e93b-755c-4f12-ba68-dec1c72c6107', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:19:21 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-f9dd0165-bc88-45e8-99da-26d8322faae0 req-303c33d0-b2bc-4650-a74d-191bd1204e64 tempest-VolumesSnapshotsTestJSON-1977314237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2caad3ad-18f1-487c-97c8-97ac6bacbc9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:19:21 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-f9dd0165-bc88-45e8-99da-26d8322faae0 req-303c33d0-b2bc-4650-a74d-191bd1204e64 tempest-VolumesSnapshotsTestJSON-1977314237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2caad3ad-18f1-487c-97c8-97ac6bacbc9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:19:21 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-f9dd0165-bc88-45e8-99da-26d8322faae0 req-303c33d0-b2bc-4650-a74d-191bd1204e64 tempest-VolumesSnapshotsTestJSON-1977314237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05cefcfd-66fb-43ab-8455-e51783b4f1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:19:21 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [req-f9dd0165-bc88-45e8-99da-26d8322faae0 req-303c33d0-b2bc-4650-a74d-191bd1204e64 tempest-VolumesSnapshotsTestJSON-1977314237 None] Volume 6606e93b-755c-4f12-ba68-dec1c72c6107: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6606e93b-755c-4f12-ba68-dec1c72c6107', 'volume_size': 1} Nov 03 20:19:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-f9dd0165-bc88-45e8-99da-26d8322faae0 req-303c33d0-b2bc-4650-a74d-191bd1204e64 tempest-VolumesSnapshotsTestJSON-1977314237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:19:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-f9dd0165-bc88-45e8-99da-26d8322faae0 req-303c33d0-b2bc-4650-a74d-191bd1204e64 tempest-VolumesSnapshotsTestJSON-1977314237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:19:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [req-f9dd0165-bc88-45e8-99da-26d8322faae0 req-303c33d0-b2bc-4650-a74d-191bd1204e64 tempest-VolumesSnapshotsTestJSON-1977314237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-27425039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6606e93b-755c-4f12-ba68-dec1c72c6107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='689fb7392ec04a12bcf306ab1656b3ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:19:22Z,use_quota=True,user_id='a5b55473c2bb42528dc0c3c064de09ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:19:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [req-f9dd0165-bc88-45e8-99da-26d8322faae0 req-303c33d0-b2bc-4650-a74d-191bd1204e64 tempest-VolumesSnapshotsTestJSON-1977314237 None] Creating volume 6606e93b-755c-4f12-ba68-dec1c72c6107 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:19:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-f9dd0165-bc88-45e8-99da-26d8322faae0 req-303c33d0-b2bc-4650-a74d-191bd1204e64 tempest-VolumesSnapshotsTestJSON-1977314237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:19:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-f9dd0165-bc88-45e8-99da-26d8322faae0 req-303c33d0-b2bc-4650-a74d-191bd1204e64 tempest-VolumesSnapshotsTestJSON-1977314237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:19:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [req-f9dd0165-bc88-45e8-99da-26d8322faae0 req-303c33d0-b2bc-4650-a74d-191bd1204e64 tempest-VolumesSnapshotsTestJSON-1977314237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:19:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [req-f9dd0165-bc88-45e8-99da-26d8322faae0 req-303c33d0-b2bc-4650-a74d-191bd1204e64 tempest-VolumesSnapshotsTestJSON-1977314237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:19:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-f9dd0165-bc88-45e8-99da-26d8322faae0 req-303c33d0-b2bc-4650-a74d-191bd1204e64 tempest-VolumesSnapshotsTestJSON-1977314237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:19:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [req-f9dd0165-bc88-45e8-99da-26d8322faae0 req-303c33d0-b2bc-4650-a74d-191bd1204e64 tempest-VolumesSnapshotsTestJSON-1977314237 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:19:21 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [req-f9dd0165-bc88-45e8-99da-26d8322faae0 req-303c33d0-b2bc-4650-a74d-191bd1204e64 tempest-VolumesSnapshotsTestJSON-1977314237 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:19:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-f9dd0165-bc88-45e8-99da-26d8322faae0 req-303c33d0-b2bc-4650-a74d-191bd1204e64 tempest-VolumesSnapshotsTestJSON-1977314237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6606e93b-755c-4f12-ba68-dec1c72c6107 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:19:21 devstack sudo[90306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6606e93b-755c-4f12-ba68-dec1c72c6107 1073741824 Nov 03 20:19:21 devstack sudo[90306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:19:22 devstack sudo[90306]: pam_unix(sudo:session): session closed for user root Nov 03 20:19:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-f9dd0165-bc88-45e8-99da-26d8322faae0 req-303c33d0-b2bc-4650-a74d-191bd1204e64 tempest-VolumesSnapshotsTestJSON-1977314237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6606e93b-755c-4f12-ba68-dec1c72c6107 1073741824" returned: 0 in 0.793s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:19:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-f9dd0165-bc88-45e8-99da-26d8322faae0 req-303c33d0-b2bc-4650-a74d-191bd1204e64 tempest-VolumesSnapshotsTestJSON-1977314237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6606e93b-755c-4f12-ba68-dec1c72c6107 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:19:22 devstack sudo[90313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6606e93b-755c-4f12-ba68-dec1c72c6107 Nov 03 20:19:22 devstack sudo[90313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:19:23 devstack sudo[90313]: pam_unix(sudo:session): session closed for user root Nov 03 20:19:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-f9dd0165-bc88-45e8-99da-26d8322faae0 req-303c33d0-b2bc-4650-a74d-191bd1204e64 tempest-VolumesSnapshotsTestJSON-1977314237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6606e93b-755c-4f12-ba68-dec1c72c6107" returned: 0 in 0.373s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:19:23 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [req-f9dd0165-bc88-45e8-99da-26d8322faae0 req-303c33d0-b2bc-4650-a74d-191bd1204e64 tempest-VolumesSnapshotsTestJSON-1977314237 None] <== create_volume: return (1263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:19:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-f9dd0165-bc88-45e8-99da-26d8322faae0 req-303c33d0-b2bc-4650-a74d-191bd1204e64 tempest-VolumesSnapshotsTestJSON-1977314237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.266s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:19:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-f9dd0165-bc88-45e8-99da-26d8322faae0 req-303c33d0-b2bc-4650-a74d-191bd1204e64 tempest-VolumesSnapshotsTestJSON-1977314237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05cefcfd-66fb-43ab-8455-e51783b4f1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6606e93b-755c-4f12-ba68-dec1c72c6107', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:19:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-f9dd0165-bc88-45e8-99da-26d8322faae0 req-303c33d0-b2bc-4650-a74d-191bd1204e64 tempest-VolumesSnapshotsTestJSON-1977314237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92d20434-a8d7-49c2-ab07-b25b2d70da0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:19:23 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [req-f9dd0165-bc88-45e8-99da-26d8322faae0 req-303c33d0-b2bc-4650-a74d-191bd1204e64 tempest-VolumesSnapshotsTestJSON-1977314237 None] Volume volume-6606e93b-755c-4f12-ba68-dec1c72c6107 (6606e93b-755c-4f12-ba68-dec1c72c6107): created successfully Nov 03 20:19:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-f9dd0165-bc88-45e8-99da-26d8322faae0 req-303c33d0-b2bc-4650-a74d-191bd1204e64 tempest-VolumesSnapshotsTestJSON-1977314237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92d20434-a8d7-49c2-ab07-b25b2d70da0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:19:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-f9dd0165-bc88-45e8-99da-26d8322faae0 req-303c33d0-b2bc-4650-a74d-191bd1204e64 tempest-VolumesSnapshotsTestJSON-1977314237 None] Flow 'volume_create_manager' (aadfc2ea-0e5d-41f9-87e0-84a008473379) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:19:23 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-f9dd0165-bc88-45e8-99da-26d8322faae0 req-303c33d0-b2bc-4650-a74d-191bd1204e64 tempest-VolumesSnapshotsTestJSON-1977314237 None] Created volume successfully. Nov 03 20:19:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-58ee2b76-bcf2-4685-ac7a-5ef8fea57046 req-88e929a8-f31e-4b64-a044-c586ae3f4f75 tempest-VolumesSnapshotsTestJSON-1977314237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:19:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-58ee2b76-bcf2-4685-ac7a-5ef8fea57046 req-88e929a8-f31e-4b64-a044-c586ae3f4f75 tempest-VolumesSnapshotsTestJSON-1977314237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:19:24 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [req-58ee2b76-bcf2-4685-ac7a-5ef8fea57046 req-88e929a8-f31e-4b64-a044-c586ae3f4f75 tempest-VolumesSnapshotsTestJSON-1977314237 None] Creating offline snapshot 0eba6eca-5d43-4a63-8349-2dbf3f82f24c of volume 6606e93b-755c-4f12-ba68-dec1c72c6107 {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:19:24 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[5325e240-fb6d-4e2f-951d-b69f85293410]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:19:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-58ee2b76-bcf2-4685-ac7a-5ef8fea57046 req-88e929a8-f31e-4b64-a044-c586ae3f4f75 tempest-VolumesSnapshotsTestJSON-1977314237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6606e93b-755c-4f12-ba68-dec1c72c6107 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:19:24 devstack sudo[90319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6606e93b-755c-4f12-ba68-dec1c72c6107 Nov 03 20:19:24 devstack sudo[90319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:19:25 devstack sudo[90319]: pam_unix(sudo:session): session closed for user root Nov 03 20:19:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-58ee2b76-bcf2-4685-ac7a-5ef8fea57046 req-88e929a8-f31e-4b64-a044-c586ae3f4f75 tempest-VolumesSnapshotsTestJSON-1977314237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6606e93b-755c-4f12-ba68-dec1c72c6107" returned: 0 in 0.740s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:19:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-58ee2b76-bcf2-4685-ac7a-5ef8fea57046 req-88e929a8-f31e-4b64-a044-c586ae3f4f75 tempest-VolumesSnapshotsTestJSON-1977314237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6606e93b-755c-4f12-ba68-dec1c72c6107,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6606e93b-755c-4f12-ba68-dec1c72c6107.0eba6eca-5d43-4a63-8349-2dbf3f82f24c 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:19:25 devstack sudo[90324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6606e93b-755c-4f12-ba68-dec1c72c6107,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6606e93b-755c-4f12-ba68-dec1c72c6107.0eba6eca-5d43-4a63-8349-2dbf3f82f24c 1G Nov 03 20:19:25 devstack sudo[90324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:19:25 devstack sudo[90324]: pam_unix(sudo:session): session closed for user root Nov 03 20:19:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-58ee2b76-bcf2-4685-ac7a-5ef8fea57046 req-88e929a8-f31e-4b64-a044-c586ae3f4f75 tempest-VolumesSnapshotsTestJSON-1977314237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6606e93b-755c-4f12-ba68-dec1c72c6107,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6606e93b-755c-4f12-ba68-dec1c72c6107.0eba6eca-5d43-4a63-8349-2dbf3f82f24c 1G" returned: 0 in 0.675s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:19:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-58ee2b76-bcf2-4685-ac7a-5ef8fea57046 req-88e929a8-f31e-4b64-a044-c586ae3f4f75 tempest-VolumesSnapshotsTestJSON-1977314237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6606e93b-755c-4f12-ba68-dec1c72c6107 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6606e93b-755c-4f12-ba68-dec1c72c6107.0eba6eca-5d43-4a63-8349-2dbf3f82f24c {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:19:25 devstack sudo[90330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6606e93b-755c-4f12-ba68-dec1c72c6107 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6606e93b-755c-4f12-ba68-dec1c72c6107.0eba6eca-5d43-4a63-8349-2dbf3f82f24c Nov 03 20:19:25 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:19:26 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root Nov 03 20:19:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-58ee2b76-bcf2-4685-ac7a-5ef8fea57046 req-88e929a8-f31e-4b64-a044-c586ae3f4f75 tempest-VolumesSnapshotsTestJSON-1977314237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6606e93b-755c-4f12-ba68-dec1c72c6107 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6606e93b-755c-4f12-ba68-dec1c72c6107.0eba6eca-5d43-4a63-8349-2dbf3f82f24c" returned: 0 in 0.375s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:19:26 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [req-58ee2b76-bcf2-4685-ac7a-5ef8fea57046 req-88e929a8-f31e-4b64-a044-c586ae3f4f75 tempest-VolumesSnapshotsTestJSON-1977314237 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6606e93b-755c-4f12-ba68-dec1c72c6107.0eba6eca-5d43-4a63-8349-2dbf3f82f24c is being set with open permissions: ugo+rw Nov 03 20:19:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-58ee2b76-bcf2-4685-ac7a-5ef8fea57046 req-88e929a8-f31e-4b64-a044-c586ae3f4f75 tempest-VolumesSnapshotsTestJSON-1977314237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6606e93b-755c-4f12-ba68-dec1c72c6107.0eba6eca-5d43-4a63-8349-2dbf3f82f24c {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:19:26 devstack sudo[90335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6606e93b-755c-4f12-ba68-dec1c72c6107.0eba6eca-5d43-4a63-8349-2dbf3f82f24c Nov 03 20:19:26 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:19:26 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root Nov 03 20:19:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-58ee2b76-bcf2-4685-ac7a-5ef8fea57046 req-88e929a8-f31e-4b64-a044-c586ae3f4f75 tempest-VolumesSnapshotsTestJSON-1977314237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6606e93b-755c-4f12-ba68-dec1c72c6107.0eba6eca-5d43-4a63-8349-2dbf3f82f24c" returned: 0 in 0.329s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:19:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-58ee2b76-bcf2-4685-ac7a-5ef8fea57046 req-88e929a8-f31e-4b64-a044-c586ae3f4f75 tempest-VolumesSnapshotsTestJSON-1977314237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6606e93b-755c-4f12-ba68-dec1c72c6107.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:19:26 devstack sudo[90338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6606e93b-755c-4f12-ba68-dec1c72c6107.info Nov 03 20:19:26 devstack sudo[90338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:19:27 devstack sudo[90338]: pam_unix(sudo:session): session closed for user root Nov 03 20:19:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-58ee2b76-bcf2-4685-ac7a-5ef8fea57046 req-88e929a8-f31e-4b64-a044-c586ae3f4f75 tempest-VolumesSnapshotsTestJSON-1977314237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6606e93b-755c-4f12-ba68-dec1c72c6107.info" returned: 0 in 0.548s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:19:27 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [req-58ee2b76-bcf2-4685-ac7a-5ef8fea57046 req-88e929a8-f31e-4b64-a044-c586ae3f4f75 tempest-VolumesSnapshotsTestJSON-1977314237 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6606e93b-755c-4f12-ba68-dec1c72c6107.info is being set with open permissions: ugo+rw Nov 03 20:19:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-58ee2b76-bcf2-4685-ac7a-5ef8fea57046 req-88e929a8-f31e-4b64-a044-c586ae3f4f75 tempest-VolumesSnapshotsTestJSON-1977314237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6606e93b-755c-4f12-ba68-dec1c72c6107.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:19:27 devstack sudo[90342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6606e93b-755c-4f12-ba68-dec1c72c6107.info Nov 03 20:19:27 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:19:27 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root Nov 03 20:19:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-58ee2b76-bcf2-4685-ac7a-5ef8fea57046 req-88e929a8-f31e-4b64-a044-c586ae3f4f75 tempest-VolumesSnapshotsTestJSON-1977314237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6606e93b-755c-4f12-ba68-dec1c72c6107.info" returned: 0 in 0.385s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:19:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-58ee2b76-bcf2-4685-ac7a-5ef8fea57046 req-88e929a8-f31e-4b64-a044-c586ae3f4f75 tempest-VolumesSnapshotsTestJSON-1977314237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.274s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:19:27 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-58ee2b76-bcf2-4685-ac7a-5ef8fea57046 req-88e929a8-f31e-4b64-a044-c586ae3f4f75 tempest-VolumesSnapshotsTestJSON-1977314237 None] Create snapshot completed successfully Nov 03 20:19:28 devstack cinder-volume[87248]: DEBUG cinder.coordination [req-b9f0bf6f-ee16-4b22-9df5-0cba74dfbeb5 req-86aaf21d-9f76-4b8a-ae35-7c20c5b23d15 tempest-VolumesSnapshotsTestJSON-1977314237 None] Acquiring lock "cinder-0eba6eca-5d43-4a63-8349-2dbf3f82f24c-delete_snapshot" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:19:28 devstack cinder-volume[87248]: DEBUG cinder.coordination [req-b9f0bf6f-ee16-4b22-9df5-0cba74dfbeb5 req-86aaf21d-9f76-4b8a-ae35-7c20c5b23d15 tempest-VolumesSnapshotsTestJSON-1977314237 None] Lock "cinder-0eba6eca-5d43-4a63-8349-2dbf3f82f24c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:19:28 devstack cinder-volume[87248]: DEBUG cinder.coordination [req-b9f0bf6f-ee16-4b22-9df5-0cba74dfbeb5 req-86aaf21d-9f76-4b8a-ae35-7c20c5b23d15 tempest-VolumesSnapshotsTestJSON-1977314237 None] Acquiring lock "cinder-quobyte-6606e93b-755c-4f12-ba68-dec1c72c6107" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:19:28 devstack cinder-volume[87248]: DEBUG cinder.coordination [req-b9f0bf6f-ee16-4b22-9df5-0cba74dfbeb5 req-86aaf21d-9f76-4b8a-ae35-7c20c5b23d15 tempest-VolumesSnapshotsTestJSON-1977314237 None] Lock "cinder-quobyte-6606e93b-755c-4f12-ba68-dec1c72c6107" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:19:28 devstack cinder-volume[87248]: DEBUG cinder.coordination [req-b9f0bf6f-ee16-4b22-9df5-0cba74dfbeb5 req-86aaf21d-9f76-4b8a-ae35-7c20c5b23d15 tempest-VolumesSnapshotsTestJSON-1977314237 None] Acquiring lock "cinder-quobyte-0eba6eca-5d43-4a63-8349-2dbf3f82f24c" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:19:28 devstack cinder-volume[87248]: DEBUG cinder.coordination [req-b9f0bf6f-ee16-4b22-9df5-0cba74dfbeb5 req-86aaf21d-9f76-4b8a-ae35-7c20c5b23d15 tempest-VolumesSnapshotsTestJSON-1977314237 None] Lock "cinder-quobyte-0eba6eca-5d43-4a63-8349-2dbf3f82f24c" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:19:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [req-b9f0bf6f-ee16-4b22-9df5-0cba74dfbeb5 req-86aaf21d-9f76-4b8a-ae35-7c20c5b23d15 tempest-VolumesSnapshotsTestJSON-1977314237 None] Deleting offline snapshot 0eba6eca-5d43-4a63-8349-2dbf3f82f24c of volume 6606e93b-755c-4f12-ba68-dec1c72c6107 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:19:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [req-b9f0bf6f-ee16-4b22-9df5-0cba74dfbeb5 req-86aaf21d-9f76-4b8a-ae35-7c20c5b23d15 tempest-VolumesSnapshotsTestJSON-1977314237 None] snapshot_file for this snap is: volume-6606e93b-755c-4f12-ba68-dec1c72c6107.0eba6eca-5d43-4a63-8349-2dbf3f82f24c {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:19:28 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d28e92-16d4-4f44-b28d-507c109e3838]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:19:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-b9f0bf6f-ee16-4b22-9df5-0cba74dfbeb5 req-86aaf21d-9f76-4b8a-ae35-7c20c5b23d15 tempest-VolumesSnapshotsTestJSON-1977314237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6606e93b-755c-4f12-ba68-dec1c72c6107.0eba6eca-5d43-4a63-8349-2dbf3f82f24c {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:19:28 devstack sudo[90346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6606e93b-755c-4f12-ba68-dec1c72c6107.0eba6eca-5d43-4a63-8349-2dbf3f82f24c Nov 03 20:19:28 devstack sudo[90346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:19:28 devstack cinder-volume[87248]: DEBUG oslo_service.periodic_task [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:19:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:19:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:19:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:19:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:19:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:19:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:19:28 devstack sudo[90377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:19:28 devstack sudo[90377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:19:28 devstack sudo[90346]: pam_unix(sudo:session): session closed for user root Nov 03 20:19:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-b9f0bf6f-ee16-4b22-9df5-0cba74dfbeb5 req-86aaf21d-9f76-4b8a-ae35-7c20c5b23d15 tempest-VolumesSnapshotsTestJSON-1977314237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6606e93b-755c-4f12-ba68-dec1c72c6107.0eba6eca-5d43-4a63-8349-2dbf3f82f24c" returned: 0 in 0.544s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:19:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [req-b9f0bf6f-ee16-4b22-9df5-0cba74dfbeb5 req-86aaf21d-9f76-4b8a-ae35-7c20c5b23d15 tempest-VolumesSnapshotsTestJSON-1977314237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6606e93b-755c-4f12-ba68-dec1c72c6107(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:19:29 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[25bc15b3-e90f-4285-b954-065a6dbc93d7]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:19:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-b9f0bf6f-ee16-4b22-9df5-0cba74dfbeb5 req-86aaf21d-9f76-4b8a-ae35-7c20c5b23d15 tempest-VolumesSnapshotsTestJSON-1977314237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6606e93b-755c-4f12-ba68-dec1c72c6107 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:19:29 devstack sudo[90377]: pam_unix(sudo:session): session closed for user root Nov 03 20:19:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.460s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:19:29 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:19:29 devstack cinder-volume[87248]: DEBUG oslo_service.periodic_task [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running periodic task VolumeManager._thread_info {{(pid=87248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:19:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] thread count: 8 {{(pid=87248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:19:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] thread info: [<_MainThread(MainThread, started 124862067372160)>, , , , , , , ] {{(pid=87248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:19:29 devstack sudo[90383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6606e93b-755c-4f12-ba68-dec1c72c6107 Nov 03 20:19:29 devstack sudo[90383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:19:29 devstack sudo[90383]: pam_unix(sudo:session): session closed for user root Nov 03 20:19:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-b9f0bf6f-ee16-4b22-9df5-0cba74dfbeb5 req-86aaf21d-9f76-4b8a-ae35-7c20c5b23d15 tempest-VolumesSnapshotsTestJSON-1977314237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6606e93b-755c-4f12-ba68-dec1c72c6107" returned: 0 in 0.546s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:19:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-b9f0bf6f-ee16-4b22-9df5-0cba74dfbeb5 req-86aaf21d-9f76-4b8a-ae35-7c20c5b23d15 tempest-VolumesSnapshotsTestJSON-1977314237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6606e93b-755c-4f12-ba68-dec1c72c6107.0eba6eca-5d43-4a63-8349-2dbf3f82f24c {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:19:29 devstack sudo[90389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6606e93b-755c-4f12-ba68-dec1c72c6107.0eba6eca-5d43-4a63-8349-2dbf3f82f24c Nov 03 20:19:29 devstack sudo[90389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:19:29 devstack sudo[90389]: pam_unix(sudo:session): session closed for user root Nov 03 20:19:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-b9f0bf6f-ee16-4b22-9df5-0cba74dfbeb5 req-86aaf21d-9f76-4b8a-ae35-7c20c5b23d15 tempest-VolumesSnapshotsTestJSON-1977314237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6606e93b-755c-4f12-ba68-dec1c72c6107.0eba6eca-5d43-4a63-8349-2dbf3f82f24c" returned: 0 in 0.395s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:19:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-b9f0bf6f-ee16-4b22-9df5-0cba74dfbeb5 req-86aaf21d-9f76-4b8a-ae35-7c20c5b23d15 tempest-VolumesSnapshotsTestJSON-1977314237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6606e93b-755c-4f12-ba68-dec1c72c6107.0eba6eca-5d43-4a63-8349-2dbf3f82f24c {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:19:30 devstack sudo[90395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6606e93b-755c-4f12-ba68-dec1c72c6107.0eba6eca-5d43-4a63-8349-2dbf3f82f24c Nov 03 20:19:30 devstack sudo[90395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:19:30 devstack sudo[90395]: pam_unix(sudo:session): session closed for user root Nov 03 20:19:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-b9f0bf6f-ee16-4b22-9df5-0cba74dfbeb5 req-86aaf21d-9f76-4b8a-ae35-7c20c5b23d15 tempest-VolumesSnapshotsTestJSON-1977314237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6606e93b-755c-4f12-ba68-dec1c72c6107.0eba6eca-5d43-4a63-8349-2dbf3f82f24c" returned: 0 in 0.314s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:19:30 devstack cinder-volume[87248]: DEBUG cinder.coordination [req-b9f0bf6f-ee16-4b22-9df5-0cba74dfbeb5 req-86aaf21d-9f76-4b8a-ae35-7c20c5b23d15 tempest-VolumesSnapshotsTestJSON-1977314237 None] Lock "cinder-quobyte-0eba6eca-5d43-4a63-8349-2dbf3f82f24c" released by "_delete_snapshot" :: held 1.970s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:19:30 devstack cinder-volume[87248]: DEBUG cinder.coordination [req-b9f0bf6f-ee16-4b22-9df5-0cba74dfbeb5 req-86aaf21d-9f76-4b8a-ae35-7c20c5b23d15 tempest-VolumesSnapshotsTestJSON-1977314237 None] Lock "cinder-quobyte-6606e93b-755c-4f12-ba68-dec1c72c6107" released by "delete_snapshot" :: held 2.017s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:19:30 devstack cinder-volume[87248]: WARNING cinder.quota [req-b9f0bf6f-ee16-4b22-9df5-0cba74dfbeb5 req-86aaf21d-9f76-4b8a-ae35-7c20c5b23d15 tempest-VolumesSnapshotsTestJSON-1977314237 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:19:30 devstack cinder-volume[87248]: DEBUG cinder.quota [req-b9f0bf6f-ee16-4b22-9df5-0cba74dfbeb5 req-86aaf21d-9f76-4b8a-ae35-7c20c5b23d15 tempest-VolumesSnapshotsTestJSON-1977314237 None] Created reservations ['80b54a0d-e37d-4db4-a575-a81dbde305d3', 'b8789a25-2098-4d66-8964-820b59d7e6a6', '15bffb46-1104-4cf8-9d01-5b66ca5ca8c1', 'de3ae583-27af-4fe3-9ee0-5df98053d499'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:19:30 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-b9f0bf6f-ee16-4b22-9df5-0cba74dfbeb5 req-86aaf21d-9f76-4b8a-ae35-7c20c5b23d15 tempest-VolumesSnapshotsTestJSON-1977314237 None] Delete snapshot completed successfully. Nov 03 20:19:30 devstack cinder-volume[87248]: DEBUG cinder.coordination [req-b9f0bf6f-ee16-4b22-9df5-0cba74dfbeb5 req-86aaf21d-9f76-4b8a-ae35-7c20c5b23d15 tempest-VolumesSnapshotsTestJSON-1977314237 None] Lock "cinder-0eba6eca-5d43-4a63-8349-2dbf3f82f24c-delete_snapshot" released by "delete_snapshot" :: held 2.202s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:19:30 devstack cinder-volume[87248]: DEBUG cinder.coordination [req-c03d438a-933e-4c1b-bb5f-f562826e01e3 req-f8843908-38a0-4ad9-a42a-fb6bf653ea04 tempest-VolumesSnapshotsTestJSON-1977314237 None] Acquiring lock "cinder-6606e93b-755c-4f12-ba68-dec1c72c6107-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:19:30 devstack cinder-volume[87248]: DEBUG cinder.coordination [req-c03d438a-933e-4c1b-bb5f-f562826e01e3 req-f8843908-38a0-4ad9-a42a-fb6bf653ea04 tempest-VolumesSnapshotsTestJSON-1977314237 None] Lock "cinder-6606e93b-755c-4f12-ba68-dec1c72c6107-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:19:30 devstack cinder-volume[87248]: DEBUG cinder.coordination [req-c03d438a-933e-4c1b-bb5f-f562826e01e3 req-f8843908-38a0-4ad9-a42a-fb6bf653ea04 tempest-VolumesSnapshotsTestJSON-1977314237 None] Acquiring lock "cinder-quobyte-6606e93b-755c-4f12-ba68-dec1c72c6107" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:19:30 devstack cinder-volume[87248]: DEBUG cinder.coordination [req-c03d438a-933e-4c1b-bb5f-f562826e01e3 req-f8843908-38a0-4ad9-a42a-fb6bf653ea04 tempest-VolumesSnapshotsTestJSON-1977314237 None] Lock "cinder-quobyte-6606e93b-755c-4f12-ba68-dec1c72c6107" acquired by "delete_volume" :: waited 0.030s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:19:30 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[487a2445-f03b-4b49-8488-c38d00b02ece]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:19:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-c03d438a-933e-4c1b-bb5f-f562826e01e3 req-f8843908-38a0-4ad9-a42a-fb6bf653ea04 tempest-VolumesSnapshotsTestJSON-1977314237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6606e93b-755c-4f12-ba68-dec1c72c6107 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:19:30 devstack sudo[90398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6606e93b-755c-4f12-ba68-dec1c72c6107 Nov 03 20:19:30 devstack sudo[90398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:19:31 devstack sudo[90398]: pam_unix(sudo:session): session closed for user root Nov 03 20:19:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-c03d438a-933e-4c1b-bb5f-f562826e01e3 req-f8843908-38a0-4ad9-a42a-fb6bf653ea04 tempest-VolumesSnapshotsTestJSON-1977314237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6606e93b-755c-4f12-ba68-dec1c72c6107" returned: 0 in 0.387s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:19:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-c03d438a-933e-4c1b-bb5f-f562826e01e3 req-f8843908-38a0-4ad9-a42a-fb6bf653ea04 tempest-VolumesSnapshotsTestJSON-1977314237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6606e93b-755c-4f12-ba68-dec1c72c6107 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:19:31 devstack sudo[90423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6606e93b-755c-4f12-ba68-dec1c72c6107 Nov 03 20:19:31 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:19:31 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root Nov 03 20:19:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-c03d438a-933e-4c1b-bb5f-f562826e01e3 req-f8843908-38a0-4ad9-a42a-fb6bf653ea04 tempest-VolumesSnapshotsTestJSON-1977314237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6606e93b-755c-4f12-ba68-dec1c72c6107" returned: 0 in 0.275s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:19:31 devstack cinder-volume[87248]: DEBUG cinder.coordination [req-c03d438a-933e-4c1b-bb5f-f562826e01e3 req-f8843908-38a0-4ad9-a42a-fb6bf653ea04 tempest-VolumesSnapshotsTestJSON-1977314237 None] Lock "cinder-quobyte-6606e93b-755c-4f12-ba68-dec1c72c6107" released by "delete_volume" :: held 0.753s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:19:31 devstack cinder-volume[87248]: DEBUG cinder.quota [req-c03d438a-933e-4c1b-bb5f-f562826e01e3 req-f8843908-38a0-4ad9-a42a-fb6bf653ea04 tempest-VolumesSnapshotsTestJSON-1977314237 None] Created reservations ['76070de4-4f1b-4d81-b998-1a362772d9ff', '08561263-3ec0-4b9d-8a34-7960ac0f1d83', '7a030d6f-9aff-4944-a480-e09041fbb9a8', 'adabd7ec-3733-474b-9b57-672f458e57ee'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:19:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-c03d438a-933e-4c1b-bb5f-f562826e01e3 req-f8843908-38a0-4ad9-a42a-fb6bf653ea04 tempest-VolumesSnapshotsTestJSON-1977314237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:19:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-c03d438a-933e-4c1b-bb5f-f562826e01e3 req-f8843908-38a0-4ad9-a42a-fb6bf653ea04 tempest-VolumesSnapshotsTestJSON-1977314237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:19:31 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [req-c03d438a-933e-4c1b-bb5f-f562826e01e3 req-f8843908-38a0-4ad9-a42a-fb6bf653ea04 tempest-VolumesSnapshotsTestJSON-1977314237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:19:31 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [req-c03d438a-933e-4c1b-bb5f-f562826e01e3 req-f8843908-38a0-4ad9-a42a-fb6bf653ea04 tempest-VolumesSnapshotsTestJSON-1977314237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:19:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-c03d438a-933e-4c1b-bb5f-f562826e01e3 req-f8843908-38a0-4ad9-a42a-fb6bf653ea04 tempest-VolumesSnapshotsTestJSON-1977314237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:19:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-c03d438a-933e-4c1b-bb5f-f562826e01e3 req-f8843908-38a0-4ad9-a42a-fb6bf653ea04 tempest-VolumesSnapshotsTestJSON-1977314237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:19:31 devstack sudo[90426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:19:31 devstack sudo[90426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:19:31 devstack sudo[90426]: pam_unix(sudo:session): session closed for user root Nov 03 20:19:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-c03d438a-933e-4c1b-bb5f-f562826e01e3 req-f8843908-38a0-4ad9-a42a-fb6bf653ea04 tempest-VolumesSnapshotsTestJSON-1977314237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.272s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:19:31 devstack cinder-volume[87248]: DEBUG cinder.manager [req-c03d438a-933e-4c1b-bb5f-f562826e01e3 req-f8843908-38a0-4ad9-a42a-fb6bf653ea04 tempest-VolumesSnapshotsTestJSON-1977314237 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:19:31 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-c03d438a-933e-4c1b-bb5f-f562826e01e3 req-f8843908-38a0-4ad9-a42a-fb6bf653ea04 tempest-VolumesSnapshotsTestJSON-1977314237 None] Deleted volume successfully. Nov 03 20:19:31 devstack cinder-volume[87248]: DEBUG cinder.coordination [req-c03d438a-933e-4c1b-bb5f-f562826e01e3 req-f8843908-38a0-4ad9-a42a-fb6bf653ea04 tempest-VolumesSnapshotsTestJSON-1977314237 None] Lock "cinder-6606e93b-755c-4f12-ba68-dec1c72c6107-delete_volume" released by "delete_volume" :: held 1.278s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:19:36 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-df678e29-e3cb-40d2-9e70-fd3f5a0061aa tempest-GroupSnapshotsTest-1925086750 None] Group tempest-GroupSnapshotsTest-Group-392692700: creating Nov 03 20:19:36 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-df678e29-e3cb-40d2-9e70-fd3f5a0061aa tempest-GroupSnapshotsTest-1925086750 None] Group tempest-GroupSnapshotsTest-Group-392692700: created successfully Nov 03 20:19:36 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-df678e29-e3cb-40d2-9e70-fd3f5a0061aa tempest-GroupSnapshotsTest-1925086750 None] Create group completed successfully. Nov 03 20:19:38 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-49566f98-c0f6-45c2-8644-2bf28d837347 tempest-GroupSnapshotsTest-1925086750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:19:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-49566f98-c0f6-45c2-8644-2bf28d837347 tempest-GroupSnapshotsTest-1925086750 None] Flow 'volume_create_manager' (ea27bea0-32f3-4d7c-9a5a-bc2e20de9350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:19:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-49566f98-c0f6-45c2-8644-2bf28d837347 tempest-GroupSnapshotsTest-1925086750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d469bb84-eca0-4bfa-beec-f853884a3474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:19:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-49566f98-c0f6-45c2-8644-2bf28d837347 tempest-GroupSnapshotsTest-1925086750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d469bb84-eca0-4bfa-beec-f853884a3474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1130880080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ae2a50fc-ebf5-46b2-a952-497e1b6fa90b,host='devstack@QuobyteHD#QuobyteHD',id=b83c2bea-af62-482f-bfbf-34ec8ee610b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a68281e50ae47cc9a5c3102575b7e5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:19:38Z,use_quota=True,user_id='1d7ddeb6e0cb4deb8439a99c9d3fe6bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be3c4409-1c4d-4a8f-a00b-54efb2c16599),volume_type_id=be3c4409-1c4d-4a8f-a00b-54efb2c16599)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:19:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-49566f98-c0f6-45c2-8644-2bf28d837347 tempest-GroupSnapshotsTest-1925086750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7f73597-02be-466b-83fc-a88d992a1bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:19:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-49566f98-c0f6-45c2-8644-2bf28d837347 tempest-GroupSnapshotsTest-1925086750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7f73597-02be-466b-83fc-a88d992a1bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:19:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-49566f98-c0f6-45c2-8644-2bf28d837347 tempest-GroupSnapshotsTest-1925086750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5911006-f9f2-418c-8958-8ec5ffba4446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:19:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-49566f98-c0f6-45c2-8644-2bf28d837347 tempest-GroupSnapshotsTest-1925086750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5911006-f9f2-418c-8958-8ec5ffba4446) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b83c2bea-af62-482f-bfbf-34ec8ee610b5', 'volume_name': 'volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:19:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-49566f98-c0f6-45c2-8644-2bf28d837347 tempest-GroupSnapshotsTest-1925086750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faff1ef5-c8de-4fa2-9491-98dfddea516e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:19:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-49566f98-c0f6-45c2-8644-2bf28d837347 tempest-GroupSnapshotsTest-1925086750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faff1ef5-c8de-4fa2-9491-98dfddea516e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:19:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-49566f98-c0f6-45c2-8644-2bf28d837347 tempest-GroupSnapshotsTest-1925086750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6beab8b1-8ec3-46d4-be03-24c43803035c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:19:38 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-49566f98-c0f6-45c2-8644-2bf28d837347 tempest-GroupSnapshotsTest-1925086750 None] Volume b83c2bea-af62-482f-bfbf-34ec8ee610b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5', 'volume_size': 1} Nov 03 20:19:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-49566f98-c0f6-45c2-8644-2bf28d837347 tempest-GroupSnapshotsTest-1925086750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:19:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-49566f98-c0f6-45c2-8644-2bf28d837347 tempest-GroupSnapshotsTest-1925086750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:19:38 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-49566f98-c0f6-45c2-8644-2bf28d837347 tempest-GroupSnapshotsTest-1925086750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ae2a50fc-ebf5-46b2-a952-497e1b6fa90b,created_at=2026-11-03T19:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1130880080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ae2a50fc-ebf5-46b2-a952-497e1b6fa90b,host='devstack@QuobyteHD#QuobyteHD',id=b83c2bea-af62-482f-bfbf-34ec8ee610b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a68281e50ae47cc9a5c3102575b7e5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:19:38Z,use_quota=True,user_id='1d7ddeb6e0cb4deb8439a99c9d3fe6bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be3c4409-1c4d-4a8f-a00b-54efb2c16599),volume_type_id=be3c4409-1c4d-4a8f-a00b-54efb2c16599)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:19:38 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-49566f98-c0f6-45c2-8644-2bf28d837347 tempest-GroupSnapshotsTest-1925086750 None] Creating volume b83c2bea-af62-482f-bfbf-34ec8ee610b5 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:19:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-49566f98-c0f6-45c2-8644-2bf28d837347 tempest-GroupSnapshotsTest-1925086750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:19:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-49566f98-c0f6-45c2-8644-2bf28d837347 tempest-GroupSnapshotsTest-1925086750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:19:38 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-49566f98-c0f6-45c2-8644-2bf28d837347 tempest-GroupSnapshotsTest-1925086750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:19:38 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-49566f98-c0f6-45c2-8644-2bf28d837347 tempest-GroupSnapshotsTest-1925086750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:19:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-49566f98-c0f6-45c2-8644-2bf28d837347 tempest-GroupSnapshotsTest-1925086750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:19:38 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-49566f98-c0f6-45c2-8644-2bf28d837347 tempest-GroupSnapshotsTest-1925086750 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:19:38 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-49566f98-c0f6-45c2-8644-2bf28d837347 tempest-GroupSnapshotsTest-1925086750 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:19:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-49566f98-c0f6-45c2-8644-2bf28d837347 tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:19:38 devstack sudo[90429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5 1073741824 Nov 03 20:19:38 devstack sudo[90429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:19:39 devstack sudo[90429]: pam_unix(sudo:session): session closed for user root Nov 03 20:19:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-49566f98-c0f6-45c2-8644-2bf28d837347 tempest-GroupSnapshotsTest-1925086750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5 1073741824" returned: 0 in 0.543s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:19:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-49566f98-c0f6-45c2-8644-2bf28d837347 tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:19:39 devstack sudo[90437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5 Nov 03 20:19:39 devstack sudo[90437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:19:39 devstack sudo[90437]: pam_unix(sudo:session): session closed for user root Nov 03 20:19:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-49566f98-c0f6-45c2-8644-2bf28d837347 tempest-GroupSnapshotsTest-1925086750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5" returned: 0 in 0.335s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:19:39 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-49566f98-c0f6-45c2-8644-2bf28d837347 tempest-GroupSnapshotsTest-1925086750 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:19:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-49566f98-c0f6-45c2-8644-2bf28d837347 tempest-GroupSnapshotsTest-1925086750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:19:39 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-49566f98-c0f6-45c2-8644-2bf28d837347 tempest-GroupSnapshotsTest-1925086750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6beab8b1-8ec3-46d4-be03-24c43803035c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:19:39 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-49566f98-c0f6-45c2-8644-2bf28d837347 tempest-GroupSnapshotsTest-1925086750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4df9e20b-8b34-4a84-a2d0-5dd48de2df28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:19:39 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-49566f98-c0f6-45c2-8644-2bf28d837347 tempest-GroupSnapshotsTest-1925086750 None] Volume volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5 (b83c2bea-af62-482f-bfbf-34ec8ee610b5): created successfully Nov 03 20:19:39 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-49566f98-c0f6-45c2-8644-2bf28d837347 tempest-GroupSnapshotsTest-1925086750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4df9e20b-8b34-4a84-a2d0-5dd48de2df28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:19:39 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-49566f98-c0f6-45c2-8644-2bf28d837347 tempest-GroupSnapshotsTest-1925086750 None] Flow 'volume_create_manager' (ea27bea0-32f3-4d7c-9a5a-bc2e20de9350) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:19:39 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-49566f98-c0f6-45c2-8644-2bf28d837347 tempest-GroupSnapshotsTest-1925086750 None] Created volume successfully. Nov 03 20:19:39 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbee92ae-c665-48b1-a876-95ae522418b8 tempest-AttachVolumeShelveTestJSON-1678871204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:19:39 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cbee92ae-c665-48b1-a876-95ae522418b8 tempest-AttachVolumeShelveTestJSON-1678871204 None] Flow 'volume_create_manager' (b9beb310-8168-43f5-8ca3-c402a79c9b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:19:39 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cbee92ae-c665-48b1-a876-95ae522418b8 tempest-AttachVolumeShelveTestJSON-1678871204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e44b653-e282-49c4-b5d0-1ce429ca1122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:19:39 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cbee92ae-c665-48b1-a876-95ae522418b8 tempest-AttachVolumeShelveTestJSON-1678871204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e44b653-e282-49c4-b5d0-1ce429ca1122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:19:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-892357379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53fc7140-2a34-4bfd-8340-e41c56cae298,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0577c40c49ce4d77b708888bcb6e456d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:19:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:19:40Z,use_quota=True,user_id='688814e7dcd8459b8e27695774c29a0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:19:39 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cbee92ae-c665-48b1-a876-95ae522418b8 tempest-AttachVolumeShelveTestJSON-1678871204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5944eae-1e1d-44a2-b47e-9306a8be44b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:19:39 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cbee92ae-c665-48b1-a876-95ae522418b8 tempest-AttachVolumeShelveTestJSON-1678871204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5944eae-1e1d-44a2-b47e-9306a8be44b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:19:39 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cbee92ae-c665-48b1-a876-95ae522418b8 tempest-AttachVolumeShelveTestJSON-1678871204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c06d5f-3057-4b4a-aecf-fcbecd18392a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:19:39 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cbee92ae-c665-48b1-a876-95ae522418b8 tempest-AttachVolumeShelveTestJSON-1678871204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c06d5f-3057-4b4a-aecf-fcbecd18392a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53fc7140-2a34-4bfd-8340-e41c56cae298', 'volume_name': 'volume-53fc7140-2a34-4bfd-8340-e41c56cae298', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:19:39 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cbee92ae-c665-48b1-a876-95ae522418b8 tempest-AttachVolumeShelveTestJSON-1678871204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (213f68f9-2816-41c2-8f29-ac7c03dc2f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:19:39 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cbee92ae-c665-48b1-a876-95ae522418b8 tempest-AttachVolumeShelveTestJSON-1678871204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (213f68f9-2816-41c2-8f29-ac7c03dc2f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:19:39 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cbee92ae-c665-48b1-a876-95ae522418b8 tempest-AttachVolumeShelveTestJSON-1678871204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8585582-9c69-49b9-85a4-7244cb276f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:19:39 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-cbee92ae-c665-48b1-a876-95ae522418b8 tempest-AttachVolumeShelveTestJSON-1678871204 None] Volume 53fc7140-2a34-4bfd-8340-e41c56cae298: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53fc7140-2a34-4bfd-8340-e41c56cae298', 'volume_size': 1} Nov 03 20:19:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-cbee92ae-c665-48b1-a876-95ae522418b8 tempest-AttachVolumeShelveTestJSON-1678871204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:19:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-cbee92ae-c665-48b1-a876-95ae522418b8 tempest-AttachVolumeShelveTestJSON-1678871204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:19:39 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-cbee92ae-c665-48b1-a876-95ae522418b8 tempest-AttachVolumeShelveTestJSON-1678871204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:19:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-892357379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53fc7140-2a34-4bfd-8340-e41c56cae298,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0577c40c49ce4d77b708888bcb6e456d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:19:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:19:40Z,use_quota=True,user_id='688814e7dcd8459b8e27695774c29a0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:19:39 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-cbee92ae-c665-48b1-a876-95ae522418b8 tempest-AttachVolumeShelveTestJSON-1678871204 None] Creating volume 53fc7140-2a34-4bfd-8340-e41c56cae298 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:19:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-cbee92ae-c665-48b1-a876-95ae522418b8 tempest-AttachVolumeShelveTestJSON-1678871204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:19:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-cbee92ae-c665-48b1-a876-95ae522418b8 tempest-AttachVolumeShelveTestJSON-1678871204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:19:39 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-cbee92ae-c665-48b1-a876-95ae522418b8 tempest-AttachVolumeShelveTestJSON-1678871204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:19:39 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-cbee92ae-c665-48b1-a876-95ae522418b8 tempest-AttachVolumeShelveTestJSON-1678871204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:19:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-cbee92ae-c665-48b1-a876-95ae522418b8 tempest-AttachVolumeShelveTestJSON-1678871204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:19:39 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-cbee92ae-c665-48b1-a876-95ae522418b8 tempest-AttachVolumeShelveTestJSON-1678871204 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:19:39 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-cbee92ae-c665-48b1-a876-95ae522418b8 tempest-AttachVolumeShelveTestJSON-1678871204 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:19:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cbee92ae-c665-48b1-a876-95ae522418b8 tempest-AttachVolumeShelveTestJSON-1678871204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-53fc7140-2a34-4bfd-8340-e41c56cae298 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:19:39 devstack sudo[90440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-53fc7140-2a34-4bfd-8340-e41c56cae298 1073741824 Nov 03 20:19:39 devstack sudo[90440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:19:40 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-146acb8b-1dc2-4075-88c8-99ea15eb19c3 tempest-GroupSnapshotsTest-1925086750 None] GroupSnapshot 318b68d7-911f-427a-bfdd-9ce1e0a1b90d: creating. Nov 03 20:19:40 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-146acb8b-1dc2-4075-88c8-99ea15eb19c3 tempest-GroupSnapshotsTest-1925086750 None] Group snapshot 318b68d7-911f-427a-bfdd-9ce1e0a1b90d: creating. {{(pid=87248) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 20:19:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-146acb8b-1dc2-4075-88c8-99ea15eb19c3 tempest-GroupSnapshotsTest-1925086750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:19:40 devstack sudo[90440]: pam_unix(sudo:session): session closed for user root Nov 03 20:19:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cbee92ae-c665-48b1-a876-95ae522418b8 tempest-AttachVolumeShelveTestJSON-1678871204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-53fc7140-2a34-4bfd-8340-e41c56cae298 1073741824" returned: 0 in 0.487s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:19:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cbee92ae-c665-48b1-a876-95ae522418b8 tempest-AttachVolumeShelveTestJSON-1678871204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-53fc7140-2a34-4bfd-8340-e41c56cae298 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:19:40 devstack sudo[90446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-53fc7140-2a34-4bfd-8340-e41c56cae298 Nov 03 20:19:40 devstack sudo[90446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:19:40 devstack sudo[90446]: pam_unix(sudo:session): session closed for user root Nov 03 20:19:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cbee92ae-c665-48b1-a876-95ae522418b8 tempest-AttachVolumeShelveTestJSON-1678871204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-53fc7140-2a34-4bfd-8340-e41c56cae298" returned: 0 in 0.338s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:19:40 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-cbee92ae-c665-48b1-a876-95ae522418b8 tempest-AttachVolumeShelveTestJSON-1678871204 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:19:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-cbee92ae-c665-48b1-a876-95ae522418b8 tempest-AttachVolumeShelveTestJSON-1678871204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:19:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-146acb8b-1dc2-4075-88c8-99ea15eb19c3 tempest-GroupSnapshotsTest-1925086750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.558s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:19:40 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cbee92ae-c665-48b1-a876-95ae522418b8 tempest-AttachVolumeShelveTestJSON-1678871204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8585582-9c69-49b9-85a4-7244cb276f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53fc7140-2a34-4bfd-8340-e41c56cae298', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:19:40 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cbee92ae-c665-48b1-a876-95ae522418b8 tempest-AttachVolumeShelveTestJSON-1678871204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f523ea15-5a79-4fd4-9a03-c037e657eb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:19:40 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-cbee92ae-c665-48b1-a876-95ae522418b8 tempest-AttachVolumeShelveTestJSON-1678871204 None] Volume volume-53fc7140-2a34-4bfd-8340-e41c56cae298 (53fc7140-2a34-4bfd-8340-e41c56cae298): created successfully Nov 03 20:19:40 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cbee92ae-c665-48b1-a876-95ae522418b8 tempest-AttachVolumeShelveTestJSON-1678871204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f523ea15-5a79-4fd4-9a03-c037e657eb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:19:40 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cbee92ae-c665-48b1-a876-95ae522418b8 tempest-AttachVolumeShelveTestJSON-1678871204 None] Flow 'volume_create_manager' (b9beb310-8168-43f5-8ca3-c402a79c9b11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:19:40 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-146acb8b-1dc2-4075-88c8-99ea15eb19c3 tempest-GroupSnapshotsTest-1925086750 None] Creating offline snapshot df860100-659e-4eb2-b2cc-66885501dcca of volume b83c2bea-af62-482f-bfbf-34ec8ee610b5 {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:19:40 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-cbee92ae-c665-48b1-a876-95ae522418b8 tempest-AttachVolumeShelveTestJSON-1678871204 None] Created volume successfully. Nov 03 20:19:40 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cba3a0d-85c8-489a-ba48-6e88491fcd59]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:19:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-146acb8b-1dc2-4075-88c8-99ea15eb19c3 tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:19:41 devstack sudo[90451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5 Nov 03 20:19:41 devstack sudo[90451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:19:41 devstack sudo[90451]: pam_unix(sudo:session): session closed for user root Nov 03 20:19:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-146acb8b-1dc2-4075-88c8-99ea15eb19c3 tempest-GroupSnapshotsTest-1925086750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5" returned: 0 in 0.420s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:19:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-146acb8b-1dc2-4075-88c8-99ea15eb19c3 tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5.df860100-659e-4eb2-b2cc-66885501dcca 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:19:41 devstack sudo[90457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5.df860100-659e-4eb2-b2cc-66885501dcca 1G Nov 03 20:19:41 devstack sudo[90457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:19:41 devstack sudo[90457]: pam_unix(sudo:session): session closed for user root Nov 03 20:19:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-146acb8b-1dc2-4075-88c8-99ea15eb19c3 tempest-GroupSnapshotsTest-1925086750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5.df860100-659e-4eb2-b2cc-66885501dcca 1G" returned: 0 in 0.459s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:19:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-146acb8b-1dc2-4075-88c8-99ea15eb19c3 tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5.df860100-659e-4eb2-b2cc-66885501dcca {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:19:41 devstack sudo[90467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5.df860100-659e-4eb2-b2cc-66885501dcca Nov 03 20:19:41 devstack sudo[90467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:19:42 devstack sudo[90467]: pam_unix(sudo:session): session closed for user root Nov 03 20:19:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-146acb8b-1dc2-4075-88c8-99ea15eb19c3 tempest-GroupSnapshotsTest-1925086750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5.df860100-659e-4eb2-b2cc-66885501dcca" returned: 0 in 0.318s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:19:42 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-146acb8b-1dc2-4075-88c8-99ea15eb19c3 tempest-GroupSnapshotsTest-1925086750 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5.df860100-659e-4eb2-b2cc-66885501dcca is being set with open permissions: ugo+rw: NotImplementedError Nov 03 20:19:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-146acb8b-1dc2-4075-88c8-99ea15eb19c3 tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5.df860100-659e-4eb2-b2cc-66885501dcca {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:19:42 devstack sudo[90472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5.df860100-659e-4eb2-b2cc-66885501dcca Nov 03 20:19:42 devstack sudo[90472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:19:42 devstack sudo[90472]: pam_unix(sudo:session): session closed for user root Nov 03 20:19:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-146acb8b-1dc2-4075-88c8-99ea15eb19c3 tempest-GroupSnapshotsTest-1925086750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5.df860100-659e-4eb2-b2cc-66885501dcca" returned: 0 in 0.264s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:19:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-146acb8b-1dc2-4075-88c8-99ea15eb19c3 tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:19:42 devstack sudo[90475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5.info Nov 03 20:19:42 devstack sudo[90475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:19:42 devstack sudo[90475]: pam_unix(sudo:session): session closed for user root Nov 03 20:19:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-146acb8b-1dc2-4075-88c8-99ea15eb19c3 tempest-GroupSnapshotsTest-1925086750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5.info" returned: 0 in 0.275s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:19:42 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-146acb8b-1dc2-4075-88c8-99ea15eb19c3 tempest-GroupSnapshotsTest-1925086750 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 20:19:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-146acb8b-1dc2-4075-88c8-99ea15eb19c3 tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:19:42 devstack sudo[90478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5.info Nov 03 20:19:42 devstack sudo[90478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:19:43 devstack sudo[90478]: pam_unix(sudo:session): session closed for user root Nov 03 20:19:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-146acb8b-1dc2-4075-88c8-99ea15eb19c3 tempest-GroupSnapshotsTest-1925086750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5.info" returned: 0 in 0.315s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:19:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-146acb8b-1dc2-4075-88c8-99ea15eb19c3 tempest-GroupSnapshotsTest-1925086750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.282s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:19:43 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-146acb8b-1dc2-4075-88c8-99ea15eb19c3 tempest-GroupSnapshotsTest-1925086750 None] group_snapshot 318b68d7-911f-427a-bfdd-9ce1e0a1b90d: created successfully Nov 03 20:19:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c0cb7f52-aae6-4e7e-83f3-bc42c9950b4f tempest-GroupSnapshotsTest-1925086750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:19:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c0cb7f52-aae6-4e7e-83f3-bc42c9950b4f tempest-GroupSnapshotsTest-1925086750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:19:45 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c0cb7f52-aae6-4e7e-83f3-bc42c9950b4f tempest-GroupSnapshotsTest-1925086750 None] Acquiring lock "cinder-quobyte-df860100-659e-4eb2-b2cc-66885501dcca-e788a9fe-103a-4509-8db1-9d6bb331738a" by "_create_volume_from_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:19:45 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c0cb7f52-aae6-4e7e-83f3-bc42c9950b4f tempest-GroupSnapshotsTest-1925086750 None] Lock "cinder-quobyte-df860100-659e-4eb2-b2cc-66885501dcca-e788a9fe-103a-4509-8db1-9d6bb331738a" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:19:45 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c0cb7f52-aae6-4e7e-83f3-bc42c9950b4f tempest-GroupSnapshotsTest-1925086750 None] Creating volume e788a9fe-103a-4509-8db1-9d6bb331738a from snapshot df860100-659e-4eb2-b2cc-66885501dcca {{(pid=87248) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 20:19:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c0cb7f52-aae6-4e7e-83f3-bc42c9950b4f tempest-GroupSnapshotsTest-1925086750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:19:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c0cb7f52-aae6-4e7e-83f3-bc42c9950b4f tempest-GroupSnapshotsTest-1925086750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:19:45 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c0cb7f52-aae6-4e7e-83f3-bc42c9950b4f tempest-GroupSnapshotsTest-1925086750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:19:45 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c0cb7f52-aae6-4e7e-83f3-bc42c9950b4f tempest-GroupSnapshotsTest-1925086750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:19:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c0cb7f52-aae6-4e7e-83f3-bc42c9950b4f tempest-GroupSnapshotsTest-1925086750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:19:45 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c0cb7f52-aae6-4e7e-83f3-bc42c9950b4f tempest-GroupSnapshotsTest-1925086750 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:19:45 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c0cb7f52-aae6-4e7e-83f3-bc42c9950b4f tempest-GroupSnapshotsTest-1925086750 None] Acquiring lock "cinder-quobyte-e788a9fe-103a-4509-8db1-9d6bb331738a" by "_copy_volume_from_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:19:45 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c0cb7f52-aae6-4e7e-83f3-bc42c9950b4f tempest-GroupSnapshotsTest-1925086750 None] Lock "cinder-quobyte-e788a9fe-103a-4509-8db1-9d6bb331738a" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:19:45 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c0cb7f52-aae6-4e7e-83f3-bc42c9950b4f tempest-GroupSnapshotsTest-1925086750 None] snapshot: df860100-659e-4eb2-b2cc-66885501dcca, volume: e788a9fe-103a-4509-8db1-9d6bb331738a, {{(pid=87248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 20:19:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c0cb7f52-aae6-4e7e-83f3-bc42c9950b4f tempest-GroupSnapshotsTest-1925086750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:19:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c0cb7f52-aae6-4e7e-83f3-bc42c9950b4f tempest-GroupSnapshotsTest-1925086750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:19:45 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c0cb7f52-aae6-4e7e-83f3-bc42c9950b4f tempest-GroupSnapshotsTest-1925086750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:19:45 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c0cb7f52-aae6-4e7e-83f3-bc42c9950b4f tempest-GroupSnapshotsTest-1925086750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:19:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c0cb7f52-aae6-4e7e-83f3-bc42c9950b4f tempest-GroupSnapshotsTest-1925086750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:19:45 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[df16b159-10d0-4f0b-906d-56a27bf6da52]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:19:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c0cb7f52-aae6-4e7e-83f3-bc42c9950b4f tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5.df860100-659e-4eb2-b2cc-66885501dcca {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:19:45 devstack sudo[90519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5.df860100-659e-4eb2-b2cc-66885501dcca Nov 03 20:19:45 devstack sudo[90519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:19:46 devstack sudo[90519]: pam_unix(sudo:session): session closed for user root Nov 03 20:19:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c0cb7f52-aae6-4e7e-83f3-bc42c9950b4f tempest-GroupSnapshotsTest-1925086750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5.df860100-659e-4eb2-b2cc-66885501dcca" returned: 0 in 0.789s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:19:46 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-c0cb7f52-aae6-4e7e-83f3-bc42c9950b4f tempest-GroupSnapshotsTest-1925086750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:19:46 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed8e369-51e2-4ff7-820a-aaac00ae3ddf]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:19:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c0cb7f52-aae6-4e7e-83f3-bc42c9950b4f tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:19:46 devstack sudo[90542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5 Nov 03 20:19:46 devstack sudo[90542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:19:46 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:SELECT=55,cinder:INSERT=11,cinder:UPDATE=49,cinder:DELETE=3 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:19:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-016c7303-9d8e-4a3a-9830-ed30db4d022f req-86103337-af0e-49e5-b7bc-635ee199f8f6 tempest-ServerActionsTestOtherA-836700016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:19:47 devstack sudo[90542]: pam_unix(sudo:session): session closed for user root Nov 03 20:19:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c0cb7f52-aae6-4e7e-83f3-bc42c9950b4f tempest-GroupSnapshotsTest-1925086750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5" returned: 0 in 0.651s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:19:47 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c0cb7f52-aae6-4e7e-83f3-bc42c9950b4f tempest-GroupSnapshotsTest-1925086750 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5 {{(pid=87248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 20:19:47 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c0cb7f52-aae6-4e7e-83f3-bc42c9950b4f tempest-GroupSnapshotsTest-1925086750 None] Creating direct copy from snapshot {{(pid=87248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 20:19:47 devstack cinder-volume[87248]: DEBUG cinder.utils [None req-c0cb7f52-aae6-4e7e-83f3-bc42c9950b4f tempest-GroupSnapshotsTest-1925086750 None] Path /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e788a9fe-103a-4509-8db1-9d6bb331738a not found in is_blk_device check {{(pid=87248) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 20:19:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c0cb7f52-aae6-4e7e-83f3-bc42c9950b4f tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e788a9fe-103a-4509-8db1-9d6bb331738a {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:19:47 devstack sudo[90551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e788a9fe-103a-4509-8db1-9d6bb331738a Nov 03 20:19:47 devstack sudo[90551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:19:56 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:SELECT=50,cinder:UPDATE=52,cinder:INSERT=12,cinder:DELETE=6 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:20:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c0cb7f52-aae6-4e7e-83f3-bc42c9950b4f tempest-GroupSnapshotsTest-1925086750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e788a9fe-103a-4509-8db1-9d6bb331738a" returned: 0 in 15.346s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:02 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-c0cb7f52-aae6-4e7e-83f3-bc42c9950b4f tempest-GroupSnapshotsTest-1925086750 None] Image conversion details: src /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5, size 1024.00 MB, duration 15.35 sec, destination /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e788a9fe-103a-4509-8db1-9d6bb331738a {{(pid=87248) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:20:02 devstack cinder-volume[87248]: INFO cinder.image.image_utils [None req-c0cb7f52-aae6-4e7e-83f3-bc42c9950b4f tempest-GroupSnapshotsTest-1925086750 None] Converted 1024.00 MB image at 66.72 MB/s Nov 03 20:20:02 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-c0cb7f52-aae6-4e7e-83f3-bc42c9950b4f tempest-GroupSnapshotsTest-1925086750 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e788a9fe-103a-4509-8db1-9d6bb331738a is being set with open permissions: ugo+rw: NotImplementedError Nov 03 20:20:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c0cb7f52-aae6-4e7e-83f3-bc42c9950b4f tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e788a9fe-103a-4509-8db1-9d6bb331738a {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:02 devstack sudo[90794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e788a9fe-103a-4509-8db1-9d6bb331738a Nov 03 20:20:02 devstack sudo[90794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:02 devstack sudo[90794]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c0cb7f52-aae6-4e7e-83f3-bc42c9950b4f tempest-GroupSnapshotsTest-1925086750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e788a9fe-103a-4509-8db1-9d6bb331738a" returned: 0 in 0.452s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:02 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c0cb7f52-aae6-4e7e-83f3-bc42c9950b4f tempest-GroupSnapshotsTest-1925086750 None] Lock "cinder-quobyte-e788a9fe-103a-4509-8db1-9d6bb331738a" released by "_copy_volume_from_snapshot" :: held 17.395s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:20:03 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c0cb7f52-aae6-4e7e-83f3-bc42c9950b4f tempest-GroupSnapshotsTest-1925086750 None] Lock "cinder-quobyte-df860100-659e-4eb2-b2cc-66885501dcca-e788a9fe-103a-4509-8db1-9d6bb331738a" released by "_create_volume_from_snapshot" :: held 17.550s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:20:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c0cb7f52-aae6-4e7e-83f3-bc42c9950b4f tempest-GroupSnapshotsTest-1925086750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 17.577s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:20:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-016c7303-9d8e-4a3a-9830-ed30db4d022f req-86103337-af0e-49e5-b7bc-635ee199f8f6 tempest-ServerActionsTestOtherA-836700016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 16.148s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:20:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-016c7303-9d8e-4a3a-9830-ed30db4d022f req-86103337-af0e-49e5-b7bc-635ee199f8f6 tempest-ServerActionsTestOtherA-836700016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.045s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:20:03 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-016c7303-9d8e-4a3a-9830-ed30db4d022f req-86103337-af0e-49e5-b7bc-635ee199f8f6 tempest-ServerActionsTestOtherA-836700016 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8', 'name': 'volume-5061afd4-d0a0-4715-809b-d47a7c2b83e4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '09581add-6edc-4837-8d93-c35b20f1d0da', 'enforce_multipath': True} {{(pid=87248) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 20:20:03 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-c0cb7f52-aae6-4e7e-83f3-bc42c9950b4f tempest-GroupSnapshotsTest-1925086750 None] Create group from source-snapshot-318b68d7-911f-427a-bfdd-9ce1e0a1b90d completed successfully. Nov 03 20:20:03 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-016c7303-9d8e-4a3a-9830-ed30db4d022f req-86103337-af0e-49e5-b7bc-635ee199f8f6 tempest-ServerActionsTestOtherA-836700016 None] attachment_update completed successfully. Nov 03 20:20:04 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-2f7dd110-76c5-4776-b003-5f39e39a5491 req-40e897ff-e303-470a-93e5-d3d7546d0bdb tempest-AttachVolumeShelveTestJSON-1678871204 None] No connector for attachment 68559ab4-75e2-4f09-807d-f4ab6c89c4a5; skipping storage backend terminate_connection call. {{(pid=87248) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Nov 03 20:20:04 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-2f7dd110-76c5-4776-b003-5f39e39a5491 req-40e897ff-e303-470a-93e5-d3d7546d0bdb tempest-AttachVolumeShelveTestJSON-1678871204 None] Deleting attachment 68559ab4-75e2-4f09-807d-f4ab6c89c4a5. {{(pid=87248) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 20:20:05 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9b657bf9-c92b-414c-8374-98da4a6e1482 tempest-GroupSnapshotsTest-1925086750 None] Acquiring lock "cinder-quobyte-e788a9fe-103a-4509-8db1-9d6bb331738a" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:20:05 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9b657bf9-c92b-414c-8374-98da4a6e1482 tempest-GroupSnapshotsTest-1925086750 None] Lock "cinder-quobyte-e788a9fe-103a-4509-8db1-9d6bb331738a" acquired by "delete_volume" :: waited 0.037s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:20:05 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c76b514-ba36-4f35-bb48-003c60ebc773]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:20:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9b657bf9-c92b-414c-8374-98da4a6e1482 tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e788a9fe-103a-4509-8db1-9d6bb331738a {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:05 devstack sudo[91214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e788a9fe-103a-4509-8db1-9d6bb331738a Nov 03 20:20:05 devstack sudo[91214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:05 devstack sudo[91214]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9b657bf9-c92b-414c-8374-98da4a6e1482 tempest-GroupSnapshotsTest-1925086750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e788a9fe-103a-4509-8db1-9d6bb331738a" returned: 0 in 0.592s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9b657bf9-c92b-414c-8374-98da4a6e1482 tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e788a9fe-103a-4509-8db1-9d6bb331738a {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:05 devstack sudo[91230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e788a9fe-103a-4509-8db1-9d6bb331738a Nov 03 20:20:05 devstack sudo[91230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:06 devstack sudo[91230]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9b657bf9-c92b-414c-8374-98da4a6e1482 tempest-GroupSnapshotsTest-1925086750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e788a9fe-103a-4509-8db1-9d6bb331738a" returned: 0 in 0.403s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:06 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9b657bf9-c92b-414c-8374-98da4a6e1482 tempest-GroupSnapshotsTest-1925086750 None] Lock "cinder-quobyte-e788a9fe-103a-4509-8db1-9d6bb331738a" released by "delete_volume" :: held 1.119s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:20:06 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-9b657bf9-c92b-414c-8374-98da4a6e1482 tempest-GroupSnapshotsTest-1925086750 None] Created reservations ['b0142027-ed37-458c-a423-1b84bad9e343'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:20:06 devstack cinder-volume[87248]: WARNING cinder.quota [None req-9b657bf9-c92b-414c-8374-98da4a6e1482 tempest-GroupSnapshotsTest-1925086750 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1398178575 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1398178575, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:20:06 devstack cinder-volume[87248]: WARNING cinder.quota [None req-9b657bf9-c92b-414c-8374-98da4a6e1482 tempest-GroupSnapshotsTest-1925086750 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1398178575 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1398178575, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:20:06 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-9b657bf9-c92b-414c-8374-98da4a6e1482 tempest-GroupSnapshotsTest-1925086750 None] Created reservations ['bc4e337d-3506-4e3c-b0a1-b9eda9058b11', 'c6413845-3565-4ec3-943c-c40ec6e47a41', 'c76f38f7-5053-48e5-9ab4-dc04f669fb43', 'bcb46585-3d85-42d3-b5e2-59ad2a6f7b2c'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:20:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-9b657bf9-c92b-414c-8374-98da4a6e1482 tempest-GroupSnapshotsTest-1925086750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:20:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-9b657bf9-c92b-414c-8374-98da4a6e1482 tempest-GroupSnapshotsTest-1925086750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:20:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-9b657bf9-c92b-414c-8374-98da4a6e1482 tempest-GroupSnapshotsTest-1925086750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:20:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-9b657bf9-c92b-414c-8374-98da4a6e1482 tempest-GroupSnapshotsTest-1925086750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:20:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-9b657bf9-c92b-414c-8374-98da4a6e1482 tempest-GroupSnapshotsTest-1925086750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:20:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9b657bf9-c92b-414c-8374-98da4a6e1482 tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:06 devstack sudo[91257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:20:06 devstack sudo[91257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:07 devstack sudo[91257]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9b657bf9-c92b-414c-8374-98da4a6e1482 tempest-GroupSnapshotsTest-1925086750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.449s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:07 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-9b657bf9-c92b-414c-8374-98da4a6e1482 tempest-GroupSnapshotsTest-1925086750 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:20:07 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-9b657bf9-c92b-414c-8374-98da4a6e1482 tempest-GroupSnapshotsTest-1925086750 None] Delete group completed successfully. Nov 03 20:20:08 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-d990f384-5a7a-40e3-9b70-31821b81ea78 tempest-GroupSnapshotsTest-1925086750 None] group_snapshot 318b68d7-911f-427a-bfdd-9ce1e0a1b90d: deleting Nov 03 20:20:08 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d990f384-5a7a-40e3-9b70-31821b81ea78 tempest-GroupSnapshotsTest-1925086750 None] group_snapshot 318b68d7-911f-427a-bfdd-9ce1e0a1b90d: deleting {{(pid=87248) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 20:20:08 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d990f384-5a7a-40e3-9b70-31821b81ea78 tempest-GroupSnapshotsTest-1925086750 None] Acquiring lock "cinder-quobyte-b83c2bea-af62-482f-bfbf-34ec8ee610b5" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:20:08 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d990f384-5a7a-40e3-9b70-31821b81ea78 tempest-GroupSnapshotsTest-1925086750 None] Lock "cinder-quobyte-b83c2bea-af62-482f-bfbf-34ec8ee610b5" acquired by "delete_snapshot" :: waited 0.057s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:20:08 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d990f384-5a7a-40e3-9b70-31821b81ea78 tempest-GroupSnapshotsTest-1925086750 None] Acquiring lock "cinder-quobyte-df860100-659e-4eb2-b2cc-66885501dcca" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:20:08 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d990f384-5a7a-40e3-9b70-31821b81ea78 tempest-GroupSnapshotsTest-1925086750 None] Lock "cinder-quobyte-df860100-659e-4eb2-b2cc-66885501dcca" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:20:08 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-d990f384-5a7a-40e3-9b70-31821b81ea78 tempest-GroupSnapshotsTest-1925086750 None] Deleting offline snapshot df860100-659e-4eb2-b2cc-66885501dcca of volume b83c2bea-af62-482f-bfbf-34ec8ee610b5 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:20:08 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-d990f384-5a7a-40e3-9b70-31821b81ea78 tempest-GroupSnapshotsTest-1925086750 None] snapshot_file for this snap is: volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5.df860100-659e-4eb2-b2cc-66885501dcca {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:20:08 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[1acf2117-de07-4a40-a5cb-0400c23e0570]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:20:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d990f384-5a7a-40e3-9b70-31821b81ea78 tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5.df860100-659e-4eb2-b2cc-66885501dcca {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:09 devstack sudo[91289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5.df860100-659e-4eb2-b2cc-66885501dcca Nov 03 20:20:09 devstack sudo[91289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:09 devstack sudo[91289]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d990f384-5a7a-40e3-9b70-31821b81ea78 tempest-GroupSnapshotsTest-1925086750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5.df860100-659e-4eb2-b2cc-66885501dcca" returned: 0 in 0.732s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:09 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-d990f384-5a7a-40e3-9b70-31821b81ea78 tempest-GroupSnapshotsTest-1925086750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:20:09 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eadf47b-4b17-4dec-a6df-4d96f9bd924e]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:20:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d990f384-5a7a-40e3-9b70-31821b81ea78 tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:09 devstack sudo[91299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5 Nov 03 20:20:09 devstack sudo[91299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:10 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-be93e430-7f6b-4f39-9c21-fb28e6d0c3d4 req-1c034001-802f-4ff1-a814-152d30bb69d4 tempest-ServerActionsTestOtherA-836700016 None] Terminate volume connection completed successfully. Nov 03 20:20:10 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-be93e430-7f6b-4f39-9c21-fb28e6d0c3d4 req-1c034001-802f-4ff1-a814-152d30bb69d4 tempest-ServerActionsTestOtherA-836700016 None] Deleting attachment 09581add-6edc-4837-8d93-c35b20f1d0da. {{(pid=87248) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 20:20:10 devstack sudo[91299]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d990f384-5a7a-40e3-9b70-31821b81ea78 tempest-GroupSnapshotsTest-1925086750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5" returned: 0 in 1.162s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d990f384-5a7a-40e3-9b70-31821b81ea78 tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5.df860100-659e-4eb2-b2cc-66885501dcca {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:10 devstack sudo[91344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5.df860100-659e-4eb2-b2cc-66885501dcca Nov 03 20:20:10 devstack sudo[91344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:10 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8597062-0bf4-4bb9-b9a5-a8463c700159 tempest-ServerRescueNegativeTestJSON-1981953613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:20:11 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e8597062-0bf4-4bb9-b9a5-a8463c700159 tempest-ServerRescueNegativeTestJSON-1981953613 None] Flow 'volume_create_manager' (a26ecda8-a792-40cb-bcc9-94cf5456de5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:20:11 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e8597062-0bf4-4bb9-b9a5-a8463c700159 tempest-ServerRescueNegativeTestJSON-1981953613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cb0f59b-827d-4ef2-a5d8-ca352cdd4123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:20:11 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e8597062-0bf4-4bb9-b9a5-a8463c700159 tempest-ServerRescueNegativeTestJSON-1981953613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cb0f59b-827d-4ef2-a5d8-ca352cdd4123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-204874057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0706c3c9-0c94-4f4b-902b-e2979400b86d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6fb2958f1e48878586c9e2e6915daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:20:11Z,use_quota=True,user_id='1e1a14ac7e2142eb9a55125574c1b54e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:20:11 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e8597062-0bf4-4bb9-b9a5-a8463c700159 tempest-ServerRescueNegativeTestJSON-1981953613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdc58671-76a8-4045-b9bc-855200ded9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:20:11 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e8597062-0bf4-4bb9-b9a5-a8463c700159 tempest-ServerRescueNegativeTestJSON-1981953613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdc58671-76a8-4045-b9bc-855200ded9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:20:11 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e8597062-0bf4-4bb9-b9a5-a8463c700159 tempest-ServerRescueNegativeTestJSON-1981953613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a955670-4247-4c50-962a-ab94089b3166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:20:11 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e8597062-0bf4-4bb9-b9a5-a8463c700159 tempest-ServerRescueNegativeTestJSON-1981953613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a955670-4247-4c50-962a-ab94089b3166) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0706c3c9-0c94-4f4b-902b-e2979400b86d', 'volume_name': 'volume-0706c3c9-0c94-4f4b-902b-e2979400b86d', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:20:11 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e8597062-0bf4-4bb9-b9a5-a8463c700159 tempest-ServerRescueNegativeTestJSON-1981953613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d06f16d0-38c3-4436-98ad-c463be3e78d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:20:11 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e8597062-0bf4-4bb9-b9a5-a8463c700159 tempest-ServerRescueNegativeTestJSON-1981953613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d06f16d0-38c3-4436-98ad-c463be3e78d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:20:11 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e8597062-0bf4-4bb9-b9a5-a8463c700159 tempest-ServerRescueNegativeTestJSON-1981953613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74bcfeb5-843f-4591-9a18-8361c17d6d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:20:11 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-e8597062-0bf4-4bb9-b9a5-a8463c700159 tempest-ServerRescueNegativeTestJSON-1981953613 None] Volume 0706c3c9-0c94-4f4b-902b-e2979400b86d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0706c3c9-0c94-4f4b-902b-e2979400b86d', 'volume_size': 1} Nov 03 20:20:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e8597062-0bf4-4bb9-b9a5-a8463c700159 tempest-ServerRescueNegativeTestJSON-1981953613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:20:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e8597062-0bf4-4bb9-b9a5-a8463c700159 tempest-ServerRescueNegativeTestJSON-1981953613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.012s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:20:11 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e8597062-0bf4-4bb9-b9a5-a8463c700159 tempest-ServerRescueNegativeTestJSON-1981953613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-204874057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0706c3c9-0c94-4f4b-902b-e2979400b86d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6fb2958f1e48878586c9e2e6915daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:20:11Z,use_quota=True,user_id='1e1a14ac7e2142eb9a55125574c1b54e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:20:11 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-e8597062-0bf4-4bb9-b9a5-a8463c700159 tempest-ServerRescueNegativeTestJSON-1981953613 None] Creating volume 0706c3c9-0c94-4f4b-902b-e2979400b86d {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:20:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e8597062-0bf4-4bb9-b9a5-a8463c700159 tempest-ServerRescueNegativeTestJSON-1981953613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:20:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e8597062-0bf4-4bb9-b9a5-a8463c700159 tempest-ServerRescueNegativeTestJSON-1981953613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:20:11 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e8597062-0bf4-4bb9-b9a5-a8463c700159 tempest-ServerRescueNegativeTestJSON-1981953613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:20:11 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e8597062-0bf4-4bb9-b9a5-a8463c700159 tempest-ServerRescueNegativeTestJSON-1981953613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:20:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e8597062-0bf4-4bb9-b9a5-a8463c700159 tempest-ServerRescueNegativeTestJSON-1981953613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:20:11 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e8597062-0bf4-4bb9-b9a5-a8463c700159 tempest-ServerRescueNegativeTestJSON-1981953613 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:20:11 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-e8597062-0bf4-4bb9-b9a5-a8463c700159 tempest-ServerRescueNegativeTestJSON-1981953613 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:20:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e8597062-0bf4-4bb9-b9a5-a8463c700159 tempest-ServerRescueNegativeTestJSON-1981953613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0706c3c9-0c94-4f4b-902b-e2979400b86d 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:11 devstack sudo[91354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0706c3c9-0c94-4f4b-902b-e2979400b86d 1073741824 Nov 03 20:20:11 devstack sudo[91354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-be93e430-7f6b-4f39-9c21-fb28e6d0c3d4 req-51b8e01f-8523-4963-9484-cb943a2dcbe8 tempest-ServerActionsTestOtherA-836700016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:20:11 devstack sudo[91344]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d990f384-5a7a-40e3-9b70-31821b81ea78 tempest-GroupSnapshotsTest-1925086750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5.df860100-659e-4eb2-b2cc-66885501dcca" returned: 0 in 1.018s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d990f384-5a7a-40e3-9b70-31821b81ea78 tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5.df860100-659e-4eb2-b2cc-66885501dcca {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:11 devstack sudo[91371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5.df860100-659e-4eb2-b2cc-66885501dcca Nov 03 20:20:11 devstack sudo[91371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:12 devstack sudo[91354]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e8597062-0bf4-4bb9-b9a5-a8463c700159 tempest-ServerRescueNegativeTestJSON-1981953613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0706c3c9-0c94-4f4b-902b-e2979400b86d 1073741824" returned: 0 in 0.828s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e8597062-0bf4-4bb9-b9a5-a8463c700159 tempest-ServerRescueNegativeTestJSON-1981953613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0706c3c9-0c94-4f4b-902b-e2979400b86d {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:12 devstack sudo[91374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0706c3c9-0c94-4f4b-902b-e2979400b86d Nov 03 20:20:12 devstack sudo[91374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:12 devstack sudo[91371]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d990f384-5a7a-40e3-9b70-31821b81ea78 tempest-GroupSnapshotsTest-1925086750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5.df860100-659e-4eb2-b2cc-66885501dcca" returned: 0 in 0.315s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:12 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d990f384-5a7a-40e3-9b70-31821b81ea78 tempest-GroupSnapshotsTest-1925086750 None] Lock "cinder-quobyte-df860100-659e-4eb2-b2cc-66885501dcca" released by "_delete_snapshot" :: held 3.522s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:20:12 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d990f384-5a7a-40e3-9b70-31821b81ea78 tempest-GroupSnapshotsTest-1925086750 None] Lock "cinder-quobyte-b83c2bea-af62-482f-bfbf-34ec8ee610b5" released by "delete_snapshot" :: held 3.572s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:20:12 devstack cinder-volume[87248]: WARNING cinder.quota [None req-d990f384-5a7a-40e3-9b70-31821b81ea78 tempest-GroupSnapshotsTest-1925086750 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1398178575 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1398178575, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:20:12 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-d990f384-5a7a-40e3-9b70-31821b81ea78 tempest-GroupSnapshotsTest-1925086750 None] Created reservations ['1f119f80-a1d7-44c6-b0dc-14e223e31ef1', '97c29dbc-9ac6-4f6b-86ca-009597179c3a', '7085e1f6-a700-4bab-9c23-161a8f6d34a2', 'db794175-66f1-46d9-9642-590d9fa9fcb1'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:20:12 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-d990f384-5a7a-40e3-9b70-31821b81ea78 tempest-GroupSnapshotsTest-1925086750 None] group_snapshot 318b68d7-911f-427a-bfdd-9ce1e0a1b90d: deleted successfully Nov 03 20:20:12 devstack sudo[91374]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e8597062-0bf4-4bb9-b9a5-a8463c700159 tempest-ServerRescueNegativeTestJSON-1981953613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0706c3c9-0c94-4f4b-902b-e2979400b86d" returned: 0 in 0.408s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:12 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e8597062-0bf4-4bb9-b9a5-a8463c700159 tempest-ServerRescueNegativeTestJSON-1981953613 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:20:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e8597062-0bf4-4bb9-b9a5-a8463c700159 tempest-ServerRescueNegativeTestJSON-1981953613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:20:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-be93e430-7f6b-4f39-9c21-fb28e6d0c3d4 req-51b8e01f-8523-4963-9484-cb943a2dcbe8 tempest-ServerActionsTestOtherA-836700016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.807s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:20:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-be93e430-7f6b-4f39-9c21-fb28e6d0c3d4 req-51b8e01f-8523-4963-9484-cb943a2dcbe8 tempest-ServerActionsTestOtherA-836700016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:20:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e8597062-0bf4-4bb9-b9a5-a8463c700159 tempest-ServerRescueNegativeTestJSON-1981953613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74bcfeb5-843f-4591-9a18-8361c17d6d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0706c3c9-0c94-4f4b-902b-e2979400b86d', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:20:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e8597062-0bf4-4bb9-b9a5-a8463c700159 tempest-ServerRescueNegativeTestJSON-1981953613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25e7a8ec-3367-4d79-b4e0-37d62e028041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:20:12 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-e8597062-0bf4-4bb9-b9a5-a8463c700159 tempest-ServerRescueNegativeTestJSON-1981953613 None] Volume volume-0706c3c9-0c94-4f4b-902b-e2979400b86d (0706c3c9-0c94-4f4b-902b-e2979400b86d): created successfully Nov 03 20:20:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e8597062-0bf4-4bb9-b9a5-a8463c700159 tempest-ServerRescueNegativeTestJSON-1981953613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25e7a8ec-3367-4d79-b4e0-37d62e028041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:20:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e8597062-0bf4-4bb9-b9a5-a8463c700159 tempest-ServerRescueNegativeTestJSON-1981953613 None] Flow 'volume_create_manager' (a26ecda8-a792-40cb-bcc9-94cf5456de5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:20:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-be93e430-7f6b-4f39-9c21-fb28e6d0c3d4 req-51b8e01f-8523-4963-9484-cb943a2dcbe8 tempest-ServerActionsTestOtherA-836700016 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8', 'name': 'volume-5061afd4-d0a0-4715-809b-d47a7c2b83e4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '10886d18-4aed-44db-b55e-91d89121b2a0', 'enforce_multipath': True} {{(pid=87248) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 20:20:12 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-e8597062-0bf4-4bb9-b9a5-a8463c700159 tempest-ServerRescueNegativeTestJSON-1981953613 None] Created volume successfully. Nov 03 20:20:12 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-be93e430-7f6b-4f39-9c21-fb28e6d0c3d4 req-51b8e01f-8523-4963-9484-cb943a2dcbe8 tempest-ServerActionsTestOtherA-836700016 None] attachment_update completed successfully. Nov 03 20:20:13 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2a9367d0-adf0-495b-853d-4d75d4b14d32 tempest-GroupSnapshotsTest-1925086750 None] Acquiring lock "cinder-quobyte-b83c2bea-af62-482f-bfbf-34ec8ee610b5" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:20:13 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2a9367d0-adf0-495b-853d-4d75d4b14d32 tempest-GroupSnapshotsTest-1925086750 None] Lock "cinder-quobyte-b83c2bea-af62-482f-bfbf-34ec8ee610b5" acquired by "delete_volume" :: waited 0.028s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:20:13 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2386742-e560-4775-aa65-b30c1167b577]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:20:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2a9367d0-adf0-495b-853d-4d75d4b14d32 tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:13 devstack sudo[91380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5 Nov 03 20:20:13 devstack sudo[91380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:13 devstack sudo[91380]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2a9367d0-adf0-495b-853d-4d75d4b14d32 tempest-GroupSnapshotsTest-1925086750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5" returned: 0 in 0.715s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2a9367d0-adf0-495b-853d-4d75d4b14d32 tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:13 devstack sudo[91390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5 Nov 03 20:20:13 devstack sudo[91390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:14 devstack sudo[91390]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2a9367d0-adf0-495b-853d-4d75d4b14d32 tempest-GroupSnapshotsTest-1925086750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b83c2bea-af62-482f-bfbf-34ec8ee610b5" returned: 0 in 0.669s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:14 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2a9367d0-adf0-495b-853d-4d75d4b14d32 tempest-GroupSnapshotsTest-1925086750 None] Lock "cinder-quobyte-b83c2bea-af62-482f-bfbf-34ec8ee610b5" released by "delete_volume" :: held 1.522s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:20:14 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-2a9367d0-adf0-495b-853d-4d75d4b14d32 tempest-GroupSnapshotsTest-1925086750 None] Created reservations ['79ee273e-a274-4d66-b62e-653cd0b09e5c'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:20:15 devstack cinder-volume[87248]: WARNING cinder.db.api [None req-2a9367d0-adf0-495b-853d-4d75d4b14d32 tempest-GroupSnapshotsTest-1925086750 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1398178575'] Nov 03 20:20:15 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-2a9367d0-adf0-495b-853d-4d75d4b14d32 tempest-GroupSnapshotsTest-1925086750 None] Created reservations ['dbeebd98-6c83-4b4f-98fb-9310ee228589', 'cc12e817-4798-46da-9a34-9d54015eee12', '0152095a-0ba0-411b-8962-5d877ca4e772', '5b902c76-22d0-4f6d-a76f-0d9e3e8b0a13'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:20:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2a9367d0-adf0-495b-853d-4d75d4b14d32 tempest-GroupSnapshotsTest-1925086750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:20:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2a9367d0-adf0-495b-853d-4d75d4b14d32 tempest-GroupSnapshotsTest-1925086750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:20:15 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2a9367d0-adf0-495b-853d-4d75d4b14d32 tempest-GroupSnapshotsTest-1925086750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:20:15 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2a9367d0-adf0-495b-853d-4d75d4b14d32 tempest-GroupSnapshotsTest-1925086750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:20:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2a9367d0-adf0-495b-853d-4d75d4b14d32 tempest-GroupSnapshotsTest-1925086750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:20:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2a9367d0-adf0-495b-853d-4d75d4b14d32 tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:15 devstack sudo[91423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:20:15 devstack sudo[91423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:15 devstack sudo[91423]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2a9367d0-adf0-495b-853d-4d75d4b14d32 tempest-GroupSnapshotsTest-1925086750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.613s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:15 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-2a9367d0-adf0-495b-853d-4d75d4b14d32 tempest-GroupSnapshotsTest-1925086750 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:20:15 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-2a9367d0-adf0-495b-853d-4d75d4b14d32 tempest-GroupSnapshotsTest-1925086750 None] Delete group completed successfully. Nov 03 20:20:18 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-bc31df48-d02d-4503-85f2-a511264e456a tempest-GroupSnapshotsTest-1925086750 None] Group tempest-GroupSnapshotsTest-Group-418018758: creating Nov 03 20:20:18 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-bc31df48-d02d-4503-85f2-a511264e456a tempest-GroupSnapshotsTest-1925086750 None] Group tempest-GroupSnapshotsTest-Group-418018758: created successfully Nov 03 20:20:18 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-bc31df48-d02d-4503-85f2-a511264e456a tempest-GroupSnapshotsTest-1925086750 None] Create group completed successfully. Nov 03 20:20:20 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-cca004bb-08bd-4aa8-8414-c76abc4e6fcd tempest-GroupSnapshotsTest-1925086750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:20:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cca004bb-08bd-4aa8-8414-c76abc4e6fcd tempest-GroupSnapshotsTest-1925086750 None] Flow 'volume_create_manager' (67fa2910-8775-4000-bb9c-f10f1eaec960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:20:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cca004bb-08bd-4aa8-8414-c76abc4e6fcd tempest-GroupSnapshotsTest-1925086750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f382e410-50d4-4f89-8f3d-fae7b3f8ca90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:20:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cca004bb-08bd-4aa8-8414-c76abc4e6fcd tempest-GroupSnapshotsTest-1925086750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f382e410-50d4-4f89-8f3d-fae7b3f8ca90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1545299875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0fa17872-5df5-436d-a552-e2420474aff3,host='devstack@QuobyteHD#QuobyteHD',id=4db926f3-879e-42e7-9546-0ca767554c2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a68281e50ae47cc9a5c3102575b7e5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:20:21Z,use_quota=True,user_id='1d7ddeb6e0cb4deb8439a99c9d3fe6bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12ca731-6bde-43a0-a8ef-39437091c3c0),volume_type_id=b12ca731-6bde-43a0-a8ef-39437091c3c0)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:20:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cca004bb-08bd-4aa8-8414-c76abc4e6fcd tempest-GroupSnapshotsTest-1925086750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa6aac82-dd9a-42d4-a2c4-6144df89dcc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:20:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cca004bb-08bd-4aa8-8414-c76abc4e6fcd tempest-GroupSnapshotsTest-1925086750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa6aac82-dd9a-42d4-a2c4-6144df89dcc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:20:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cca004bb-08bd-4aa8-8414-c76abc4e6fcd tempest-GroupSnapshotsTest-1925086750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5547d66-05e9-4f74-8d93-defedb16e48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:20:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cca004bb-08bd-4aa8-8414-c76abc4e6fcd tempest-GroupSnapshotsTest-1925086750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5547d66-05e9-4f74-8d93-defedb16e48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4db926f3-879e-42e7-9546-0ca767554c2f', 'volume_name': 'volume-4db926f3-879e-42e7-9546-0ca767554c2f', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:20:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cca004bb-08bd-4aa8-8414-c76abc4e6fcd tempest-GroupSnapshotsTest-1925086750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55fae04b-1329-4617-b4ba-67ac7296e196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:20:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cca004bb-08bd-4aa8-8414-c76abc4e6fcd tempest-GroupSnapshotsTest-1925086750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55fae04b-1329-4617-b4ba-67ac7296e196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:20:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cca004bb-08bd-4aa8-8414-c76abc4e6fcd tempest-GroupSnapshotsTest-1925086750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4cdde2d-de3a-4edb-b179-2c462d95b13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:20:20 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-cca004bb-08bd-4aa8-8414-c76abc4e6fcd tempest-GroupSnapshotsTest-1925086750 None] Volume 4db926f3-879e-42e7-9546-0ca767554c2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4db926f3-879e-42e7-9546-0ca767554c2f', 'volume_size': 1} Nov 03 20:20:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-cca004bb-08bd-4aa8-8414-c76abc4e6fcd tempest-GroupSnapshotsTest-1925086750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:20:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-cca004bb-08bd-4aa8-8414-c76abc4e6fcd tempest-GroupSnapshotsTest-1925086750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:20:20 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-cca004bb-08bd-4aa8-8414-c76abc4e6fcd tempest-GroupSnapshotsTest-1925086750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0fa17872-5df5-436d-a552-e2420474aff3,created_at=2026-11-03T19:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1545299875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0fa17872-5df5-436d-a552-e2420474aff3,host='devstack@QuobyteHD#QuobyteHD',id=4db926f3-879e-42e7-9546-0ca767554c2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a68281e50ae47cc9a5c3102575b7e5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:20:21Z,use_quota=True,user_id='1d7ddeb6e0cb4deb8439a99c9d3fe6bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12ca731-6bde-43a0-a8ef-39437091c3c0),volume_type_id=b12ca731-6bde-43a0-a8ef-39437091c3c0)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:20:20 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-cca004bb-08bd-4aa8-8414-c76abc4e6fcd tempest-GroupSnapshotsTest-1925086750 None] Creating volume 4db926f3-879e-42e7-9546-0ca767554c2f {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:20:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-cca004bb-08bd-4aa8-8414-c76abc4e6fcd tempest-GroupSnapshotsTest-1925086750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:20:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-cca004bb-08bd-4aa8-8414-c76abc4e6fcd tempest-GroupSnapshotsTest-1925086750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:20:20 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-cca004bb-08bd-4aa8-8414-c76abc4e6fcd tempest-GroupSnapshotsTest-1925086750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:20:20 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-cca004bb-08bd-4aa8-8414-c76abc4e6fcd tempest-GroupSnapshotsTest-1925086750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:20:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-cca004bb-08bd-4aa8-8414-c76abc4e6fcd tempest-GroupSnapshotsTest-1925086750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:20:20 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-cca004bb-08bd-4aa8-8414-c76abc4e6fcd tempest-GroupSnapshotsTest-1925086750 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:20:20 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-cca004bb-08bd-4aa8-8414-c76abc4e6fcd tempest-GroupSnapshotsTest-1925086750 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:20:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cca004bb-08bd-4aa8-8414-c76abc4e6fcd tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4db926f3-879e-42e7-9546-0ca767554c2f 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:20 devstack sudo[91952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4db926f3-879e-42e7-9546-0ca767554c2f 1073741824 Nov 03 20:20:20 devstack sudo[91952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:21 devstack sudo[91952]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cca004bb-08bd-4aa8-8414-c76abc4e6fcd tempest-GroupSnapshotsTest-1925086750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4db926f3-879e-42e7-9546-0ca767554c2f 1073741824" returned: 0 in 0.720s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cca004bb-08bd-4aa8-8414-c76abc4e6fcd tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4db926f3-879e-42e7-9546-0ca767554c2f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:21 devstack sudo[91970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4db926f3-879e-42e7-9546-0ca767554c2f Nov 03 20:20:21 devstack sudo[91970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:22 devstack sudo[91970]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cca004bb-08bd-4aa8-8414-c76abc4e6fcd tempest-GroupSnapshotsTest-1925086750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4db926f3-879e-42e7-9546-0ca767554c2f" returned: 0 in 0.769s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:22 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-cca004bb-08bd-4aa8-8414-c76abc4e6fcd tempest-GroupSnapshotsTest-1925086750 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:20:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-cca004bb-08bd-4aa8-8414-c76abc4e6fcd tempest-GroupSnapshotsTest-1925086750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.627s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:20:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cca004bb-08bd-4aa8-8414-c76abc4e6fcd tempest-GroupSnapshotsTest-1925086750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4cdde2d-de3a-4edb-b179-2c462d95b13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4db926f3-879e-42e7-9546-0ca767554c2f', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:20:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cca004bb-08bd-4aa8-8414-c76abc4e6fcd tempest-GroupSnapshotsTest-1925086750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5e7f917-4de9-4f6f-8548-c558f0d58beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:20:22 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-cca004bb-08bd-4aa8-8414-c76abc4e6fcd tempest-GroupSnapshotsTest-1925086750 None] Volume volume-4db926f3-879e-42e7-9546-0ca767554c2f (4db926f3-879e-42e7-9546-0ca767554c2f): created successfully Nov 03 20:20:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cca004bb-08bd-4aa8-8414-c76abc4e6fcd tempest-GroupSnapshotsTest-1925086750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5e7f917-4de9-4f6f-8548-c558f0d58beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:20:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cca004bb-08bd-4aa8-8414-c76abc4e6fcd tempest-GroupSnapshotsTest-1925086750 None] Flow 'volume_create_manager' (67fa2910-8775-4000-bb9c-f10f1eaec960) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:20:22 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-cca004bb-08bd-4aa8-8414-c76abc4e6fcd tempest-GroupSnapshotsTest-1925086750 None] Created volume successfully. Nov 03 20:20:25 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c0ec1e8-382b-4341-94ce-1fb58a26f6d9 tempest-GroupSnapshotsTest-1925086750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:20:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8c0ec1e8-382b-4341-94ce-1fb58a26f6d9 tempest-GroupSnapshotsTest-1925086750 None] Flow 'volume_create_manager' (b84e7ca3-0eec-48d2-b975-5ebf7c704dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:20:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8c0ec1e8-382b-4341-94ce-1fb58a26f6d9 tempest-GroupSnapshotsTest-1925086750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daae6cfe-df93-420c-83c2-970c9763fc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:20:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8c0ec1e8-382b-4341-94ce-1fb58a26f6d9 tempest-GroupSnapshotsTest-1925086750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daae6cfe-df93-420c-83c2-970c9763fc5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:20:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1749675937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0fa17872-5df5-436d-a552-e2420474aff3,host='devstack@QuobyteHD#QuobyteHD',id=1ce8ee10-7183-4905-8d00-8be5700dff14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a68281e50ae47cc9a5c3102575b7e5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:20:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:20:25Z,use_quota=True,user_id='1d7ddeb6e0cb4deb8439a99c9d3fe6bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12ca731-6bde-43a0-a8ef-39437091c3c0),volume_type_id=b12ca731-6bde-43a0-a8ef-39437091c3c0)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:20:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8c0ec1e8-382b-4341-94ce-1fb58a26f6d9 tempest-GroupSnapshotsTest-1925086750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (671e5e13-a1ac-482a-81f1-659cc6938f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:20:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8c0ec1e8-382b-4341-94ce-1fb58a26f6d9 tempest-GroupSnapshotsTest-1925086750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (671e5e13-a1ac-482a-81f1-659cc6938f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:20:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8c0ec1e8-382b-4341-94ce-1fb58a26f6d9 tempest-GroupSnapshotsTest-1925086750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a8a317f-8b2a-4435-9ebf-2725753e3be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:20:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8c0ec1e8-382b-4341-94ce-1fb58a26f6d9 tempest-GroupSnapshotsTest-1925086750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a8a317f-8b2a-4435-9ebf-2725753e3be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ce8ee10-7183-4905-8d00-8be5700dff14', 'volume_name': 'volume-1ce8ee10-7183-4905-8d00-8be5700dff14', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:20:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8c0ec1e8-382b-4341-94ce-1fb58a26f6d9 tempest-GroupSnapshotsTest-1925086750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6606ff54-328f-4396-9391-33e0f537d016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:20:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8c0ec1e8-382b-4341-94ce-1fb58a26f6d9 tempest-GroupSnapshotsTest-1925086750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6606ff54-328f-4396-9391-33e0f537d016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:20:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8c0ec1e8-382b-4341-94ce-1fb58a26f6d9 tempest-GroupSnapshotsTest-1925086750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a80d281-6659-47da-9e8a-26be506baa68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:20:25 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-8c0ec1e8-382b-4341-94ce-1fb58a26f6d9 tempest-GroupSnapshotsTest-1925086750 None] Volume 1ce8ee10-7183-4905-8d00-8be5700dff14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ce8ee10-7183-4905-8d00-8be5700dff14', 'volume_size': 1} Nov 03 20:20:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8c0ec1e8-382b-4341-94ce-1fb58a26f6d9 tempest-GroupSnapshotsTest-1925086750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:20:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8c0ec1e8-382b-4341-94ce-1fb58a26f6d9 tempest-GroupSnapshotsTest-1925086750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:20:25 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8c0ec1e8-382b-4341-94ce-1fb58a26f6d9 tempest-GroupSnapshotsTest-1925086750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0fa17872-5df5-436d-a552-e2420474aff3,created_at=2026-11-03T19:20:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1749675937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0fa17872-5df5-436d-a552-e2420474aff3,host='devstack@QuobyteHD#QuobyteHD',id=1ce8ee10-7183-4905-8d00-8be5700dff14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a68281e50ae47cc9a5c3102575b7e5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:20:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:20:25Z,use_quota=True,user_id='1d7ddeb6e0cb4deb8439a99c9d3fe6bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12ca731-6bde-43a0-a8ef-39437091c3c0),volume_type_id=b12ca731-6bde-43a0-a8ef-39437091c3c0)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:20:25 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-8c0ec1e8-382b-4341-94ce-1fb58a26f6d9 tempest-GroupSnapshotsTest-1925086750 None] Creating volume 1ce8ee10-7183-4905-8d00-8be5700dff14 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:20:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8c0ec1e8-382b-4341-94ce-1fb58a26f6d9 tempest-GroupSnapshotsTest-1925086750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:20:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8c0ec1e8-382b-4341-94ce-1fb58a26f6d9 tempest-GroupSnapshotsTest-1925086750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:20:25 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8c0ec1e8-382b-4341-94ce-1fb58a26f6d9 tempest-GroupSnapshotsTest-1925086750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:20:25 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8c0ec1e8-382b-4341-94ce-1fb58a26f6d9 tempest-GroupSnapshotsTest-1925086750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:20:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8c0ec1e8-382b-4341-94ce-1fb58a26f6d9 tempest-GroupSnapshotsTest-1925086750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:20:25 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8c0ec1e8-382b-4341-94ce-1fb58a26f6d9 tempest-GroupSnapshotsTest-1925086750 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:20:25 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-8c0ec1e8-382b-4341-94ce-1fb58a26f6d9 tempest-GroupSnapshotsTest-1925086750 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:20:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8c0ec1e8-382b-4341-94ce-1fb58a26f6d9 tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ce8ee10-7183-4905-8d00-8be5700dff14 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:25 devstack sudo[92024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ce8ee10-7183-4905-8d00-8be5700dff14 1073741824 Nov 03 20:20:25 devstack sudo[92024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:26 devstack sudo[92024]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8c0ec1e8-382b-4341-94ce-1fb58a26f6d9 tempest-GroupSnapshotsTest-1925086750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ce8ee10-7183-4905-8d00-8be5700dff14 1073741824" returned: 0 in 1.214s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8c0ec1e8-382b-4341-94ce-1fb58a26f6d9 tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ce8ee10-7183-4905-8d00-8be5700dff14 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:26 devstack sudo[92116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ce8ee10-7183-4905-8d00-8be5700dff14 Nov 03 20:20:26 devstack sudo[92116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:27 devstack sudo[92116]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8c0ec1e8-382b-4341-94ce-1fb58a26f6d9 tempest-GroupSnapshotsTest-1925086750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ce8ee10-7183-4905-8d00-8be5700dff14" returned: 0 in 0.729s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:27 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8c0ec1e8-382b-4341-94ce-1fb58a26f6d9 tempest-GroupSnapshotsTest-1925086750 None] <== create_volume: return (2067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:20:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8c0ec1e8-382b-4341-94ce-1fb58a26f6d9 tempest-GroupSnapshotsTest-1925086750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.070s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:20:27 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8c0ec1e8-382b-4341-94ce-1fb58a26f6d9 tempest-GroupSnapshotsTest-1925086750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a80d281-6659-47da-9e8a-26be506baa68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ce8ee10-7183-4905-8d00-8be5700dff14', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:20:27 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8c0ec1e8-382b-4341-94ce-1fb58a26f6d9 tempest-GroupSnapshotsTest-1925086750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc903de2-f830-4adb-9672-4f4ee2c510c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:20:27 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-8c0ec1e8-382b-4341-94ce-1fb58a26f6d9 tempest-GroupSnapshotsTest-1925086750 None] Volume volume-1ce8ee10-7183-4905-8d00-8be5700dff14 (1ce8ee10-7183-4905-8d00-8be5700dff14): created successfully Nov 03 20:20:27 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8c0ec1e8-382b-4341-94ce-1fb58a26f6d9 tempest-GroupSnapshotsTest-1925086750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc903de2-f830-4adb-9672-4f4ee2c510c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:20:27 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8c0ec1e8-382b-4341-94ce-1fb58a26f6d9 tempest-GroupSnapshotsTest-1925086750 None] Flow 'volume_create_manager' (b84e7ca3-0eec-48d2-b975-5ebf7c704dec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:20:27 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-8c0ec1e8-382b-4341-94ce-1fb58a26f6d9 tempest-GroupSnapshotsTest-1925086750 None] Created volume successfully. Nov 03 20:20:28 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-00a9638e-b53f-4cfe-b360-55b6e6ee2e79 tempest-GroupSnapshotsTest-1925086750 None] Update group completed successfully. Nov 03 20:20:28 devstack cinder-volume[87248]: DEBUG oslo_service.periodic_task [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:20:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:20:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:20:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:20:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:20:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:20:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:28 devstack sudo[92132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:20:28 devstack sudo[92132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:29 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-73c481fc-c673-408c-ba63-2dbc199a5de9 tempest-ServerRescueNegativeTestJSON-1981953613 None] Acquiring lock "cinder-0706c3c9-0c94-4f4b-902b-e2979400b86d-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:20:29 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-73c481fc-c673-408c-ba63-2dbc199a5de9 tempest-ServerRescueNegativeTestJSON-1981953613 None] Lock "cinder-0706c3c9-0c94-4f4b-902b-e2979400b86d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:20:29 devstack sudo[92132]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:29 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-73c481fc-c673-408c-ba63-2dbc199a5de9 tempest-ServerRescueNegativeTestJSON-1981953613 None] Acquiring lock "cinder-quobyte-0706c3c9-0c94-4f4b-902b-e2979400b86d" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:20:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.455s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:29 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:20:29 devstack cinder-volume[87248]: DEBUG oslo_service.periodic_task [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running periodic task VolumeManager._thread_info {{(pid=87248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:20:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] thread count: 8 {{(pid=87248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:20:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] thread info: [<_MainThread(MainThread, started 124862067372160)>, , , , , , , ] {{(pid=87248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:20:29 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-73c481fc-c673-408c-ba63-2dbc199a5de9 tempest-ServerRescueNegativeTestJSON-1981953613 None] Lock "cinder-quobyte-0706c3c9-0c94-4f4b-902b-e2979400b86d" acquired by "delete_volume" :: waited 0.056s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:20:29 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7758df-cda0-4a6e-898e-c00a2e800c76]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:20:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-73c481fc-c673-408c-ba63-2dbc199a5de9 tempest-ServerRescueNegativeTestJSON-1981953613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0706c3c9-0c94-4f4b-902b-e2979400b86d {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:29 devstack sudo[92136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0706c3c9-0c94-4f4b-902b-e2979400b86d Nov 03 20:20:29 devstack sudo[92136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:29 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-7d53e396-dd1f-4891-8f65-d67dca50119a tempest-GroupSnapshotsTest-1925086750 None] Update group completed successfully. Nov 03 20:20:29 devstack sudo[92136]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-73c481fc-c673-408c-ba63-2dbc199a5de9 tempest-ServerRescueNegativeTestJSON-1981953613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0706c3c9-0c94-4f4b-902b-e2979400b86d" returned: 0 in 0.588s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-73c481fc-c673-408c-ba63-2dbc199a5de9 tempest-ServerRescueNegativeTestJSON-1981953613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0706c3c9-0c94-4f4b-902b-e2979400b86d {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:29 devstack sudo[92141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0706c3c9-0c94-4f4b-902b-e2979400b86d Nov 03 20:20:29 devstack sudo[92141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:30 devstack sudo[92141]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-73c481fc-c673-408c-ba63-2dbc199a5de9 tempest-ServerRescueNegativeTestJSON-1981953613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0706c3c9-0c94-4f4b-902b-e2979400b86d" returned: 0 in 0.535s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:30 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-73c481fc-c673-408c-ba63-2dbc199a5de9 tempest-ServerRescueNegativeTestJSON-1981953613 None] Lock "cinder-quobyte-0706c3c9-0c94-4f4b-902b-e2979400b86d" released by "delete_volume" :: held 1.199s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:20:30 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-73c481fc-c673-408c-ba63-2dbc199a5de9 tempest-ServerRescueNegativeTestJSON-1981953613 None] Created reservations ['74bb58ee-df3f-4412-8d9a-7b94c8557d20', 'd82c62c5-b671-4ab8-ac1b-bce0302f7460', 'e4e4b3f3-4216-49a4-af25-cbe201d81f07', '5a833eca-d6d2-4d80-b889-5ec452b2674f'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:20:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-73c481fc-c673-408c-ba63-2dbc199a5de9 tempest-ServerRescueNegativeTestJSON-1981953613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:20:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-73c481fc-c673-408c-ba63-2dbc199a5de9 tempest-ServerRescueNegativeTestJSON-1981953613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:20:30 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-73c481fc-c673-408c-ba63-2dbc199a5de9 tempest-ServerRescueNegativeTestJSON-1981953613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:20:30 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-73c481fc-c673-408c-ba63-2dbc199a5de9 tempest-ServerRescueNegativeTestJSON-1981953613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:20:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-73c481fc-c673-408c-ba63-2dbc199a5de9 tempest-ServerRescueNegativeTestJSON-1981953613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:20:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-73c481fc-c673-408c-ba63-2dbc199a5de9 tempest-ServerRescueNegativeTestJSON-1981953613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:30 devstack sudo[92144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:20:30 devstack sudo[92144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:31 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-f10f06bc-907f-4432-a91a-051b986e00c1 tempest-GroupSnapshotsTest-1925086750 None] Update group completed successfully. Nov 03 20:20:31 devstack sudo[92144]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-73c481fc-c673-408c-ba63-2dbc199a5de9 tempest-ServerRescueNegativeTestJSON-1981953613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.363s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:31 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-73c481fc-c673-408c-ba63-2dbc199a5de9 tempest-ServerRescueNegativeTestJSON-1981953613 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:20:31 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-73c481fc-c673-408c-ba63-2dbc199a5de9 tempest-ServerRescueNegativeTestJSON-1981953613 None] Deleted volume successfully. Nov 03 20:20:31 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-73c481fc-c673-408c-ba63-2dbc199a5de9 tempest-ServerRescueNegativeTestJSON-1981953613 None] Lock "cinder-0706c3c9-0c94-4f4b-902b-e2979400b86d-delete_volume" released by "delete_volume" :: held 1.999s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:20:32 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-72b0c7e5-8321-443c-8011-941a6c0c7d88 tempest-GroupSnapshotsTest-1925086750 None] Update group completed successfully. Nov 03 20:20:34 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-60dc8f0c-6cc6-42ab-85cf-43fd9dc94667 tempest-GroupSnapshotsTest-1925086750 None] GroupSnapshot 3e6c137e-f942-4079-a6f2-749f2d5bece7: creating. Nov 03 20:20:34 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-60dc8f0c-6cc6-42ab-85cf-43fd9dc94667 tempest-GroupSnapshotsTest-1925086750 None] Group snapshot 3e6c137e-f942-4079-a6f2-749f2d5bece7: creating. {{(pid=87248) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 20:20:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-60dc8f0c-6cc6-42ab-85cf-43fd9dc94667 tempest-GroupSnapshotsTest-1925086750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:20:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-60dc8f0c-6cc6-42ab-85cf-43fd9dc94667 tempest-GroupSnapshotsTest-1925086750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:20:34 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-60dc8f0c-6cc6-42ab-85cf-43fd9dc94667 tempest-GroupSnapshotsTest-1925086750 None] Creating offline snapshot b0ddf837-4be8-4d27-855e-01c6dd2489d8 of volume 1ce8ee10-7183-4905-8d00-8be5700dff14 {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:20:34 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[263f5c26-7f0b-42b3-985a-23f6a169784b]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:20:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-60dc8f0c-6cc6-42ab-85cf-43fd9dc94667 tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ce8ee10-7183-4905-8d00-8be5700dff14 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:34 devstack sudo[92179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ce8ee10-7183-4905-8d00-8be5700dff14 Nov 03 20:20:34 devstack sudo[92179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:35 devstack sudo[92179]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-60dc8f0c-6cc6-42ab-85cf-43fd9dc94667 tempest-GroupSnapshotsTest-1925086750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ce8ee10-7183-4905-8d00-8be5700dff14" returned: 0 in 0.726s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-60dc8f0c-6cc6-42ab-85cf-43fd9dc94667 tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ce8ee10-7183-4905-8d00-8be5700dff14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ce8ee10-7183-4905-8d00-8be5700dff14.b0ddf837-4be8-4d27-855e-01c6dd2489d8 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:35 devstack sudo[92188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ce8ee10-7183-4905-8d00-8be5700dff14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ce8ee10-7183-4905-8d00-8be5700dff14.b0ddf837-4be8-4d27-855e-01c6dd2489d8 1G Nov 03 20:20:35 devstack sudo[92188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:36 devstack sudo[92188]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-60dc8f0c-6cc6-42ab-85cf-43fd9dc94667 tempest-GroupSnapshotsTest-1925086750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ce8ee10-7183-4905-8d00-8be5700dff14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ce8ee10-7183-4905-8d00-8be5700dff14.b0ddf837-4be8-4d27-855e-01c6dd2489d8 1G" returned: 0 in 0.945s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-60dc8f0c-6cc6-42ab-85cf-43fd9dc94667 tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ce8ee10-7183-4905-8d00-8be5700dff14 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ce8ee10-7183-4905-8d00-8be5700dff14.b0ddf837-4be8-4d27-855e-01c6dd2489d8 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:36 devstack sudo[92239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ce8ee10-7183-4905-8d00-8be5700dff14 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ce8ee10-7183-4905-8d00-8be5700dff14.b0ddf837-4be8-4d27-855e-01c6dd2489d8 Nov 03 20:20:36 devstack sudo[92239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:36 devstack sudo[92239]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-60dc8f0c-6cc6-42ab-85cf-43fd9dc94667 tempest-GroupSnapshotsTest-1925086750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ce8ee10-7183-4905-8d00-8be5700dff14 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ce8ee10-7183-4905-8d00-8be5700dff14.b0ddf837-4be8-4d27-855e-01c6dd2489d8" returned: 0 in 0.478s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:36 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-60dc8f0c-6cc6-42ab-85cf-43fd9dc94667 tempest-GroupSnapshotsTest-1925086750 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ce8ee10-7183-4905-8d00-8be5700dff14.b0ddf837-4be8-4d27-855e-01c6dd2489d8 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 20:20:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-60dc8f0c-6cc6-42ab-85cf-43fd9dc94667 tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ce8ee10-7183-4905-8d00-8be5700dff14.b0ddf837-4be8-4d27-855e-01c6dd2489d8 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:36 devstack sudo[92245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ce8ee10-7183-4905-8d00-8be5700dff14.b0ddf837-4be8-4d27-855e-01c6dd2489d8 Nov 03 20:20:36 devstack sudo[92245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:37 devstack sudo[92245]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-60dc8f0c-6cc6-42ab-85cf-43fd9dc94667 tempest-GroupSnapshotsTest-1925086750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ce8ee10-7183-4905-8d00-8be5700dff14.b0ddf837-4be8-4d27-855e-01c6dd2489d8" returned: 0 in 0.452s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-60dc8f0c-6cc6-42ab-85cf-43fd9dc94667 tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ce8ee10-7183-4905-8d00-8be5700dff14.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:37 devstack sudo[92270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ce8ee10-7183-4905-8d00-8be5700dff14.info Nov 03 20:20:37 devstack sudo[92270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:37 devstack sudo[92270]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-60dc8f0c-6cc6-42ab-85cf-43fd9dc94667 tempest-GroupSnapshotsTest-1925086750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ce8ee10-7183-4905-8d00-8be5700dff14.info" returned: 0 in 0.350s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:37 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-60dc8f0c-6cc6-42ab-85cf-43fd9dc94667 tempest-GroupSnapshotsTest-1925086750 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ce8ee10-7183-4905-8d00-8be5700dff14.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 20:20:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-60dc8f0c-6cc6-42ab-85cf-43fd9dc94667 tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ce8ee10-7183-4905-8d00-8be5700dff14.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:37 devstack sudo[92274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ce8ee10-7183-4905-8d00-8be5700dff14.info Nov 03 20:20:37 devstack sudo[92274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:37 devstack sudo[92274]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-60dc8f0c-6cc6-42ab-85cf-43fd9dc94667 tempest-GroupSnapshotsTest-1925086750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ce8ee10-7183-4905-8d00-8be5700dff14.info" returned: 0 in 0.350s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-60dc8f0c-6cc6-42ab-85cf-43fd9dc94667 tempest-GroupSnapshotsTest-1925086750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.510s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:20:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-60dc8f0c-6cc6-42ab-85cf-43fd9dc94667 tempest-GroupSnapshotsTest-1925086750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:20:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-60dc8f0c-6cc6-42ab-85cf-43fd9dc94667 tempest-GroupSnapshotsTest-1925086750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:20:38 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-60dc8f0c-6cc6-42ab-85cf-43fd9dc94667 tempest-GroupSnapshotsTest-1925086750 None] Creating offline snapshot e76cbc7c-2b5d-4438-ae59-f99cc904942a of volume 4db926f3-879e-42e7-9546-0ca767554c2f {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:20:38 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4895c7-cf60-46a8-a0d5-37139f57b96b]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:20:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-60dc8f0c-6cc6-42ab-85cf-43fd9dc94667 tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4db926f3-879e-42e7-9546-0ca767554c2f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:38 devstack sudo[92278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4db926f3-879e-42e7-9546-0ca767554c2f Nov 03 20:20:38 devstack sudo[92278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:38 devstack sudo[92278]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-60dc8f0c-6cc6-42ab-85cf-43fd9dc94667 tempest-GroupSnapshotsTest-1925086750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4db926f3-879e-42e7-9546-0ca767554c2f" returned: 0 in 0.439s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-60dc8f0c-6cc6-42ab-85cf-43fd9dc94667 tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4db926f3-879e-42e7-9546-0ca767554c2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4db926f3-879e-42e7-9546-0ca767554c2f.e76cbc7c-2b5d-4438-ae59-f99cc904942a 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:38 devstack sudo[92285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4db926f3-879e-42e7-9546-0ca767554c2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4db926f3-879e-42e7-9546-0ca767554c2f.e76cbc7c-2b5d-4438-ae59-f99cc904942a 1G Nov 03 20:20:38 devstack sudo[92285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:38 devstack sudo[92285]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-60dc8f0c-6cc6-42ab-85cf-43fd9dc94667 tempest-GroupSnapshotsTest-1925086750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4db926f3-879e-42e7-9546-0ca767554c2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4db926f3-879e-42e7-9546-0ca767554c2f.e76cbc7c-2b5d-4438-ae59-f99cc904942a 1G" returned: 0 in 0.460s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-60dc8f0c-6cc6-42ab-85cf-43fd9dc94667 tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4db926f3-879e-42e7-9546-0ca767554c2f -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4db926f3-879e-42e7-9546-0ca767554c2f.e76cbc7c-2b5d-4438-ae59-f99cc904942a {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:39 devstack sudo[92291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4db926f3-879e-42e7-9546-0ca767554c2f -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4db926f3-879e-42e7-9546-0ca767554c2f.e76cbc7c-2b5d-4438-ae59-f99cc904942a Nov 03 20:20:39 devstack sudo[92291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:39 devstack sudo[92291]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-60dc8f0c-6cc6-42ab-85cf-43fd9dc94667 tempest-GroupSnapshotsTest-1925086750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4db926f3-879e-42e7-9546-0ca767554c2f -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4db926f3-879e-42e7-9546-0ca767554c2f.e76cbc7c-2b5d-4438-ae59-f99cc904942a" returned: 0 in 0.323s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:39 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-60dc8f0c-6cc6-42ab-85cf-43fd9dc94667 tempest-GroupSnapshotsTest-1925086750 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4db926f3-879e-42e7-9546-0ca767554c2f.e76cbc7c-2b5d-4438-ae59-f99cc904942a is being set with open permissions: ugo+rw: NotImplementedError Nov 03 20:20:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-60dc8f0c-6cc6-42ab-85cf-43fd9dc94667 tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4db926f3-879e-42e7-9546-0ca767554c2f.e76cbc7c-2b5d-4438-ae59-f99cc904942a {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:39 devstack sudo[92297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4db926f3-879e-42e7-9546-0ca767554c2f.e76cbc7c-2b5d-4438-ae59-f99cc904942a Nov 03 20:20:39 devstack sudo[92297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:39 devstack sudo[92297]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-60dc8f0c-6cc6-42ab-85cf-43fd9dc94667 tempest-GroupSnapshotsTest-1925086750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4db926f3-879e-42e7-9546-0ca767554c2f.e76cbc7c-2b5d-4438-ae59-f99cc904942a" returned: 0 in 0.263s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-60dc8f0c-6cc6-42ab-85cf-43fd9dc94667 tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4db926f3-879e-42e7-9546-0ca767554c2f.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:39 devstack sudo[92300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4db926f3-879e-42e7-9546-0ca767554c2f.info Nov 03 20:20:39 devstack sudo[92300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:39 devstack sudo[92300]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-60dc8f0c-6cc6-42ab-85cf-43fd9dc94667 tempest-GroupSnapshotsTest-1925086750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4db926f3-879e-42e7-9546-0ca767554c2f.info" returned: 0 in 0.335s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:39 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-60dc8f0c-6cc6-42ab-85cf-43fd9dc94667 tempest-GroupSnapshotsTest-1925086750 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4db926f3-879e-42e7-9546-0ca767554c2f.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 20:20:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-60dc8f0c-6cc6-42ab-85cf-43fd9dc94667 tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4db926f3-879e-42e7-9546-0ca767554c2f.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:39 devstack sudo[92304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4db926f3-879e-42e7-9546-0ca767554c2f.info Nov 03 20:20:39 devstack sudo[92304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:40 devstack sudo[92304]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-60dc8f0c-6cc6-42ab-85cf-43fd9dc94667 tempest-GroupSnapshotsTest-1925086750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4db926f3-879e-42e7-9546-0ca767554c2f.info" returned: 0 in 0.246s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-60dc8f0c-6cc6-42ab-85cf-43fd9dc94667 tempest-GroupSnapshotsTest-1925086750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.173s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:20:40 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-60dc8f0c-6cc6-42ab-85cf-43fd9dc94667 tempest-GroupSnapshotsTest-1925086750 None] group_snapshot 3e6c137e-f942-4079-a6f2-749f2d5bece7: created successfully Nov 03 20:20:41 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-105b784d-ebad-482e-8690-19f394bcadbc tempest-GroupSnapshotsTest-1925086750 None] group_snapshot 3e6c137e-f942-4079-a6f2-749f2d5bece7: deleting Nov 03 20:20:41 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-105b784d-ebad-482e-8690-19f394bcadbc tempest-GroupSnapshotsTest-1925086750 None] group_snapshot 3e6c137e-f942-4079-a6f2-749f2d5bece7: deleting {{(pid=87248) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 20:20:41 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-105b784d-ebad-482e-8690-19f394bcadbc tempest-GroupSnapshotsTest-1925086750 None] Acquiring lock "cinder-quobyte-1ce8ee10-7183-4905-8d00-8be5700dff14" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:20:41 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-105b784d-ebad-482e-8690-19f394bcadbc tempest-GroupSnapshotsTest-1925086750 None] Lock "cinder-quobyte-1ce8ee10-7183-4905-8d00-8be5700dff14" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:20:41 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-105b784d-ebad-482e-8690-19f394bcadbc tempest-GroupSnapshotsTest-1925086750 None] Acquiring lock "cinder-quobyte-b0ddf837-4be8-4d27-855e-01c6dd2489d8" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:20:41 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-105b784d-ebad-482e-8690-19f394bcadbc tempest-GroupSnapshotsTest-1925086750 None] Lock "cinder-quobyte-b0ddf837-4be8-4d27-855e-01c6dd2489d8" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:20:41 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-105b784d-ebad-482e-8690-19f394bcadbc tempest-GroupSnapshotsTest-1925086750 None] Deleting offline snapshot b0ddf837-4be8-4d27-855e-01c6dd2489d8 of volume 1ce8ee10-7183-4905-8d00-8be5700dff14 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:20:41 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-105b784d-ebad-482e-8690-19f394bcadbc tempest-GroupSnapshotsTest-1925086750 None] snapshot_file for this snap is: volume-1ce8ee10-7183-4905-8d00-8be5700dff14.b0ddf837-4be8-4d27-855e-01c6dd2489d8 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:20:41 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ad4014-8a3d-4789-a3c6-beaa9ea14a73]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:20:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-105b784d-ebad-482e-8690-19f394bcadbc tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ce8ee10-7183-4905-8d00-8be5700dff14.b0ddf837-4be8-4d27-855e-01c6dd2489d8 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:41 devstack sudo[92309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ce8ee10-7183-4905-8d00-8be5700dff14.b0ddf837-4be8-4d27-855e-01c6dd2489d8 Nov 03 20:20:41 devstack sudo[92309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:41 devstack sudo[92309]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-105b784d-ebad-482e-8690-19f394bcadbc tempest-GroupSnapshotsTest-1925086750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ce8ee10-7183-4905-8d00-8be5700dff14.b0ddf837-4be8-4d27-855e-01c6dd2489d8" returned: 0 in 0.485s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:41 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-105b784d-ebad-482e-8690-19f394bcadbc tempest-GroupSnapshotsTest-1925086750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ce8ee10-7183-4905-8d00-8be5700dff14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:20:41 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e243ebe-51c6-49e2-8f97-391661eec687]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:20:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-105b784d-ebad-482e-8690-19f394bcadbc tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ce8ee10-7183-4905-8d00-8be5700dff14 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:41 devstack sudo[92314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ce8ee10-7183-4905-8d00-8be5700dff14 Nov 03 20:20:41 devstack sudo[92314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:42 devstack sudo[92314]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-105b784d-ebad-482e-8690-19f394bcadbc tempest-GroupSnapshotsTest-1925086750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ce8ee10-7183-4905-8d00-8be5700dff14" returned: 0 in 0.357s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-105b784d-ebad-482e-8690-19f394bcadbc tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ce8ee10-7183-4905-8d00-8be5700dff14.b0ddf837-4be8-4d27-855e-01c6dd2489d8 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:42 devstack sudo[92319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ce8ee10-7183-4905-8d00-8be5700dff14.b0ddf837-4be8-4d27-855e-01c6dd2489d8 Nov 03 20:20:42 devstack sudo[92319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:42 devstack sudo[92319]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-105b784d-ebad-482e-8690-19f394bcadbc tempest-GroupSnapshotsTest-1925086750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ce8ee10-7183-4905-8d00-8be5700dff14.b0ddf837-4be8-4d27-855e-01c6dd2489d8" returned: 0 in 0.609s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-105b784d-ebad-482e-8690-19f394bcadbc tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ce8ee10-7183-4905-8d00-8be5700dff14.b0ddf837-4be8-4d27-855e-01c6dd2489d8 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:42 devstack sudo[92324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ce8ee10-7183-4905-8d00-8be5700dff14.b0ddf837-4be8-4d27-855e-01c6dd2489d8 Nov 03 20:20:42 devstack sudo[92324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:43 devstack sudo[92324]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-105b784d-ebad-482e-8690-19f394bcadbc tempest-GroupSnapshotsTest-1925086750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ce8ee10-7183-4905-8d00-8be5700dff14.b0ddf837-4be8-4d27-855e-01c6dd2489d8" returned: 0 in 0.304s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:43 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-105b784d-ebad-482e-8690-19f394bcadbc tempest-GroupSnapshotsTest-1925086750 None] Lock "cinder-quobyte-b0ddf837-4be8-4d27-855e-01c6dd2489d8" released by "_delete_snapshot" :: held 1.925s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:20:43 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-105b784d-ebad-482e-8690-19f394bcadbc tempest-GroupSnapshotsTest-1925086750 None] Lock "cinder-quobyte-1ce8ee10-7183-4905-8d00-8be5700dff14" released by "delete_snapshot" :: held 1.961s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:20:43 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-105b784d-ebad-482e-8690-19f394bcadbc tempest-GroupSnapshotsTest-1925086750 None] Acquiring lock "cinder-quobyte-4db926f3-879e-42e7-9546-0ca767554c2f" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:20:43 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-105b784d-ebad-482e-8690-19f394bcadbc tempest-GroupSnapshotsTest-1925086750 None] Lock "cinder-quobyte-4db926f3-879e-42e7-9546-0ca767554c2f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:20:43 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-105b784d-ebad-482e-8690-19f394bcadbc tempest-GroupSnapshotsTest-1925086750 None] Acquiring lock "cinder-quobyte-e76cbc7c-2b5d-4438-ae59-f99cc904942a" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:20:43 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-105b784d-ebad-482e-8690-19f394bcadbc tempest-GroupSnapshotsTest-1925086750 None] Lock "cinder-quobyte-e76cbc7c-2b5d-4438-ae59-f99cc904942a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:20:43 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-105b784d-ebad-482e-8690-19f394bcadbc tempest-GroupSnapshotsTest-1925086750 None] Deleting offline snapshot e76cbc7c-2b5d-4438-ae59-f99cc904942a of volume 4db926f3-879e-42e7-9546-0ca767554c2f {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:20:43 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-105b784d-ebad-482e-8690-19f394bcadbc tempest-GroupSnapshotsTest-1925086750 None] snapshot_file for this snap is: volume-4db926f3-879e-42e7-9546-0ca767554c2f.e76cbc7c-2b5d-4438-ae59-f99cc904942a {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:20:43 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d76d4e5-a03f-440c-9bcd-651293a5c938]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:20:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-105b784d-ebad-482e-8690-19f394bcadbc tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4db926f3-879e-42e7-9546-0ca767554c2f.e76cbc7c-2b5d-4438-ae59-f99cc904942a {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:43 devstack sudo[92329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4db926f3-879e-42e7-9546-0ca767554c2f.e76cbc7c-2b5d-4438-ae59-f99cc904942a Nov 03 20:20:43 devstack sudo[92329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:43 devstack sudo[92329]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-105b784d-ebad-482e-8690-19f394bcadbc tempest-GroupSnapshotsTest-1925086750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4db926f3-879e-42e7-9546-0ca767554c2f.e76cbc7c-2b5d-4438-ae59-f99cc904942a" returned: 0 in 0.525s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:43 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-105b784d-ebad-482e-8690-19f394bcadbc tempest-GroupSnapshotsTest-1925086750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4db926f3-879e-42e7-9546-0ca767554c2f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:20:43 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[e091c4b4-932f-4c08-876d-78ab3e4d6b5a]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:20:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-105b784d-ebad-482e-8690-19f394bcadbc tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4db926f3-879e-42e7-9546-0ca767554c2f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:43 devstack sudo[92335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4db926f3-879e-42e7-9546-0ca767554c2f Nov 03 20:20:43 devstack sudo[92335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:44 devstack sudo[92335]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-105b784d-ebad-482e-8690-19f394bcadbc tempest-GroupSnapshotsTest-1925086750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4db926f3-879e-42e7-9546-0ca767554c2f" returned: 0 in 0.461s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-105b784d-ebad-482e-8690-19f394bcadbc tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4db926f3-879e-42e7-9546-0ca767554c2f.e76cbc7c-2b5d-4438-ae59-f99cc904942a {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:44 devstack sudo[92340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4db926f3-879e-42e7-9546-0ca767554c2f.e76cbc7c-2b5d-4438-ae59-f99cc904942a Nov 03 20:20:44 devstack sudo[92340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:44 devstack sudo[92340]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-105b784d-ebad-482e-8690-19f394bcadbc tempest-GroupSnapshotsTest-1925086750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4db926f3-879e-42e7-9546-0ca767554c2f.e76cbc7c-2b5d-4438-ae59-f99cc904942a" returned: 0 in 0.383s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-105b784d-ebad-482e-8690-19f394bcadbc tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4db926f3-879e-42e7-9546-0ca767554c2f.e76cbc7c-2b5d-4438-ae59-f99cc904942a {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:44 devstack sudo[92345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4db926f3-879e-42e7-9546-0ca767554c2f.e76cbc7c-2b5d-4438-ae59-f99cc904942a Nov 03 20:20:44 devstack sudo[92345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:45 devstack sudo[92345]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-105b784d-ebad-482e-8690-19f394bcadbc tempest-GroupSnapshotsTest-1925086750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4db926f3-879e-42e7-9546-0ca767554c2f.e76cbc7c-2b5d-4438-ae59-f99cc904942a" returned: 0 in 0.347s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:45 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-105b784d-ebad-482e-8690-19f394bcadbc tempest-GroupSnapshotsTest-1925086750 None] Lock "cinder-quobyte-e76cbc7c-2b5d-4438-ae59-f99cc904942a" released by "_delete_snapshot" :: held 1.859s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:20:45 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-105b784d-ebad-482e-8690-19f394bcadbc tempest-GroupSnapshotsTest-1925086750 None] Lock "cinder-quobyte-4db926f3-879e-42e7-9546-0ca767554c2f" released by "delete_snapshot" :: held 1.886s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:20:45 devstack cinder-volume[87248]: WARNING cinder.quota [None req-105b784d-ebad-482e-8690-19f394bcadbc tempest-GroupSnapshotsTest-1925086750 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2040113931 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2040113931, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:20:45 devstack cinder-volume[87248]: WARNING cinder.quota [None req-105b784d-ebad-482e-8690-19f394bcadbc tempest-GroupSnapshotsTest-1925086750 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2040113931 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2040113931, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:20:45 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-105b784d-ebad-482e-8690-19f394bcadbc tempest-GroupSnapshotsTest-1925086750 None] Created reservations ['c76a0177-ca2e-4bdc-a501-42f2ab1dc16a', '9f3d1551-6588-4398-8b92-20e80fff3059', 'c8c3c8d9-1f32-4f6f-9274-4bcd99056198', 'e247cfa1-04f6-42d2-b8ba-8e3a34c5d8f7'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:20:45 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-105b784d-ebad-482e-8690-19f394bcadbc tempest-GroupSnapshotsTest-1925086750 None] Created reservations ['754a4a54-4f46-4b60-8330-b1bffc097f1a', '0ae79079-da7d-4e13-aa3b-8ef900740ae8', 'fba779ed-7ece-44da-9b9c-e6e1ea4a7de6', '42e16c7e-e526-4a29-835a-587e9edaa14e'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:20:45 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-105b784d-ebad-482e-8690-19f394bcadbc tempest-GroupSnapshotsTest-1925086750 None] group_snapshot 3e6c137e-f942-4079-a6f2-749f2d5bece7: deleted successfully Nov 03 20:20:46 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-3377730a-e921-44be-a8c8-985afa7bd530 tempest-GroupSnapshotsTest-1925086750 None] Acquiring lock "cinder-quobyte-1ce8ee10-7183-4905-8d00-8be5700dff14" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:20:46 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-3377730a-e921-44be-a8c8-985afa7bd530 tempest-GroupSnapshotsTest-1925086750 None] Lock "cinder-quobyte-1ce8ee10-7183-4905-8d00-8be5700dff14" acquired by "delete_volume" :: waited 0.019s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:20:46 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[45aace9e-cd63-4dd5-a965-0169a299e6f3]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:20:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3377730a-e921-44be-a8c8-985afa7bd530 tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ce8ee10-7183-4905-8d00-8be5700dff14 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:46 devstack sudo[92348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ce8ee10-7183-4905-8d00-8be5700dff14 Nov 03 20:20:46 devstack sudo[92348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:46 devstack sudo[92348]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3377730a-e921-44be-a8c8-985afa7bd530 tempest-GroupSnapshotsTest-1925086750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ce8ee10-7183-4905-8d00-8be5700dff14" returned: 0 in 0.384s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3377730a-e921-44be-a8c8-985afa7bd530 tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ce8ee10-7183-4905-8d00-8be5700dff14 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:46 devstack sudo[92354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ce8ee10-7183-4905-8d00-8be5700dff14 Nov 03 20:20:46 devstack sudo[92354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:46 devstack sudo[92354]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3377730a-e921-44be-a8c8-985afa7bd530 tempest-GroupSnapshotsTest-1925086750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ce8ee10-7183-4905-8d00-8be5700dff14" returned: 0 in 0.256s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:47 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-3377730a-e921-44be-a8c8-985afa7bd530 tempest-GroupSnapshotsTest-1925086750 None] Lock "cinder-quobyte-1ce8ee10-7183-4905-8d00-8be5700dff14" released by "delete_volume" :: held 0.721s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:20:47 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-3377730a-e921-44be-a8c8-985afa7bd530 tempest-GroupSnapshotsTest-1925086750 None] Acquiring lock "cinder-quobyte-4db926f3-879e-42e7-9546-0ca767554c2f" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:20:47 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-3377730a-e921-44be-a8c8-985afa7bd530 tempest-GroupSnapshotsTest-1925086750 None] Lock "cinder-quobyte-4db926f3-879e-42e7-9546-0ca767554c2f" acquired by "delete_volume" :: waited 0.014s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:20:47 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26c0d3f-3acb-40ad-9d8a-ebb6b8139354]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:20:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3377730a-e921-44be-a8c8-985afa7bd530 tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4db926f3-879e-42e7-9546-0ca767554c2f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:47 devstack sudo[92357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4db926f3-879e-42e7-9546-0ca767554c2f Nov 03 20:20:47 devstack sudo[92357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:47 devstack sudo[92357]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3377730a-e921-44be-a8c8-985afa7bd530 tempest-GroupSnapshotsTest-1925086750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4db926f3-879e-42e7-9546-0ca767554c2f" returned: 0 in 0.371s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3377730a-e921-44be-a8c8-985afa7bd530 tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4db926f3-879e-42e7-9546-0ca767554c2f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:47 devstack sudo[92363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4db926f3-879e-42e7-9546-0ca767554c2f Nov 03 20:20:47 devstack sudo[92363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:47 devstack sudo[92363]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3377730a-e921-44be-a8c8-985afa7bd530 tempest-GroupSnapshotsTest-1925086750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4db926f3-879e-42e7-9546-0ca767554c2f" returned: 0 in 0.263s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:47 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-3377730a-e921-44be-a8c8-985afa7bd530 tempest-GroupSnapshotsTest-1925086750 None] Lock "cinder-quobyte-4db926f3-879e-42e7-9546-0ca767554c2f" released by "delete_volume" :: held 0.701s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:20:47 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-3377730a-e921-44be-a8c8-985afa7bd530 tempest-GroupSnapshotsTest-1925086750 None] Created reservations ['244d19ff-41a3-4cc1-86da-5c818f573719'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:20:47 devstack cinder-volume[87248]: WARNING cinder.quota [None req-3377730a-e921-44be-a8c8-985afa7bd530 tempest-GroupSnapshotsTest-1925086750 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2040113931 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2040113931, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:20:47 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-3377730a-e921-44be-a8c8-985afa7bd530 tempest-GroupSnapshotsTest-1925086750 None] Created reservations ['47c8dfa2-8c08-4711-a5e7-6c0ece36a9b8', 'e91f127b-2ec2-4293-af64-9190a87ccde7', 'dfd3ac78-6efc-4bb1-a1c5-b1203f8d6df8', 'f258509d-ff75-40fc-80b1-d15221a2edd8'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:20:47 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-3377730a-e921-44be-a8c8-985afa7bd530 tempest-GroupSnapshotsTest-1925086750 None] Created reservations ['a50f5a00-cae2-4769-9f90-fbd3c501ef99', '388a2352-2b2b-4d06-b6df-4408ff6952c6', '2b46022a-03ef-4af5-8274-0f802d333015', '1b2bc833-0c32-4b3d-a021-048e73e701ab'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:20:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-3377730a-e921-44be-a8c8-985afa7bd530 tempest-GroupSnapshotsTest-1925086750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:20:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-3377730a-e921-44be-a8c8-985afa7bd530 tempest-GroupSnapshotsTest-1925086750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:20:48 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-3377730a-e921-44be-a8c8-985afa7bd530 tempest-GroupSnapshotsTest-1925086750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:20:48 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-3377730a-e921-44be-a8c8-985afa7bd530 tempest-GroupSnapshotsTest-1925086750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:20:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-3377730a-e921-44be-a8c8-985afa7bd530 tempest-GroupSnapshotsTest-1925086750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:20:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3377730a-e921-44be-a8c8-985afa7bd530 tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:48 devstack sudo[92366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:20:48 devstack sudo[92366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:48 devstack sudo[92366]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3377730a-e921-44be-a8c8-985afa7bd530 tempest-GroupSnapshotsTest-1925086750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.248s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:48 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-3377730a-e921-44be-a8c8-985afa7bd530 tempest-GroupSnapshotsTest-1925086750 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:20:48 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-3377730a-e921-44be-a8c8-985afa7bd530 tempest-GroupSnapshotsTest-1925086750 None] Delete group completed successfully. Nov 03 20:20:49 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-22160ae6-284b-4b4f-a54b-cd69f5ec0f08 tempest-GroupSnapshotsTest-1925086750 None] Group tempest-GroupSnapshotsTest-Group-2093007732: creating Nov 03 20:20:49 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-22160ae6-284b-4b4f-a54b-cd69f5ec0f08 tempest-GroupSnapshotsTest-1925086750 None] Group tempest-GroupSnapshotsTest-Group-2093007732: created successfully Nov 03 20:20:49 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-22160ae6-284b-4b4f-a54b-cd69f5ec0f08 tempest-GroupSnapshotsTest-1925086750 None] Create group completed successfully. Nov 03 20:20:50 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-96da9d18-f94f-44f1-8787-6f2188a1d31e tempest-GroupSnapshotsTest-1925086750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:20:50 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-96da9d18-f94f-44f1-8787-6f2188a1d31e tempest-GroupSnapshotsTest-1925086750 None] Flow 'volume_create_manager' (db7b02d6-0de4-4ff2-a357-4ff5281d2cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:20:50 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-96da9d18-f94f-44f1-8787-6f2188a1d31e tempest-GroupSnapshotsTest-1925086750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c84ab40-6b73-4d24-86a7-7ab4c3cb5d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:20:50 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-96da9d18-f94f-44f1-8787-6f2188a1d31e tempest-GroupSnapshotsTest-1925086750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c84ab40-6b73-4d24-86a7-7ab4c3cb5d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:20:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-803752556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2dc91a4b-4384-4285-a153-8a28127085b7,host='devstack@QuobyteHD#QuobyteHD',id=220d6a51-3cd7-4feb-95a9-7558a5188579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a68281e50ae47cc9a5c3102575b7e5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:20:51Z,use_quota=True,user_id='1d7ddeb6e0cb4deb8439a99c9d3fe6bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb7ffacf-177b-4fe2-bee2-f171e587100b),volume_type_id=bb7ffacf-177b-4fe2-bee2-f171e587100b)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:20:50 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-96da9d18-f94f-44f1-8787-6f2188a1d31e tempest-GroupSnapshotsTest-1925086750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f56d25d3-37f1-4fce-940f-86fb18147d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:20:50 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-96da9d18-f94f-44f1-8787-6f2188a1d31e tempest-GroupSnapshotsTest-1925086750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f56d25d3-37f1-4fce-940f-86fb18147d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:20:50 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-96da9d18-f94f-44f1-8787-6f2188a1d31e tempest-GroupSnapshotsTest-1925086750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eee59845-fbf8-4859-bc38-8d6c4f1663f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:20:50 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-96da9d18-f94f-44f1-8787-6f2188a1d31e tempest-GroupSnapshotsTest-1925086750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eee59845-fbf8-4859-bc38-8d6c4f1663f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '220d6a51-3cd7-4feb-95a9-7558a5188579', 'volume_name': 'volume-220d6a51-3cd7-4feb-95a9-7558a5188579', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:20:50 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-96da9d18-f94f-44f1-8787-6f2188a1d31e tempest-GroupSnapshotsTest-1925086750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a7051d7-5266-493a-8323-1323319cf52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:20:50 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-96da9d18-f94f-44f1-8787-6f2188a1d31e tempest-GroupSnapshotsTest-1925086750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a7051d7-5266-493a-8323-1323319cf52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:20:50 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-96da9d18-f94f-44f1-8787-6f2188a1d31e tempest-GroupSnapshotsTest-1925086750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32b42eb9-badb-4b54-8b07-7d669ccb3ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:20:50 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-96da9d18-f94f-44f1-8787-6f2188a1d31e tempest-GroupSnapshotsTest-1925086750 None] Volume 220d6a51-3cd7-4feb-95a9-7558a5188579: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-220d6a51-3cd7-4feb-95a9-7558a5188579', 'volume_size': 1} Nov 03 20:20:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-96da9d18-f94f-44f1-8787-6f2188a1d31e tempest-GroupSnapshotsTest-1925086750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:20:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-96da9d18-f94f-44f1-8787-6f2188a1d31e tempest-GroupSnapshotsTest-1925086750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:20:50 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-96da9d18-f94f-44f1-8787-6f2188a1d31e tempest-GroupSnapshotsTest-1925086750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2dc91a4b-4384-4285-a153-8a28127085b7,created_at=2026-11-03T19:20:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-803752556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2dc91a4b-4384-4285-a153-8a28127085b7,host='devstack@QuobyteHD#QuobyteHD',id=220d6a51-3cd7-4feb-95a9-7558a5188579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a68281e50ae47cc9a5c3102575b7e5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:20:51Z,use_quota=True,user_id='1d7ddeb6e0cb4deb8439a99c9d3fe6bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb7ffacf-177b-4fe2-bee2-f171e587100b),volume_type_id=bb7ffacf-177b-4fe2-bee2-f171e587100b)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:20:50 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-96da9d18-f94f-44f1-8787-6f2188a1d31e tempest-GroupSnapshotsTest-1925086750 None] Creating volume 220d6a51-3cd7-4feb-95a9-7558a5188579 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:20:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-96da9d18-f94f-44f1-8787-6f2188a1d31e tempest-GroupSnapshotsTest-1925086750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:20:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-96da9d18-f94f-44f1-8787-6f2188a1d31e tempest-GroupSnapshotsTest-1925086750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:20:50 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-96da9d18-f94f-44f1-8787-6f2188a1d31e tempest-GroupSnapshotsTest-1925086750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:20:50 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-96da9d18-f94f-44f1-8787-6f2188a1d31e tempest-GroupSnapshotsTest-1925086750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:20:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-96da9d18-f94f-44f1-8787-6f2188a1d31e tempest-GroupSnapshotsTest-1925086750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:20:50 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-96da9d18-f94f-44f1-8787-6f2188a1d31e tempest-GroupSnapshotsTest-1925086750 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:20:50 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-96da9d18-f94f-44f1-8787-6f2188a1d31e tempest-GroupSnapshotsTest-1925086750 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:20:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-96da9d18-f94f-44f1-8787-6f2188a1d31e tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-220d6a51-3cd7-4feb-95a9-7558a5188579 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:51 devstack sudo[92371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-220d6a51-3cd7-4feb-95a9-7558a5188579 1073741824 Nov 03 20:20:51 devstack sudo[92371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:51 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-447d9034-c65a-4b4e-b368-7f2851b52e41 tempest-BackendsCapabilitiesAdminTestsJSON-1669194755 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6631889343262, 'free_capacity_gb': 1773.6631889343262, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87248) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 03 20:20:51 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-08378994-d6c4-49a1-be75-9682a3751911 tempest-BackendsCapabilitiesAdminTestsJSON-1669194755 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6631889343262, 'free_capacity_gb': 1773.6631889343262, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87248) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 03 20:20:51 devstack sudo[92371]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-96da9d18-f94f-44f1-8787-6f2188a1d31e tempest-GroupSnapshotsTest-1925086750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-220d6a51-3cd7-4feb-95a9-7558a5188579 1073741824" returned: 0 in 0.564s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-96da9d18-f94f-44f1-8787-6f2188a1d31e tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-220d6a51-3cd7-4feb-95a9-7558a5188579 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:51 devstack sudo[92390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-220d6a51-3cd7-4feb-95a9-7558a5188579 Nov 03 20:20:51 devstack sudo[92390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:52 devstack sudo[92390]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-96da9d18-f94f-44f1-8787-6f2188a1d31e tempest-GroupSnapshotsTest-1925086750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-220d6a51-3cd7-4feb-95a9-7558a5188579" returned: 0 in 0.372s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:52 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-96da9d18-f94f-44f1-8787-6f2188a1d31e tempest-GroupSnapshotsTest-1925086750 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:20:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-96da9d18-f94f-44f1-8787-6f2188a1d31e tempest-GroupSnapshotsTest-1925086750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:20:52 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-96da9d18-f94f-44f1-8787-6f2188a1d31e tempest-GroupSnapshotsTest-1925086750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32b42eb9-badb-4b54-8b07-7d669ccb3ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-220d6a51-3cd7-4feb-95a9-7558a5188579', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:20:52 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-96da9d18-f94f-44f1-8787-6f2188a1d31e tempest-GroupSnapshotsTest-1925086750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc8b3c5a-5248-41bc-b412-dbf85341cdc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:20:52 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-96da9d18-f94f-44f1-8787-6f2188a1d31e tempest-GroupSnapshotsTest-1925086750 None] Volume volume-220d6a51-3cd7-4feb-95a9-7558a5188579 (220d6a51-3cd7-4feb-95a9-7558a5188579): created successfully Nov 03 20:20:52 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-96da9d18-f94f-44f1-8787-6f2188a1d31e tempest-GroupSnapshotsTest-1925086750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc8b3c5a-5248-41bc-b412-dbf85341cdc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:20:52 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-96da9d18-f94f-44f1-8787-6f2188a1d31e tempest-GroupSnapshotsTest-1925086750 None] Flow 'volume_create_manager' (db7b02d6-0de4-4ff2-a357-4ff5281d2cab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:20:52 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-96da9d18-f94f-44f1-8787-6f2188a1d31e tempest-GroupSnapshotsTest-1925086750 None] Created volume successfully. Nov 03 20:20:53 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-c82e691b-48eb-48e6-a346-153793636bae tempest-GroupSnapshotsTest-1925086750 None] GroupSnapshot beb16cda-52cb-4d21-9930-6cd30c8cc1c6: creating. Nov 03 20:20:53 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c82e691b-48eb-48e6-a346-153793636bae tempest-GroupSnapshotsTest-1925086750 None] Group snapshot beb16cda-52cb-4d21-9930-6cd30c8cc1c6: creating. {{(pid=87248) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 20:20:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c82e691b-48eb-48e6-a346-153793636bae tempest-GroupSnapshotsTest-1925086750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:20:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c82e691b-48eb-48e6-a346-153793636bae tempest-GroupSnapshotsTest-1925086750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:20:53 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-c82e691b-48eb-48e6-a346-153793636bae tempest-GroupSnapshotsTest-1925086750 None] Creating offline snapshot 0de89c4f-a7db-4514-9865-e01533463ff5 of volume 220d6a51-3cd7-4feb-95a9-7558a5188579 {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:20:53 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[7deca591-4e76-415f-a053-8048bb1af068]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:20:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c82e691b-48eb-48e6-a346-153793636bae tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-220d6a51-3cd7-4feb-95a9-7558a5188579 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:53 devstack sudo[92407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-220d6a51-3cd7-4feb-95a9-7558a5188579 Nov 03 20:20:53 devstack sudo[92407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:54 devstack sudo[92407]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c82e691b-48eb-48e6-a346-153793636bae tempest-GroupSnapshotsTest-1925086750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-220d6a51-3cd7-4feb-95a9-7558a5188579" returned: 0 in 0.460s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c82e691b-48eb-48e6-a346-153793636bae tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-220d6a51-3cd7-4feb-95a9-7558a5188579,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-220d6a51-3cd7-4feb-95a9-7558a5188579.0de89c4f-a7db-4514-9865-e01533463ff5 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:54 devstack sudo[92413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-220d6a51-3cd7-4feb-95a9-7558a5188579,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-220d6a51-3cd7-4feb-95a9-7558a5188579.0de89c4f-a7db-4514-9865-e01533463ff5 1G Nov 03 20:20:54 devstack sudo[92413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:54 devstack sudo[92413]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c82e691b-48eb-48e6-a346-153793636bae tempest-GroupSnapshotsTest-1925086750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-220d6a51-3cd7-4feb-95a9-7558a5188579,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-220d6a51-3cd7-4feb-95a9-7558a5188579.0de89c4f-a7db-4514-9865-e01533463ff5 1G" returned: 0 in 0.460s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c82e691b-48eb-48e6-a346-153793636bae tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-220d6a51-3cd7-4feb-95a9-7558a5188579 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-220d6a51-3cd7-4feb-95a9-7558a5188579.0de89c4f-a7db-4514-9865-e01533463ff5 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:54 devstack sudo[92419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-220d6a51-3cd7-4feb-95a9-7558a5188579 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-220d6a51-3cd7-4feb-95a9-7558a5188579.0de89c4f-a7db-4514-9865-e01533463ff5 Nov 03 20:20:54 devstack sudo[92419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:54 devstack sudo[92419]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c82e691b-48eb-48e6-a346-153793636bae tempest-GroupSnapshotsTest-1925086750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-220d6a51-3cd7-4feb-95a9-7558a5188579 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-220d6a51-3cd7-4feb-95a9-7558a5188579.0de89c4f-a7db-4514-9865-e01533463ff5" returned: 0 in 0.367s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:54 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-c82e691b-48eb-48e6-a346-153793636bae tempest-GroupSnapshotsTest-1925086750 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-220d6a51-3cd7-4feb-95a9-7558a5188579.0de89c4f-a7db-4514-9865-e01533463ff5 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 20:20:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c82e691b-48eb-48e6-a346-153793636bae tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-220d6a51-3cd7-4feb-95a9-7558a5188579.0de89c4f-a7db-4514-9865-e01533463ff5 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:54 devstack sudo[92424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-220d6a51-3cd7-4feb-95a9-7558a5188579.0de89c4f-a7db-4514-9865-e01533463ff5 Nov 03 20:20:54 devstack sudo[92424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:55 devstack sudo[92424]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c82e691b-48eb-48e6-a346-153793636bae tempest-GroupSnapshotsTest-1925086750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-220d6a51-3cd7-4feb-95a9-7558a5188579.0de89c4f-a7db-4514-9865-e01533463ff5" returned: 0 in 0.260s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c82e691b-48eb-48e6-a346-153793636bae tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-220d6a51-3cd7-4feb-95a9-7558a5188579.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:55 devstack sudo[92427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-220d6a51-3cd7-4feb-95a9-7558a5188579.info Nov 03 20:20:55 devstack sudo[92427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:55 devstack sudo[92427]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c82e691b-48eb-48e6-a346-153793636bae tempest-GroupSnapshotsTest-1925086750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-220d6a51-3cd7-4feb-95a9-7558a5188579.info" returned: 0 in 0.290s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:55 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-c82e691b-48eb-48e6-a346-153793636bae tempest-GroupSnapshotsTest-1925086750 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-220d6a51-3cd7-4feb-95a9-7558a5188579.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 20:20:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c82e691b-48eb-48e6-a346-153793636bae tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-220d6a51-3cd7-4feb-95a9-7558a5188579.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:55 devstack sudo[92430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-220d6a51-3cd7-4feb-95a9-7558a5188579.info Nov 03 20:20:55 devstack sudo[92430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:55 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-947e158f-c6f7-4c3b-a136-c5af8ae90271 tempest-AttachVolumeShelveTestJSON-1678871204 None] Acquiring lock "cinder-53fc7140-2a34-4bfd-8340-e41c56cae298-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:20:55 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-947e158f-c6f7-4c3b-a136-c5af8ae90271 tempest-AttachVolumeShelveTestJSON-1678871204 None] Lock "cinder-53fc7140-2a34-4bfd-8340-e41c56cae298-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:20:55 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-947e158f-c6f7-4c3b-a136-c5af8ae90271 tempest-AttachVolumeShelveTestJSON-1678871204 None] Acquiring lock "cinder-quobyte-53fc7140-2a34-4bfd-8340-e41c56cae298" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:20:55 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-947e158f-c6f7-4c3b-a136-c5af8ae90271 tempest-AttachVolumeShelveTestJSON-1678871204 None] Lock "cinder-quobyte-53fc7140-2a34-4bfd-8340-e41c56cae298" acquired by "delete_volume" :: waited 0.017s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:20:55 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[854ce06b-f8c4-4686-9e87-022ecbeb9733]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:20:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-947e158f-c6f7-4c3b-a136-c5af8ae90271 tempest-AttachVolumeShelveTestJSON-1678871204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-53fc7140-2a34-4bfd-8340-e41c56cae298 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:55 devstack sudo[92432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-53fc7140-2a34-4bfd-8340-e41c56cae298 Nov 03 20:20:55 devstack sudo[92432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:55 devstack sudo[92430]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c82e691b-48eb-48e6-a346-153793636bae tempest-GroupSnapshotsTest-1925086750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-220d6a51-3cd7-4feb-95a9-7558a5188579.info" returned: 0 in 0.296s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c82e691b-48eb-48e6-a346-153793636bae tempest-GroupSnapshotsTest-1925086750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.239s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:20:55 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-c82e691b-48eb-48e6-a346-153793636bae tempest-GroupSnapshotsTest-1925086750 None] group_snapshot beb16cda-52cb-4d21-9930-6cd30c8cc1c6: created successfully Nov 03 20:20:56 devstack sudo[92432]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-947e158f-c6f7-4c3b-a136-c5af8ae90271 tempest-AttachVolumeShelveTestJSON-1678871204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-53fc7140-2a34-4bfd-8340-e41c56cae298" returned: 0 in 0.381s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-947e158f-c6f7-4c3b-a136-c5af8ae90271 tempest-AttachVolumeShelveTestJSON-1678871204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-53fc7140-2a34-4bfd-8340-e41c56cae298 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:56 devstack sudo[92438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-53fc7140-2a34-4bfd-8340-e41c56cae298 Nov 03 20:20:56 devstack sudo[92438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:56 devstack sudo[92438]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-947e158f-c6f7-4c3b-a136-c5af8ae90271 tempest-AttachVolumeShelveTestJSON-1678871204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-53fc7140-2a34-4bfd-8340-e41c56cae298" returned: 0 in 0.249s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:56 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-947e158f-c6f7-4c3b-a136-c5af8ae90271 tempest-AttachVolumeShelveTestJSON-1678871204 None] Lock "cinder-quobyte-53fc7140-2a34-4bfd-8340-e41c56cae298" released by "delete_volume" :: held 0.686s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:20:56 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-947e158f-c6f7-4c3b-a136-c5af8ae90271 tempest-AttachVolumeShelveTestJSON-1678871204 None] Created reservations ['45287469-0cc2-4825-a795-352c540075ca', 'a2507072-83f5-4544-93fa-5a2d9fe40364', 'a4cf6f62-0d4f-4283-a138-f6a263c3be0a', 'f751b53e-42c1-41bf-b5fa-17ec1c7206e9'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:20:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-947e158f-c6f7-4c3b-a136-c5af8ae90271 tempest-AttachVolumeShelveTestJSON-1678871204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:20:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-947e158f-c6f7-4c3b-a136-c5af8ae90271 tempest-AttachVolumeShelveTestJSON-1678871204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:20:56 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-947e158f-c6f7-4c3b-a136-c5af8ae90271 tempest-AttachVolumeShelveTestJSON-1678871204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:20:56 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-947e158f-c6f7-4c3b-a136-c5af8ae90271 tempest-AttachVolumeShelveTestJSON-1678871204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:20:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-947e158f-c6f7-4c3b-a136-c5af8ae90271 tempest-AttachVolumeShelveTestJSON-1678871204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:20:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-947e158f-c6f7-4c3b-a136-c5af8ae90271 tempest-AttachVolumeShelveTestJSON-1678871204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:56 devstack sudo[92441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:20:56 devstack sudo[92441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:56 devstack sudo[92441]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-947e158f-c6f7-4c3b-a136-c5af8ae90271 tempest-AttachVolumeShelveTestJSON-1678871204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.336s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:56 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-947e158f-c6f7-4c3b-a136-c5af8ae90271 tempest-AttachVolumeShelveTestJSON-1678871204 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:20:56 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-947e158f-c6f7-4c3b-a136-c5af8ae90271 tempest-AttachVolumeShelveTestJSON-1678871204 None] Deleted volume successfully. Nov 03 20:20:56 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-947e158f-c6f7-4c3b-a136-c5af8ae90271 tempest-AttachVolumeShelveTestJSON-1678871204 None] Lock "cinder-53fc7140-2a34-4bfd-8340-e41c56cae298-delete_volume" released by "delete_volume" :: held 1.287s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:20:57 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-2d0a5a46-2177-4e4e-b3d2-8d20d9132a3b tempest-GroupSnapshotsTest-1925086750 None] group_snapshot beb16cda-52cb-4d21-9930-6cd30c8cc1c6: deleting Nov 03 20:20:57 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:SELECT=110,cinder:UPDATE=109,cinder:INSERT=26,cinder:DELETE=3 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:20:57 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:INSERT=21,cinder:UPDATE=98,cinder:SELECT=109,cinder:DELETE=3 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:20:57 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2d0a5a46-2177-4e4e-b3d2-8d20d9132a3b tempest-GroupSnapshotsTest-1925086750 None] group_snapshot beb16cda-52cb-4d21-9930-6cd30c8cc1c6: deleting {{(pid=87248) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 20:20:57 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2d0a5a46-2177-4e4e-b3d2-8d20d9132a3b tempest-GroupSnapshotsTest-1925086750 None] Acquiring lock "cinder-quobyte-220d6a51-3cd7-4feb-95a9-7558a5188579" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:20:57 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2d0a5a46-2177-4e4e-b3d2-8d20d9132a3b tempest-GroupSnapshotsTest-1925086750 None] Lock "cinder-quobyte-220d6a51-3cd7-4feb-95a9-7558a5188579" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:20:57 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2d0a5a46-2177-4e4e-b3d2-8d20d9132a3b tempest-GroupSnapshotsTest-1925086750 None] Acquiring lock "cinder-quobyte-0de89c4f-a7db-4514-9865-e01533463ff5" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:20:57 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2d0a5a46-2177-4e4e-b3d2-8d20d9132a3b tempest-GroupSnapshotsTest-1925086750 None] Lock "cinder-quobyte-0de89c4f-a7db-4514-9865-e01533463ff5" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:20:57 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-2d0a5a46-2177-4e4e-b3d2-8d20d9132a3b tempest-GroupSnapshotsTest-1925086750 None] Deleting offline snapshot 0de89c4f-a7db-4514-9865-e01533463ff5 of volume 220d6a51-3cd7-4feb-95a9-7558a5188579 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:20:57 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-2d0a5a46-2177-4e4e-b3d2-8d20d9132a3b tempest-GroupSnapshotsTest-1925086750 None] snapshot_file for this snap is: volume-220d6a51-3cd7-4feb-95a9-7558a5188579.0de89c4f-a7db-4514-9865-e01533463ff5 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:20:57 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b94ec4-81d8-40fb-be28-08ed4cb784d9]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:20:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2d0a5a46-2177-4e4e-b3d2-8d20d9132a3b tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-220d6a51-3cd7-4feb-95a9-7558a5188579.0de89c4f-a7db-4514-9865-e01533463ff5 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:57 devstack sudo[92478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-220d6a51-3cd7-4feb-95a9-7558a5188579.0de89c4f-a7db-4514-9865-e01533463ff5 Nov 03 20:20:57 devstack sudo[92478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:57 devstack sudo[92478]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2d0a5a46-2177-4e4e-b3d2-8d20d9132a3b tempest-GroupSnapshotsTest-1925086750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-220d6a51-3cd7-4feb-95a9-7558a5188579.0de89c4f-a7db-4514-9865-e01533463ff5" returned: 0 in 0.418s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:57 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-2d0a5a46-2177-4e4e-b3d2-8d20d9132a3b tempest-GroupSnapshotsTest-1925086750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-220d6a51-3cd7-4feb-95a9-7558a5188579(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:20:57 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b058218-542c-494e-9d33-1458386b47b8]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:20:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2d0a5a46-2177-4e4e-b3d2-8d20d9132a3b tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-220d6a51-3cd7-4feb-95a9-7558a5188579 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:57 devstack sudo[92485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-220d6a51-3cd7-4feb-95a9-7558a5188579 Nov 03 20:20:57 devstack sudo[92485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:57 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-8cfd693c-43ea-4058-8015-90deb58bcdd0 tempest-GroupsTest-342520804 None] Group tempest-Group1-427762278: creating Nov 03 20:20:57 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-8cfd693c-43ea-4058-8015-90deb58bcdd0 tempest-GroupsTest-342520804 None] Group tempest-Group1-427762278: created successfully Nov 03 20:20:58 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-8cfd693c-43ea-4058-8015-90deb58bcdd0 tempest-GroupsTest-342520804 None] Create group completed successfully. Nov 03 20:20:58 devstack sudo[92485]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2d0a5a46-2177-4e4e-b3d2-8d20d9132a3b tempest-GroupSnapshotsTest-1925086750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-220d6a51-3cd7-4feb-95a9-7558a5188579" returned: 0 in 0.419s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2d0a5a46-2177-4e4e-b3d2-8d20d9132a3b tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-220d6a51-3cd7-4feb-95a9-7558a5188579.0de89c4f-a7db-4514-9865-e01533463ff5 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:58 devstack sudo[92490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-220d6a51-3cd7-4feb-95a9-7558a5188579.0de89c4f-a7db-4514-9865-e01533463ff5 Nov 03 20:20:58 devstack sudo[92490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:58 devstack sudo[92490]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2d0a5a46-2177-4e4e-b3d2-8d20d9132a3b tempest-GroupSnapshotsTest-1925086750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-220d6a51-3cd7-4feb-95a9-7558a5188579.0de89c4f-a7db-4514-9865-e01533463ff5" returned: 0 in 0.349s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2d0a5a46-2177-4e4e-b3d2-8d20d9132a3b tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-220d6a51-3cd7-4feb-95a9-7558a5188579.0de89c4f-a7db-4514-9865-e01533463ff5 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:58 devstack sudo[92496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-220d6a51-3cd7-4feb-95a9-7558a5188579.0de89c4f-a7db-4514-9865-e01533463ff5 Nov 03 20:20:58 devstack sudo[92496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:20:58 devstack sudo[92496]: pam_unix(sudo:session): session closed for user root Nov 03 20:20:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2d0a5a46-2177-4e4e-b3d2-8d20d9132a3b tempest-GroupSnapshotsTest-1925086750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-220d6a51-3cd7-4feb-95a9-7558a5188579.0de89c4f-a7db-4514-9865-e01533463ff5" returned: 0 in 0.268s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:20:58 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2d0a5a46-2177-4e4e-b3d2-8d20d9132a3b tempest-GroupSnapshotsTest-1925086750 None] Lock "cinder-quobyte-0de89c4f-a7db-4514-9865-e01533463ff5" released by "_delete_snapshot" :: held 1.640s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:20:58 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2d0a5a46-2177-4e4e-b3d2-8d20d9132a3b tempest-GroupSnapshotsTest-1925086750 None] Lock "cinder-quobyte-220d6a51-3cd7-4feb-95a9-7558a5188579" released by "delete_snapshot" :: held 1.665s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:20:58 devstack cinder-volume[87248]: WARNING cinder.quota [None req-2d0a5a46-2177-4e4e-b3d2-8d20d9132a3b tempest-GroupSnapshotsTest-1925086750 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-586308310 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-586308310, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:20:58 devstack cinder-volume[87248]: WARNING cinder.quota [None req-2d0a5a46-2177-4e4e-b3d2-8d20d9132a3b tempest-GroupSnapshotsTest-1925086750 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-586308310 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-586308310, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:20:58 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-2d0a5a46-2177-4e4e-b3d2-8d20d9132a3b tempest-GroupSnapshotsTest-1925086750 None] Created reservations ['635808fa-8896-4ab3-a49d-f55a2369ba57', '0aa2bd37-3c69-4239-8398-05a6c5081b09', '7aaab6ce-c97d-4029-b528-6a107bf9766d', '2aeebb03-c97a-41cc-b632-e8d0b4ee968c'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:20:58 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-2d0a5a46-2177-4e4e-b3d2-8d20d9132a3b tempest-GroupSnapshotsTest-1925086750 None] group_snapshot beb16cda-52cb-4d21-9930-6cd30c8cc1c6: deleted successfully Nov 03 20:20:59 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-5200d5aa-301a-43c8-b93d-ab1a242cbec1 tempest-GroupsTest-342520804 None] Group tempest-Group2-2121647092: creating Nov 03 20:20:59 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-5200d5aa-301a-43c8-b93d-ab1a242cbec1 tempest-GroupsTest-342520804 None] Group tempest-Group2-2121647092: created successfully Nov 03 20:20:59 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-5200d5aa-301a-43c8-b93d-ab1a242cbec1 tempest-GroupsTest-342520804 None] Create group completed successfully. Nov 03 20:20:59 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1f2b33a9-83a7-4e58-afad-156ee2e27054 tempest-GroupSnapshotsTest-1925086750 None] Acquiring lock "cinder-quobyte-220d6a51-3cd7-4feb-95a9-7558a5188579" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:20:59 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1f2b33a9-83a7-4e58-afad-156ee2e27054 tempest-GroupSnapshotsTest-1925086750 None] Lock "cinder-quobyte-220d6a51-3cd7-4feb-95a9-7558a5188579" acquired by "delete_volume" :: waited 0.017s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:20:59 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[339bf5c8-9ed5-4b86-9ea0-f83806f597b3]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:20:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1f2b33a9-83a7-4e58-afad-156ee2e27054 tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-220d6a51-3cd7-4feb-95a9-7558a5188579 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:20:59 devstack sudo[92501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-220d6a51-3cd7-4feb-95a9-7558a5188579 Nov 03 20:20:59 devstack sudo[92501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:00 devstack sudo[92501]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1f2b33a9-83a7-4e58-afad-156ee2e27054 tempest-GroupSnapshotsTest-1925086750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-220d6a51-3cd7-4feb-95a9-7558a5188579" returned: 0 in 0.465s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1f2b33a9-83a7-4e58-afad-156ee2e27054 tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-220d6a51-3cd7-4feb-95a9-7558a5188579 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:00 devstack sudo[92508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-220d6a51-3cd7-4feb-95a9-7558a5188579 Nov 03 20:21:00 devstack sudo[92508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:00 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-b2967f39-106d-4709-9bd2-9b724745a5c0 req-39142f47-4805-423d-843e-3ee3fdf6f9d4 tempest-ServerActionsTestOtherA-836700016 None] Terminate volume connection completed successfully. Nov 03 20:21:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-b2967f39-106d-4709-9bd2-9b724745a5c0 req-39142f47-4805-423d-843e-3ee3fdf6f9d4 tempest-ServerActionsTestOtherA-836700016 None] Deleting attachment 10886d18-4aed-44db-b55e-91d89121b2a0. {{(pid=87248) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 20:21:00 devstack sudo[92508]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1f2b33a9-83a7-4e58-afad-156ee2e27054 tempest-GroupSnapshotsTest-1925086750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-220d6a51-3cd7-4feb-95a9-7558a5188579" returned: 0 in 0.491s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:00 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1f2b33a9-83a7-4e58-afad-156ee2e27054 tempest-GroupSnapshotsTest-1925086750 None] Lock "cinder-quobyte-220d6a51-3cd7-4feb-95a9-7558a5188579" released by "delete_volume" :: held 1.072s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:21:00 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-1f2b33a9-83a7-4e58-afad-156ee2e27054 tempest-GroupSnapshotsTest-1925086750 None] Created reservations ['c66c19b6-9853-42d2-95f1-258d5f615543'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:21:01 devstack cinder-volume[87248]: WARNING cinder.quota [None req-1f2b33a9-83a7-4e58-afad-156ee2e27054 tempest-GroupSnapshotsTest-1925086750 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-586308310 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-586308310, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:21:01 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-486bfa26-a32f-4126-ba70-a01c1c817f34 tempest-GroupsTest-342520804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:21:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-486bfa26-a32f-4126-ba70-a01c1c817f34 tempest-GroupsTest-342520804 None] Flow 'volume_create_manager' (6665622e-5175-4772-8a6f-ff9ead6e00d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:21:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-486bfa26-a32f-4126-ba70-a01c1c817f34 tempest-GroupsTest-342520804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d10aa935-01ca-4325-b9a4-680f79216024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-486bfa26-a32f-4126-ba70-a01c1c817f34 tempest-GroupsTest-342520804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d10aa935-01ca-4325-b9a4-680f79216024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-231300644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9e73806a-0406-460b-b58b-0a6d29d482a5,host='devstack@QuobyteHD#QuobyteHD',id=b1b21715-8571-42f8-b69b-baaf5d0b0ca1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8257cdc0a18148fb8e8b8a2c502f493a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:21:01Z,use_quota=True,user_id='ed284cf8d19b4490b48609c3beac51d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(adb8c85d-fd8f-4d50-be41-993735c7c940),volume_type_id=adb8c85d-fd8f-4d50-be41-993735c7c940)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-486bfa26-a32f-4126-ba70-a01c1c817f34 tempest-GroupsTest-342520804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5857688e-ac7f-4f43-b329-62ca1933a785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-486bfa26-a32f-4126-ba70-a01c1c817f34 tempest-GroupsTest-342520804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5857688e-ac7f-4f43-b329-62ca1933a785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-486bfa26-a32f-4126-ba70-a01c1c817f34 tempest-GroupsTest-342520804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d0fc67a-9e74-47e7-9462-950d9e68ad7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-486bfa26-a32f-4126-ba70-a01c1c817f34 tempest-GroupsTest-342520804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d0fc67a-9e74-47e7-9462-950d9e68ad7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1b21715-8571-42f8-b69b-baaf5d0b0ca1', 'volume_name': 'volume-b1b21715-8571-42f8-b69b-baaf5d0b0ca1', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-486bfa26-a32f-4126-ba70-a01c1c817f34 tempest-GroupsTest-342520804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14646258-5efa-4736-a815-8c41ce099093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-486bfa26-a32f-4126-ba70-a01c1c817f34 tempest-GroupsTest-342520804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14646258-5efa-4736-a815-8c41ce099093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-486bfa26-a32f-4126-ba70-a01c1c817f34 tempest-GroupsTest-342520804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f59664e8-3b3a-46e7-be35-eccd8fb7d79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:01 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-486bfa26-a32f-4126-ba70-a01c1c817f34 tempest-GroupsTest-342520804 None] Volume b1b21715-8571-42f8-b69b-baaf5d0b0ca1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1b21715-8571-42f8-b69b-baaf5d0b0ca1', 'volume_size': 1} Nov 03 20:21:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-486bfa26-a32f-4126-ba70-a01c1c817f34 tempest-GroupsTest-342520804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-486bfa26-a32f-4126-ba70-a01c1c817f34 tempest-GroupsTest-342520804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:01 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-486bfa26-a32f-4126-ba70-a01c1c817f34 tempest-GroupsTest-342520804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9e73806a-0406-460b-b58b-0a6d29d482a5,created_at=2026-11-03T19:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-231300644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9e73806a-0406-460b-b58b-0a6d29d482a5,host='devstack@QuobyteHD#QuobyteHD',id=b1b21715-8571-42f8-b69b-baaf5d0b0ca1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8257cdc0a18148fb8e8b8a2c502f493a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:21:01Z,use_quota=True,user_id='ed284cf8d19b4490b48609c3beac51d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(adb8c85d-fd8f-4d50-be41-993735c7c940),volume_type_id=adb8c85d-fd8f-4d50-be41-993735c7c940)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:21:01 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-486bfa26-a32f-4126-ba70-a01c1c817f34 tempest-GroupsTest-342520804 None] Creating volume b1b21715-8571-42f8-b69b-baaf5d0b0ca1 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:21:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-486bfa26-a32f-4126-ba70-a01c1c817f34 tempest-GroupsTest-342520804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-486bfa26-a32f-4126-ba70-a01c1c817f34 tempest-GroupsTest-342520804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:01 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-486bfa26-a32f-4126-ba70-a01c1c817f34 tempest-GroupsTest-342520804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:21:01 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-486bfa26-a32f-4126-ba70-a01c1c817f34 tempest-GroupsTest-342520804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:21:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-486bfa26-a32f-4126-ba70-a01c1c817f34 tempest-GroupsTest-342520804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:01 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-486bfa26-a32f-4126-ba70-a01c1c817f34 tempest-GroupsTest-342520804 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:21:01 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-486bfa26-a32f-4126-ba70-a01c1c817f34 tempest-GroupsTest-342520804 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:21:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-486bfa26-a32f-4126-ba70-a01c1c817f34 tempest-GroupsTest-342520804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b1b21715-8571-42f8-b69b-baaf5d0b0ca1 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:01 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-1f2b33a9-83a7-4e58-afad-156ee2e27054 tempest-GroupSnapshotsTest-1925086750 None] Created reservations ['288228fd-3e9c-46df-b03e-49e8d8014be4', '93d96596-57f0-4776-bcfd-6aadf83882c9', 'd2ad1f05-cc97-44ad-9a4e-cec070e5d9e4', '3a9211f1-3912-487f-85b7-21c7f6044a9b'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:21:01 devstack sudo[92519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b1b21715-8571-42f8-b69b-baaf5d0b0ca1 1073741824 Nov 03 20:21:01 devstack sudo[92519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1f2b33a9-83a7-4e58-afad-156ee2e27054 tempest-GroupSnapshotsTest-1925086750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1f2b33a9-83a7-4e58-afad-156ee2e27054 tempest-GroupSnapshotsTest-1925086750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:01 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-1f2b33a9-83a7-4e58-afad-156ee2e27054 tempest-GroupSnapshotsTest-1925086750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:21:01 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-1f2b33a9-83a7-4e58-afad-156ee2e27054 tempest-GroupSnapshotsTest-1925086750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:21:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1f2b33a9-83a7-4e58-afad-156ee2e27054 tempest-GroupSnapshotsTest-1925086750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1f2b33a9-83a7-4e58-afad-156ee2e27054 tempest-GroupSnapshotsTest-1925086750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:01 devstack sudo[92522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:21:01 devstack sudo[92522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:01 devstack sudo[92522]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1f2b33a9-83a7-4e58-afad-156ee2e27054 tempest-GroupSnapshotsTest-1925086750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.402s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:01 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-1f2b33a9-83a7-4e58-afad-156ee2e27054 tempest-GroupSnapshotsTest-1925086750 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:21:01 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-1f2b33a9-83a7-4e58-afad-156ee2e27054 tempest-GroupSnapshotsTest-1925086750 None] Delete group completed successfully. Nov 03 20:21:01 devstack sudo[92519]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-486bfa26-a32f-4126-ba70-a01c1c817f34 tempest-GroupsTest-342520804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b1b21715-8571-42f8-b69b-baaf5d0b0ca1 1073741824" returned: 0 in 0.598s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-486bfa26-a32f-4126-ba70-a01c1c817f34 tempest-GroupsTest-342520804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b1b21715-8571-42f8-b69b-baaf5d0b0ca1 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:01 devstack sudo[92532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b1b21715-8571-42f8-b69b-baaf5d0b0ca1 Nov 03 20:21:01 devstack sudo[92532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:02 devstack sudo[92532]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-486bfa26-a32f-4126-ba70-a01c1c817f34 tempest-GroupsTest-342520804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b1b21715-8571-42f8-b69b-baaf5d0b0ca1" returned: 0 in 0.454s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:02 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-486bfa26-a32f-4126-ba70-a01c1c817f34 tempest-GroupsTest-342520804 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:21:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-486bfa26-a32f-4126-ba70-a01c1c817f34 tempest-GroupsTest-342520804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-486bfa26-a32f-4126-ba70-a01c1c817f34 tempest-GroupsTest-342520804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f59664e8-3b3a-46e7-be35-eccd8fb7d79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1b21715-8571-42f8-b69b-baaf5d0b0ca1', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-486bfa26-a32f-4126-ba70-a01c1c817f34 tempest-GroupsTest-342520804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f17bd18-b11c-4a59-9da7-e54ac3725537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:02 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-486bfa26-a32f-4126-ba70-a01c1c817f34 tempest-GroupsTest-342520804 None] Volume volume-b1b21715-8571-42f8-b69b-baaf5d0b0ca1 (b1b21715-8571-42f8-b69b-baaf5d0b0ca1): created successfully Nov 03 20:21:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-486bfa26-a32f-4126-ba70-a01c1c817f34 tempest-GroupsTest-342520804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f17bd18-b11c-4a59-9da7-e54ac3725537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-486bfa26-a32f-4126-ba70-a01c1c817f34 tempest-GroupsTest-342520804 None] Flow 'volume_create_manager' (6665622e-5175-4772-8a6f-ff9ead6e00d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:21:02 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-486bfa26-a32f-4126-ba70-a01c1c817f34 tempest-GroupsTest-342520804 None] Created volume successfully. Nov 03 20:21:04 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-3dcc1f75-9291-4f72-baf1-4a7f509e9b6b tempest-GroupsTest-342520804 None] Acquiring lock "cinder-quobyte-b1b21715-8571-42f8-b69b-baaf5d0b0ca1" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:21:05 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-3dcc1f75-9291-4f72-baf1-4a7f509e9b6b tempest-GroupsTest-342520804 None] Lock "cinder-quobyte-b1b21715-8571-42f8-b69b-baaf5d0b0ca1" acquired by "delete_volume" :: waited 0.032s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:21:05 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a76dcf-dffa-4da3-a135-bd2596d26124]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:21:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3dcc1f75-9291-4f72-baf1-4a7f509e9b6b tempest-GroupsTest-342520804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b1b21715-8571-42f8-b69b-baaf5d0b0ca1 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:05 devstack sudo[92562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b1b21715-8571-42f8-b69b-baaf5d0b0ca1 Nov 03 20:21:05 devstack sudo[92562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:05 devstack sudo[92562]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3dcc1f75-9291-4f72-baf1-4a7f509e9b6b tempest-GroupsTest-342520804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b1b21715-8571-42f8-b69b-baaf5d0b0ca1" returned: 0 in 0.503s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3dcc1f75-9291-4f72-baf1-4a7f509e9b6b tempest-GroupsTest-342520804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b1b21715-8571-42f8-b69b-baaf5d0b0ca1 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:05 devstack sudo[92567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b1b21715-8571-42f8-b69b-baaf5d0b0ca1 Nov 03 20:21:05 devstack sudo[92567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:05 devstack sudo[92567]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3dcc1f75-9291-4f72-baf1-4a7f509e9b6b tempest-GroupsTest-342520804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b1b21715-8571-42f8-b69b-baaf5d0b0ca1" returned: 0 in 0.283s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:05 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-3dcc1f75-9291-4f72-baf1-4a7f509e9b6b tempest-GroupsTest-342520804 None] Lock "cinder-quobyte-b1b21715-8571-42f8-b69b-baaf5d0b0ca1" released by "delete_volume" :: held 0.868s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:21:05 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-3dcc1f75-9291-4f72-baf1-4a7f509e9b6b tempest-GroupsTest-342520804 None] Created reservations ['2c55adc3-63be-4512-83a9-1858bfc193f6'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:21:06 devstack cinder-volume[87248]: WARNING cinder.quota [None req-3dcc1f75-9291-4f72-baf1-4a7f509e9b6b tempest-GroupsTest-342520804 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-302950715 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-302950715, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:21:06 devstack cinder-volume[87248]: WARNING cinder.quota [None req-3dcc1f75-9291-4f72-baf1-4a7f509e9b6b tempest-GroupsTest-342520804 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-302950715 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-302950715, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:21:06 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-3dcc1f75-9291-4f72-baf1-4a7f509e9b6b tempest-GroupsTest-342520804 None] Created reservations ['e3a28c82-55c8-40b4-962a-c2802024f78f', 'e90e6a6b-2cc2-4fb3-a66a-6c21de7836e8', 'c8ca2d43-c115-427d-9702-345133304c98', 'f309020c-0252-4134-980d-bcadb08c844c'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:21:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-3dcc1f75-9291-4f72-baf1-4a7f509e9b6b tempest-GroupsTest-342520804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-3dcc1f75-9291-4f72-baf1-4a7f509e9b6b tempest-GroupsTest-342520804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-3dcc1f75-9291-4f72-baf1-4a7f509e9b6b tempest-GroupsTest-342520804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:21:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-3dcc1f75-9291-4f72-baf1-4a7f509e9b6b tempest-GroupsTest-342520804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:21:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-3dcc1f75-9291-4f72-baf1-4a7f509e9b6b tempest-GroupsTest-342520804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3dcc1f75-9291-4f72-baf1-4a7f509e9b6b tempest-GroupsTest-342520804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:06 devstack sudo[92570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:21:06 devstack sudo[92570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:06 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-4040786e-565a-4900-92ae-a6caea257660 tempest-GroupsTest-342520804 None] Created reservations ['d4adbc1a-f711-4a25-8589-73b0fbf47e6d'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:21:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4040786e-565a-4900-92ae-a6caea257660 tempest-GroupsTest-342520804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4040786e-565a-4900-92ae-a6caea257660 tempest-GroupsTest-342520804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-4040786e-565a-4900-92ae-a6caea257660 tempest-GroupsTest-342520804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:21:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-4040786e-565a-4900-92ae-a6caea257660 tempest-GroupsTest-342520804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:21:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4040786e-565a-4900-92ae-a6caea257660 tempest-GroupsTest-342520804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4040786e-565a-4900-92ae-a6caea257660 tempest-GroupsTest-342520804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:06 devstack sudo[92573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:21:06 devstack sudo[92573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:06 devstack sudo[92570]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3dcc1f75-9291-4f72-baf1-4a7f509e9b6b tempest-GroupsTest-342520804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.420s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:06 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-3dcc1f75-9291-4f72-baf1-4a7f509e9b6b tempest-GroupsTest-342520804 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:21:06 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-3dcc1f75-9291-4f72-baf1-4a7f509e9b6b tempest-GroupsTest-342520804 None] Delete group completed successfully. Nov 03 20:21:07 devstack sudo[92573]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4040786e-565a-4900-92ae-a6caea257660 tempest-GroupsTest-342520804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.406s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:07 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-4040786e-565a-4900-92ae-a6caea257660 tempest-GroupsTest-342520804 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:21:07 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-4040786e-565a-4900-92ae-a6caea257660 tempest-GroupsTest-342520804 None] Delete group completed successfully. Nov 03 20:21:07 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-71b5c57f-4c0f-486d-98e7-54885d00a954 tempest-VolumesTestJSON-835164019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:21:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-71b5c57f-4c0f-486d-98e7-54885d00a954 tempest-VolumesTestJSON-835164019 None] Flow 'volume_create_manager' (9dd226fc-6736-47a8-a56e-c801c6f9b0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:21:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-71b5c57f-4c0f-486d-98e7-54885d00a954 tempest-VolumesTestJSON-835164019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e86c33a8-fea9-4459-aa36-a5adcc148467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-71b5c57f-4c0f-486d-98e7-54885d00a954 tempest-VolumesTestJSON-835164019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e86c33a8-fea9-4459-aa36-a5adcc148467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-45727840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa4f8d49-32ac-4011-b5c3-49f027a810db,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c8ae52b66632435fbdb34fc16a24e611',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:21:07Z,use_quota=True,user_id='52b7f283610e49b5ab7fd6b994632772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-71b5c57f-4c0f-486d-98e7-54885d00a954 tempest-VolumesTestJSON-835164019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4e0dedf-0587-48b7-987d-5342ba9e631b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-71b5c57f-4c0f-486d-98e7-54885d00a954 tempest-VolumesTestJSON-835164019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4e0dedf-0587-48b7-987d-5342ba9e631b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-71b5c57f-4c0f-486d-98e7-54885d00a954 tempest-VolumesTestJSON-835164019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16d912ba-2ce0-4d65-97bb-9c13e0b58f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-71b5c57f-4c0f-486d-98e7-54885d00a954 tempest-VolumesTestJSON-835164019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16d912ba-2ce0-4d65-97bb-9c13e0b58f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa4f8d49-32ac-4011-b5c3-49f027a810db', 'volume_name': 'volume-aa4f8d49-32ac-4011-b5c3-49f027a810db', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-71b5c57f-4c0f-486d-98e7-54885d00a954 tempest-VolumesTestJSON-835164019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a92a94f-b886-4a9f-a650-a3e16aa62a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-71b5c57f-4c0f-486d-98e7-54885d00a954 tempest-VolumesTestJSON-835164019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a92a94f-b886-4a9f-a650-a3e16aa62a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-71b5c57f-4c0f-486d-98e7-54885d00a954 tempest-VolumesTestJSON-835164019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6b239e5-89d1-4a41-83f1-ceccafe7339c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:07 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-71b5c57f-4c0f-486d-98e7-54885d00a954 tempest-VolumesTestJSON-835164019 None] Volume aa4f8d49-32ac-4011-b5c3-49f027a810db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa4f8d49-32ac-4011-b5c3-49f027a810db', 'volume_size': 1} Nov 03 20:21:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-71b5c57f-4c0f-486d-98e7-54885d00a954 tempest-VolumesTestJSON-835164019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-71b5c57f-4c0f-486d-98e7-54885d00a954 tempest-VolumesTestJSON-835164019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:07 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-71b5c57f-4c0f-486d-98e7-54885d00a954 tempest-VolumesTestJSON-835164019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-45727840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa4f8d49-32ac-4011-b5c3-49f027a810db,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c8ae52b66632435fbdb34fc16a24e611',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:21:07Z,use_quota=True,user_id='52b7f283610e49b5ab7fd6b994632772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:21:07 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-71b5c57f-4c0f-486d-98e7-54885d00a954 tempest-VolumesTestJSON-835164019 None] Creating volume aa4f8d49-32ac-4011-b5c3-49f027a810db {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:21:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-71b5c57f-4c0f-486d-98e7-54885d00a954 tempest-VolumesTestJSON-835164019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-71b5c57f-4c0f-486d-98e7-54885d00a954 tempest-VolumesTestJSON-835164019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:07 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-71b5c57f-4c0f-486d-98e7-54885d00a954 tempest-VolumesTestJSON-835164019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:21:07 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-71b5c57f-4c0f-486d-98e7-54885d00a954 tempest-VolumesTestJSON-835164019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:21:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-71b5c57f-4c0f-486d-98e7-54885d00a954 tempest-VolumesTestJSON-835164019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:07 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-71b5c57f-4c0f-486d-98e7-54885d00a954 tempest-VolumesTestJSON-835164019 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:21:07 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-71b5c57f-4c0f-486d-98e7-54885d00a954 tempest-VolumesTestJSON-835164019 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:21:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-71b5c57f-4c0f-486d-98e7-54885d00a954 tempest-VolumesTestJSON-835164019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-aa4f8d49-32ac-4011-b5c3-49f027a810db 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:07 devstack sudo[92576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-aa4f8d49-32ac-4011-b5c3-49f027a810db 1073741824 Nov 03 20:21:07 devstack sudo[92576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:08 devstack sudo[92576]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-71b5c57f-4c0f-486d-98e7-54885d00a954 tempest-VolumesTestJSON-835164019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-aa4f8d49-32ac-4011-b5c3-49f027a810db 1073741824" returned: 0 in 0.611s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-71b5c57f-4c0f-486d-98e7-54885d00a954 tempest-VolumesTestJSON-835164019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-aa4f8d49-32ac-4011-b5c3-49f027a810db {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:08 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:21:08 devstack sudo[92581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-aa4f8d49-32ac-4011-b5c3-49f027a810db Nov 03 20:21:08 devstack sudo[92581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:08 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Flow 'volume_create_manager' (3bf42f5a-e42c-4172-a642-5926511a4c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:21:08 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bcd7020-948a-4aac-9671-46ab4a5e0231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:08 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bcd7020-948a-4aac-9671-46ab4a5e0231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-558282498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bbd0803-74df-43c1-a49e-75f29e4f1597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45424ab9fd1245dc853d8bd68503846e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:21:08Z,use_quota=True,user_id='e2249889f62c48e3bfb18526317bb6e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:08 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b03f0f8-899b-4317-8558-723333667f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:08 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b03f0f8-899b-4317-8558-723333667f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:08 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c238e656-318e-47b7-80f4-2e4b0615618e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:08 devstack cinder-volume[87248]: DEBUG cinder.image.glance [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Creating Keystone auth plugin from conf {{(pid=87248) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 20:21:08 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-e704a586-24cc-43c4-86c3-95f8668cf1ae tempest-GroupsTest-342520804 None] Group tempest-GroupsTest-Group-928048136: creating Nov 03 20:21:08 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-e704a586-24cc-43c4-86c3-95f8668cf1ae tempest-GroupsTest-342520804 None] Group tempest-GroupsTest-Group-928048136: created successfully Nov 03 20:21:08 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-e704a586-24cc-43c4-86c3-95f8668cf1ae tempest-GroupsTest-342520804 None] Create group completed successfully. Nov 03 20:21:08 devstack sudo[92581]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-71b5c57f-4c0f-486d-98e7-54885d00a954 tempest-VolumesTestJSON-835164019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-aa4f8d49-32ac-4011-b5c3-49f027a810db" returned: 0 in 0.375s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:08 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-71b5c57f-4c0f-486d-98e7-54885d00a954 tempest-VolumesTestJSON-835164019 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:21:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-71b5c57f-4c0f-486d-98e7-54885d00a954 tempest-VolumesTestJSON-835164019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:08 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-71b5c57f-4c0f-486d-98e7-54885d00a954 tempest-VolumesTestJSON-835164019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6b239e5-89d1-4a41-83f1-ceccafe7339c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa4f8d49-32ac-4011-b5c3-49f027a810db', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:08 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-71b5c57f-4c0f-486d-98e7-54885d00a954 tempest-VolumesTestJSON-835164019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a2c29e7-06f2-4b57-9eca-17f36edaf1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:08 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-71b5c57f-4c0f-486d-98e7-54885d00a954 tempest-VolumesTestJSON-835164019 None] Volume volume-aa4f8d49-32ac-4011-b5c3-49f027a810db (aa4f8d49-32ac-4011-b5c3-49f027a810db): created successfully Nov 03 20:21:08 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-71b5c57f-4c0f-486d-98e7-54885d00a954 tempest-VolumesTestJSON-835164019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a2c29e7-06f2-4b57-9eca-17f36edaf1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:08 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-71b5c57f-4c0f-486d-98e7-54885d00a954 tempest-VolumesTestJSON-835164019 None] Flow 'volume_create_manager' (9dd226fc-6736-47a8-a56e-c801c6f9b0bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:21:08 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-71b5c57f-4c0f-486d-98e7-54885d00a954 tempest-VolumesTestJSON-835164019 None] Created volume successfully. Nov 03 20:21:09 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c238e656-318e-47b7-80f4-2e4b0615618e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6bbd0803-74df-43c1-a49e-75f29e4f1597', 'volume_name': 'volume-6bbd0803-74df-43c1-a49e-75f29e4f1597', 'volume_size': 1, 'image_id': '346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a647f64245a54dad95167f6d04c75eaa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'created_at': datetime.datetime(2026, 11, 3, 19, 11, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 11, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/346de059-5b9a-438e-a6dd-24e9fc9a1ee3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:09 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce390559-c223-44db-8b7e-dd063111e392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:09 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce390559-c223-44db-8b7e-dd063111e392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:09 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2642d955-6902-425b-ae1b-9b4e0d53e15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:09 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Volume 6bbd0803-74df-43c1-a49e-75f29e4f1597: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6bbd0803-74df-43c1-a49e-75f29e4f1597', 'volume_size': 1, 'image_id': '346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a647f64245a54dad95167f6d04c75eaa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'created_at': datetime.datetime(2026, 11, 3, 19, 11, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 11, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/346de059-5b9a-438e-a6dd-24e9fc9a1ee3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 20:21:09 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Trying to clone 6bbd0803-74df-43c1-a49e-75f29e4f1597 from image 346de059-5b9a-438e-a6dd-24e9fc9a1ee3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'metadata': {}}]). {{(pid=87248) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 20:21:09 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_4ko4vfg1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87248) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 20:21:09 devstack cinder-volume[87248]: INFO cinder.image.image_utils [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Image download 20.69 MB at 20.69 MB/s Nov 03 20:21:09 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[63125b3e-96a8-4cb0-ba67-b1bf0c73f0e4]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:21:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_4ko4vfg1devstack@QuobyteHD {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:09 devstack sudo[92605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_4ko4vfg1devstack@QuobyteHD Nov 03 20:21:09 devstack sudo[92605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:09 devstack sudo[92605]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_4ko4vfg1devstack@QuobyteHD" returned: 0 in 0.421s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:09 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Temporary image 346de059-5b9a-438e-a6dd-24e9fc9a1ee3 is fetched for user e2249889f62c48e3bfb18526317bb6e4. {{(pid=87248) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 20:21:10 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f87521d-1845-4be7-91a3-15743180af28]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:21:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_4ko4vfg1devstack@QuobyteHD {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:10 devstack sudo[92612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_4ko4vfg1devstack@QuobyteHD Nov 03 20:21:10 devstack sudo[92612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:10 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb73d9f4-84d3-489b-8a9c-76a114a2525a tempest-GroupsTest-342520804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:21:10 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-bb73d9f4-84d3-489b-8a9c-76a114a2525a tempest-GroupsTest-342520804 None] Flow 'volume_create_manager' (b14bc03a-ce42-4f00-817a-09868858b683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:21:10 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-bb73d9f4-84d3-489b-8a9c-76a114a2525a tempest-GroupsTest-342520804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d7384e9-a691-4e73-8671-666f68d1ced0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:10 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-bb73d9f4-84d3-489b-8a9c-76a114a2525a tempest-GroupsTest-342520804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d7384e9-a691-4e73-8671-666f68d1ced0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1355776102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=592f34f3-f1fc-4da5-b780-4043b87404b7,host='devstack@QuobyteHD#QuobyteHD',id=63146ce8-38c1-43e1-b60e-a33266f7b429,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8257cdc0a18148fb8e8b8a2c502f493a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:21:10Z,use_quota=True,user_id='ed284cf8d19b4490b48609c3beac51d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eb6ad85b-cafc-448b-a588-f740ba784b4d),volume_type_id=eb6ad85b-cafc-448b-a588-f740ba784b4d)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:10 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-bb73d9f4-84d3-489b-8a9c-76a114a2525a tempest-GroupsTest-342520804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51748fdf-19cd-4e6a-b35b-73449f29d909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:10 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-bb73d9f4-84d3-489b-8a9c-76a114a2525a tempest-GroupsTest-342520804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51748fdf-19cd-4e6a-b35b-73449f29d909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:10 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-bb73d9f4-84d3-489b-8a9c-76a114a2525a tempest-GroupsTest-342520804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07f41ac6-6e55-436e-86b9-d230f62bb5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:10 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-bb73d9f4-84d3-489b-8a9c-76a114a2525a tempest-GroupsTest-342520804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07f41ac6-6e55-436e-86b9-d230f62bb5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63146ce8-38c1-43e1-b60e-a33266f7b429', 'volume_name': 'volume-63146ce8-38c1-43e1-b60e-a33266f7b429', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:10 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-bb73d9f4-84d3-489b-8a9c-76a114a2525a tempest-GroupsTest-342520804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0007125-1f43-4b4f-992c-3a89bac07820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:10 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-bb73d9f4-84d3-489b-8a9c-76a114a2525a tempest-GroupsTest-342520804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0007125-1f43-4b4f-992c-3a89bac07820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:10 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-bb73d9f4-84d3-489b-8a9c-76a114a2525a tempest-GroupsTest-342520804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3292e45-7f4a-4d0d-992d-e7798679064b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:10 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-bb73d9f4-84d3-489b-8a9c-76a114a2525a tempest-GroupsTest-342520804 None] Volume 63146ce8-38c1-43e1-b60e-a33266f7b429: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63146ce8-38c1-43e1-b60e-a33266f7b429', 'volume_size': 1} Nov 03 20:21:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-bb73d9f4-84d3-489b-8a9c-76a114a2525a tempest-GroupsTest-342520804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-bb73d9f4-84d3-489b-8a9c-76a114a2525a tempest-GroupsTest-342520804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:10 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-bb73d9f4-84d3-489b-8a9c-76a114a2525a tempest-GroupsTest-342520804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=592f34f3-f1fc-4da5-b780-4043b87404b7,created_at=2026-11-03T19:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1355776102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=592f34f3-f1fc-4da5-b780-4043b87404b7,host='devstack@QuobyteHD#QuobyteHD',id=63146ce8-38c1-43e1-b60e-a33266f7b429,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8257cdc0a18148fb8e8b8a2c502f493a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:21:10Z,use_quota=True,user_id='ed284cf8d19b4490b48609c3beac51d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eb6ad85b-cafc-448b-a588-f740ba784b4d),volume_type_id=eb6ad85b-cafc-448b-a588-f740ba784b4d)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:21:10 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-bb73d9f4-84d3-489b-8a9c-76a114a2525a tempest-GroupsTest-342520804 None] Creating volume 63146ce8-38c1-43e1-b60e-a33266f7b429 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:21:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-bb73d9f4-84d3-489b-8a9c-76a114a2525a tempest-GroupsTest-342520804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-bb73d9f4-84d3-489b-8a9c-76a114a2525a tempest-GroupsTest-342520804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:10 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-bb73d9f4-84d3-489b-8a9c-76a114a2525a tempest-GroupsTest-342520804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:21:10 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-bb73d9f4-84d3-489b-8a9c-76a114a2525a tempest-GroupsTest-342520804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:21:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-bb73d9f4-84d3-489b-8a9c-76a114a2525a tempest-GroupsTest-342520804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:10 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-bb73d9f4-84d3-489b-8a9c-76a114a2525a tempest-GroupsTest-342520804 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:21:10 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-bb73d9f4-84d3-489b-8a9c-76a114a2525a tempest-GroupsTest-342520804 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:21:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-bb73d9f4-84d3-489b-8a9c-76a114a2525a tempest-GroupsTest-342520804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63146ce8-38c1-43e1-b60e-a33266f7b429 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:10 devstack sudo[92612]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_4ko4vfg1devstack@QuobyteHD" returned: 0 in 0.405s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:10 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-265e94ff-c8d4-49fc-bf43-26d3cb9293de tempest-VolumesTestJSON-835164019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:21:10 devstack sudo[92618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63146ce8-38c1-43e1-b60e-a33266f7b429 1073741824 Nov 03 20:21:10 devstack sudo[92618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:10 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-265e94ff-c8d4-49fc-bf43-26d3cb9293de tempest-VolumesTestJSON-835164019 None] Flow 'volume_create_manager' (cee17b5f-7617-46c0-96fd-961286c9384b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:21:10 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-265e94ff-c8d4-49fc-bf43-26d3cb9293de tempest-VolumesTestJSON-835164019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed28fcc8-5373-41f7-9fb9-22d9b2a94c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:10 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-265e94ff-c8d4-49fc-bf43-26d3cb9293de tempest-VolumesTestJSON-835164019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed28fcc8-5373-41f7-9fb9-22d9b2a94c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1501752156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd54e463-c5ad-471d-8c27-a8485488cd41,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c8ae52b66632435fbdb34fc16a24e611',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:21:10Z,use_quota=True,user_id='52b7f283610e49b5ab7fd6b994632772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:10 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-265e94ff-c8d4-49fc-bf43-26d3cb9293de tempest-VolumesTestJSON-835164019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (258b623b-044e-4765-bcdf-4f6a3fd570d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:10 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-265e94ff-c8d4-49fc-bf43-26d3cb9293de tempest-VolumesTestJSON-835164019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (258b623b-044e-4765-bcdf-4f6a3fd570d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:10 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-265e94ff-c8d4-49fc-bf43-26d3cb9293de tempest-VolumesTestJSON-835164019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfaf7451-b8c1-4f26-a04d-1a48b4776f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:10 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-265e94ff-c8d4-49fc-bf43-26d3cb9293de tempest-VolumesTestJSON-835164019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfaf7451-b8c1-4f26-a04d-1a48b4776f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd54e463-c5ad-471d-8c27-a8485488cd41', 'volume_name': 'volume-cd54e463-c5ad-471d-8c27-a8485488cd41', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:10 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-265e94ff-c8d4-49fc-bf43-26d3cb9293de tempest-VolumesTestJSON-835164019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4e275f1-3c57-4041-90b9-644510b114eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:10 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-265e94ff-c8d4-49fc-bf43-26d3cb9293de tempest-VolumesTestJSON-835164019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4e275f1-3c57-4041-90b9-644510b114eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:10 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-265e94ff-c8d4-49fc-bf43-26d3cb9293de tempest-VolumesTestJSON-835164019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e3b6c3-e9cc-4c66-b83c-fa0066d5feec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:10 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-265e94ff-c8d4-49fc-bf43-26d3cb9293de tempest-VolumesTestJSON-835164019 None] Volume cd54e463-c5ad-471d-8c27-a8485488cd41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd54e463-c5ad-471d-8c27-a8485488cd41', 'volume_size': 1} Nov 03 20:21:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-265e94ff-c8d4-49fc-bf43-26d3cb9293de tempest-VolumesTestJSON-835164019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:10 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-7e7686b2-0fa4-4854-b57a-2750d41013bb tempest-GroupSnapshotsV319Test-936336535 None] Group tempest-GroupSnapshotsV319Test-Group-115840496: creating Nov 03 20:21:10 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-7e7686b2-0fa4-4854-b57a-2750d41013bb tempest-GroupSnapshotsV319Test-936336535 None] Group tempest-GroupSnapshotsV319Test-Group-115840496: created successfully Nov 03 20:21:10 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-7e7686b2-0fa4-4854-b57a-2750d41013bb tempest-GroupSnapshotsV319Test-936336535 None] Create group completed successfully. Nov 03 20:21:10 devstack sudo[92618]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-bb73d9f4-84d3-489b-8a9c-76a114a2525a tempest-GroupsTest-342520804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63146ce8-38c1-43e1-b60e-a33266f7b429 1073741824" returned: 0 in 0.473s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-bb73d9f4-84d3-489b-8a9c-76a114a2525a tempest-GroupsTest-342520804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63146ce8-38c1-43e1-b60e-a33266f7b429 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:11 devstack sudo[92624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63146ce8-38c1-43e1-b60e-a33266f7b429 Nov 03 20:21:11 devstack sudo[92624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:11 devstack sudo[92624]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-bb73d9f4-84d3-489b-8a9c-76a114a2525a tempest-GroupsTest-342520804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63146ce8-38c1-43e1-b60e-a33266f7b429" returned: 0 in 0.277s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:11 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-bb73d9f4-84d3-489b-8a9c-76a114a2525a tempest-GroupsTest-342520804 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:21:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-bb73d9f4-84d3-489b-8a9c-76a114a2525a tempest-GroupsTest-342520804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.769s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:11 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-558282498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bbd0803-74df-43c1-a49e-75f29e4f1597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45424ab9fd1245dc853d8bd68503846e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:21:08Z,use_quota=True,user_id='e2249889f62c48e3bfb18526317bb6e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:21:11 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Creating volume 6bbd0803-74df-43c1-a49e-75f29e4f1597 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:21:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:11 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:21:11 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:21:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:11 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:21:11 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:21:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6bbd0803-74df-43c1-a49e-75f29e4f1597 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:11 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-bb73d9f4-84d3-489b-8a9c-76a114a2525a tempest-GroupsTest-342520804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3292e45-7f4a-4d0d-992d-e7798679064b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63146ce8-38c1-43e1-b60e-a33266f7b429', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:11 devstack sudo[92627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6bbd0803-74df-43c1-a49e-75f29e4f1597 1073741824 Nov 03 20:21:11 devstack sudo[92627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:11 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-bb73d9f4-84d3-489b-8a9c-76a114a2525a tempest-GroupsTest-342520804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d428a056-7620-44bf-a962-724162ed634e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:11 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-bb73d9f4-84d3-489b-8a9c-76a114a2525a tempest-GroupsTest-342520804 None] Volume volume-63146ce8-38c1-43e1-b60e-a33266f7b429 (63146ce8-38c1-43e1-b60e-a33266f7b429): created successfully Nov 03 20:21:11 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-bb73d9f4-84d3-489b-8a9c-76a114a2525a tempest-GroupsTest-342520804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d428a056-7620-44bf-a962-724162ed634e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:11 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-bb73d9f4-84d3-489b-8a9c-76a114a2525a tempest-GroupsTest-342520804 None] Flow 'volume_create_manager' (b14bc03a-ce42-4f00-817a-09868858b683) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:21:11 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-bb73d9f4-84d3-489b-8a9c-76a114a2525a tempest-GroupsTest-342520804 None] Created volume successfully. Nov 03 20:21:11 devstack sudo[92627]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6bbd0803-74df-43c1-a49e-75f29e4f1597 1073741824" returned: 0 in 0.422s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6bbd0803-74df-43c1-a49e-75f29e4f1597 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:11 devstack sudo[92634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6bbd0803-74df-43c1-a49e-75f29e4f1597 Nov 03 20:21:11 devstack sudo[92634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:11 devstack sudo[92634]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6bbd0803-74df-43c1-a49e-75f29e4f1597" returned: 0 in 0.254s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:11 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:21:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-265e94ff-c8d4-49fc-bf43-26d3cb9293de tempest-VolumesTestJSON-835164019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.404s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:11 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-265e94ff-c8d4-49fc-bf43-26d3cb9293de tempest-VolumesTestJSON-835164019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1501752156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd54e463-c5ad-471d-8c27-a8485488cd41,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c8ae52b66632435fbdb34fc16a24e611',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:21:10Z,use_quota=True,user_id='52b7f283610e49b5ab7fd6b994632772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:21:11 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-265e94ff-c8d4-49fc-bf43-26d3cb9293de tempest-VolumesTestJSON-835164019 None] Creating volume cd54e463-c5ad-471d-8c27-a8485488cd41 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:21:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-265e94ff-c8d4-49fc-bf43-26d3cb9293de tempest-VolumesTestJSON-835164019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-265e94ff-c8d4-49fc-bf43-26d3cb9293de tempest-VolumesTestJSON-835164019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:12 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-265e94ff-c8d4-49fc-bf43-26d3cb9293de tempest-VolumesTestJSON-835164019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:21:12 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-265e94ff-c8d4-49fc-bf43-26d3cb9293de tempest-VolumesTestJSON-835164019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:21:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-265e94ff-c8d4-49fc-bf43-26d3cb9293de tempest-VolumesTestJSON-835164019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:12 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-265e94ff-c8d4-49fc-bf43-26d3cb9293de tempest-VolumesTestJSON-835164019 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:21:12 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-265e94ff-c8d4-49fc-bf43-26d3cb9293de tempest-VolumesTestJSON-835164019 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:21:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-265e94ff-c8d4-49fc-bf43-26d3cb9293de tempest-VolumesTestJSON-835164019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cd54e463-c5ad-471d-8c27-a8485488cd41 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:12 devstack sudo[92637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cd54e463-c5ad-471d-8c27-a8485488cd41 1073741824 Nov 03 20:21:12 devstack sudo[92637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:12 devstack cinder-volume[87248]: DEBUG cinder.volume.volume_utils [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Attempting download of 346de059-5b9a-438e-a6dd-24e9fc9a1ee3 ((None, [{'url': 'file:///opt/stack/data/glance/images/346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'metadata': {}}])) to volume 6bbd0803-74df-43c1-a49e-75f29e4f1597. {{(pid=87248) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 20:21:12 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[814cbf6e-92c0-4165-bd8e-5329ff96de49]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:21:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_e53is9ws {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:12 devstack sudo[92639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_e53is9ws Nov 03 20:21:12 devstack sudo[92639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:12 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-672e3daf-e7fb-41e5-b94d-09ec7829a31f tempest-GroupSnapshotsV319Test-936336535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:21:12 devstack sudo[92639]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-672e3daf-e7fb-41e5-b94d-09ec7829a31f tempest-GroupSnapshotsV319Test-936336535 None] Flow 'volume_create_manager' (b7c863c0-7dd7-4e3b-8bea-9a8bdee31a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:21:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-672e3daf-e7fb-41e5-b94d-09ec7829a31f tempest-GroupSnapshotsV319Test-936336535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ac241e7-9537-4b87-b7e7-a69641d6b8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_e53is9ws" returned: 0 in 0.487s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_e53is9ws {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-672e3daf-e7fb-41e5-b94d-09ec7829a31f tempest-GroupSnapshotsV319Test-936336535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ac241e7-9537-4b87-b7e7-a69641d6b8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2009334447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3e6e3e0f-861c-4139-be73-e0b8e0f3b103,host='devstack@QuobyteHD#QuobyteHD',id=56f1b6fe-e6fd-45f8-b92d-75ccc800d65c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb5d2361c74947c59dd53c355a0865e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:21:12Z,use_quota=True,user_id='b594cb5503e345e0a8cb9da2babe73e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14e543ec-ab8c-45d8-88df-db9e4806b7c8),volume_type_id=14e543ec-ab8c-45d8-88df-db9e4806b7c8)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-672e3daf-e7fb-41e5-b94d-09ec7829a31f tempest-GroupSnapshotsV319Test-936336535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13d72c21-e23b-49ae-bead-b0969f94012b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-672e3daf-e7fb-41e5-b94d-09ec7829a31f tempest-GroupSnapshotsV319Test-936336535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13d72c21-e23b-49ae-bead-b0969f94012b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:12 devstack sudo[92637]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-672e3daf-e7fb-41e5-b94d-09ec7829a31f tempest-GroupSnapshotsV319Test-936336535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df6ce985-3d53-414a-aa41-c5d52c43c8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-672e3daf-e7fb-41e5-b94d-09ec7829a31f tempest-GroupSnapshotsV319Test-936336535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df6ce985-3d53-414a-aa41-c5d52c43c8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56f1b6fe-e6fd-45f8-b92d-75ccc800d65c', 'volume_name': 'volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-672e3daf-e7fb-41e5-b94d-09ec7829a31f tempest-GroupSnapshotsV319Test-936336535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d831ac5f-0783-43d7-8931-0895f5ca2cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-672e3daf-e7fb-41e5-b94d-09ec7829a31f tempest-GroupSnapshotsV319Test-936336535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d831ac5f-0783-43d7-8931-0895f5ca2cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-672e3daf-e7fb-41e5-b94d-09ec7829a31f tempest-GroupSnapshotsV319Test-936336535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b6269b6-8561-4c2f-a46f-e4b88defb9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:12 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-672e3daf-e7fb-41e5-b94d-09ec7829a31f tempest-GroupSnapshotsV319Test-936336535 None] Volume 56f1b6fe-e6fd-45f8-b92d-75ccc800d65c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c', 'volume_size': 1} Nov 03 20:21:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-672e3daf-e7fb-41e5-b94d-09ec7829a31f tempest-GroupSnapshotsV319Test-936336535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-265e94ff-c8d4-49fc-bf43-26d3cb9293de tempest-VolumesTestJSON-835164019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cd54e463-c5ad-471d-8c27-a8485488cd41 1073741824" returned: 0 in 0.668s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-265e94ff-c8d4-49fc-bf43-26d3cb9293de tempest-VolumesTestJSON-835164019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cd54e463-c5ad-471d-8c27-a8485488cd41 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:12 devstack sudo[92648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_e53is9ws Nov 03 20:21:12 devstack sudo[92648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:12 devstack sudo[92649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cd54e463-c5ad-471d-8c27-a8485488cd41 Nov 03 20:21:12 devstack sudo[92649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:12 devstack sudo[92648]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_e53is9ws" returned: 1 in 0.367s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_e53is9ws' failed. Not Retrying. {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 20:21:12 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[b136ba64-3ebb-4ee1-b016-37d2625035b4]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:21:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_4ko4vfg1devstack@QuobyteHD {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:13 devstack sudo[92649]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-265e94ff-c8d4-49fc-bf43-26d3cb9293de tempest-VolumesTestJSON-835164019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cd54e463-c5ad-471d-8c27-a8485488cd41" returned: 0 in 0.326s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:13 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-265e94ff-c8d4-49fc-bf43-26d3cb9293de tempest-VolumesTestJSON-835164019 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:21:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-265e94ff-c8d4-49fc-bf43-26d3cb9293de tempest-VolumesTestJSON-835164019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-672e3daf-e7fb-41e5-b94d-09ec7829a31f tempest-GroupSnapshotsV319Test-936336535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.371s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:13 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-672e3daf-e7fb-41e5-b94d-09ec7829a31f tempest-GroupSnapshotsV319Test-936336535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3e6e3e0f-861c-4139-be73-e0b8e0f3b103,created_at=2026-11-03T19:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2009334447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3e6e3e0f-861c-4139-be73-e0b8e0f3b103,host='devstack@QuobyteHD#QuobyteHD',id=56f1b6fe-e6fd-45f8-b92d-75ccc800d65c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb5d2361c74947c59dd53c355a0865e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:21:12Z,use_quota=True,user_id='b594cb5503e345e0a8cb9da2babe73e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14e543ec-ab8c-45d8-88df-db9e4806b7c8),volume_type_id=14e543ec-ab8c-45d8-88df-db9e4806b7c8)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:21:13 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-672e3daf-e7fb-41e5-b94d-09ec7829a31f tempest-GroupSnapshotsV319Test-936336535 None] Creating volume 56f1b6fe-e6fd-45f8-b92d-75ccc800d65c {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:21:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-672e3daf-e7fb-41e5-b94d-09ec7829a31f tempest-GroupSnapshotsV319Test-936336535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-672e3daf-e7fb-41e5-b94d-09ec7829a31f tempest-GroupSnapshotsV319Test-936336535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:13 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-672e3daf-e7fb-41e5-b94d-09ec7829a31f tempest-GroupSnapshotsV319Test-936336535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:21:13 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-672e3daf-e7fb-41e5-b94d-09ec7829a31f tempest-GroupSnapshotsV319Test-936336535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:21:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-672e3daf-e7fb-41e5-b94d-09ec7829a31f tempest-GroupSnapshotsV319Test-936336535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:13 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-672e3daf-e7fb-41e5-b94d-09ec7829a31f tempest-GroupSnapshotsV319Test-936336535 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:21:13 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-672e3daf-e7fb-41e5-b94d-09ec7829a31f tempest-GroupSnapshotsV319Test-936336535 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:21:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-672e3daf-e7fb-41e5-b94d-09ec7829a31f tempest-GroupSnapshotsV319Test-936336535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:13 devstack sudo[92656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c 1073741824 Nov 03 20:21:13 devstack sudo[92656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-265e94ff-c8d4-49fc-bf43-26d3cb9293de tempest-VolumesTestJSON-835164019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e3b6c3-e9cc-4c66-b83c-fa0066d5feec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd54e463-c5ad-471d-8c27-a8485488cd41', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-265e94ff-c8d4-49fc-bf43-26d3cb9293de tempest-VolumesTestJSON-835164019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08cf6f3e-8283-44f6-abbf-2023d149ec15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:13 devstack sudo[92655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_4ko4vfg1devstack@QuobyteHD Nov 03 20:21:13 devstack sudo[92655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:13 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-265e94ff-c8d4-49fc-bf43-26d3cb9293de tempest-VolumesTestJSON-835164019 None] Volume volume-cd54e463-c5ad-471d-8c27-a8485488cd41 (cd54e463-c5ad-471d-8c27-a8485488cd41): created successfully Nov 03 20:21:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-265e94ff-c8d4-49fc-bf43-26d3cb9293de tempest-VolumesTestJSON-835164019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08cf6f3e-8283-44f6-abbf-2023d149ec15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-265e94ff-c8d4-49fc-bf43-26d3cb9293de tempest-VolumesTestJSON-835164019 None] Flow 'volume_create_manager' (cee17b5f-7617-46c0-96fd-961286c9384b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:21:13 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-265e94ff-c8d4-49fc-bf43-26d3cb9293de tempest-VolumesTestJSON-835164019 None] Created volume successfully. Nov 03 20:21:13 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dba4c46-e6fa-425b-9c70-21f769c0d054 tempest-GroupsTest-342520804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:21:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0dba4c46-e6fa-425b-9c70-21f769c0d054 tempest-GroupsTest-342520804 None] Flow 'volume_create_manager' (c081a555-ac7b-4183-a43a-0dfa92d42611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:21:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0dba4c46-e6fa-425b-9c70-21f769c0d054 tempest-GroupsTest-342520804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47e1034a-3d51-4ba9-86af-3ea2ae4b436c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0dba4c46-e6fa-425b-9c70-21f769c0d054 tempest-GroupsTest-342520804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47e1034a-3d51-4ba9-86af-3ea2ae4b436c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1871391436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=592f34f3-f1fc-4da5-b780-4043b87404b7,host='devstack@QuobyteHD#QuobyteHD',id=aff2dbb3-a04e-4bbf-b30a-1014eadebcd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8257cdc0a18148fb8e8b8a2c502f493a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:21:13Z,use_quota=True,user_id='ed284cf8d19b4490b48609c3beac51d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eb6ad85b-cafc-448b-a588-f740ba784b4d),volume_type_id=eb6ad85b-cafc-448b-a588-f740ba784b4d)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0dba4c46-e6fa-425b-9c70-21f769c0d054 tempest-GroupsTest-342520804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf2e40b-d10b-4bd3-b7b6-872d0b1ed792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0dba4c46-e6fa-425b-9c70-21f769c0d054 tempest-GroupsTest-342520804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf2e40b-d10b-4bd3-b7b6-872d0b1ed792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0dba4c46-e6fa-425b-9c70-21f769c0d054 tempest-GroupsTest-342520804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e780201-e863-43d0-90c3-1f9b906e922c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0dba4c46-e6fa-425b-9c70-21f769c0d054 tempest-GroupsTest-342520804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e780201-e863-43d0-90c3-1f9b906e922c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aff2dbb3-a04e-4bbf-b30a-1014eadebcd9', 'volume_name': 'volume-aff2dbb3-a04e-4bbf-b30a-1014eadebcd9', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0dba4c46-e6fa-425b-9c70-21f769c0d054 tempest-GroupsTest-342520804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0023c1ff-aeb6-4b29-8200-af859436ad09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0dba4c46-e6fa-425b-9c70-21f769c0d054 tempest-GroupsTest-342520804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0023c1ff-aeb6-4b29-8200-af859436ad09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0dba4c46-e6fa-425b-9c70-21f769c0d054 tempest-GroupsTest-342520804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f4a5a46-8fe2-47dc-8e84-b4ff6e3359c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:13 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-0dba4c46-e6fa-425b-9c70-21f769c0d054 tempest-GroupsTest-342520804 None] Volume aff2dbb3-a04e-4bbf-b30a-1014eadebcd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aff2dbb3-a04e-4bbf-b30a-1014eadebcd9', 'volume_size': 1} Nov 03 20:21:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-0dba4c46-e6fa-425b-9c70-21f769c0d054 tempest-GroupsTest-342520804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:13 devstack sudo[92655]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_4ko4vfg1devstack@QuobyteHD" returned: 0 in 0.464s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:13 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] 346de059-5b9a-438e-a6dd-24e9fc9a1ee3 was qcow2, converting to qcow2 {{(pid=87248) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 20:21:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_4ko4vfg1devstack@QuobyteHD /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6bbd0803-74df-43c1-a49e-75f29e4f1597 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:13 devstack sudo[92665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_4ko4vfg1devstack@QuobyteHD /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6bbd0803-74df-43c1-a49e-75f29e4f1597 Nov 03 20:21:13 devstack sudo[92665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:13 devstack sudo[92656]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-672e3daf-e7fb-41e5-b94d-09ec7829a31f tempest-GroupSnapshotsV319Test-936336535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c 1073741824" returned: 0 in 0.590s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-672e3daf-e7fb-41e5-b94d-09ec7829a31f tempest-GroupSnapshotsV319Test-936336535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:13 devstack sudo[92672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c Nov 03 20:21:13 devstack sudo[92672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:14 devstack sudo[92672]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-672e3daf-e7fb-41e5-b94d-09ec7829a31f tempest-GroupSnapshotsV319Test-936336535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c" returned: 0 in 0.340s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:14 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-672e3daf-e7fb-41e5-b94d-09ec7829a31f tempest-GroupSnapshotsV319Test-936336535 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:21:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-672e3daf-e7fb-41e5-b94d-09ec7829a31f tempest-GroupSnapshotsV319Test-936336535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-0dba4c46-e6fa-425b-9c70-21f769c0d054 tempest-GroupsTest-342520804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.708s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:14 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-0dba4c46-e6fa-425b-9c70-21f769c0d054 tempest-GroupsTest-342520804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=592f34f3-f1fc-4da5-b780-4043b87404b7,created_at=2026-11-03T19:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1871391436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=592f34f3-f1fc-4da5-b780-4043b87404b7,host='devstack@QuobyteHD#QuobyteHD',id=aff2dbb3-a04e-4bbf-b30a-1014eadebcd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8257cdc0a18148fb8e8b8a2c502f493a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:21:13Z,use_quota=True,user_id='ed284cf8d19b4490b48609c3beac51d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eb6ad85b-cafc-448b-a588-f740ba784b4d),volume_type_id=eb6ad85b-cafc-448b-a588-f740ba784b4d)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:21:14 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-0dba4c46-e6fa-425b-9c70-21f769c0d054 tempest-GroupsTest-342520804 None] Creating volume aff2dbb3-a04e-4bbf-b30a-1014eadebcd9 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:21:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-0dba4c46-e6fa-425b-9c70-21f769c0d054 tempest-GroupsTest-342520804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-0dba4c46-e6fa-425b-9c70-21f769c0d054 tempest-GroupsTest-342520804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:14 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-0dba4c46-e6fa-425b-9c70-21f769c0d054 tempest-GroupsTest-342520804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:21:14 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-0dba4c46-e6fa-425b-9c70-21f769c0d054 tempest-GroupsTest-342520804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:21:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-0dba4c46-e6fa-425b-9c70-21f769c0d054 tempest-GroupsTest-342520804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:14 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-0dba4c46-e6fa-425b-9c70-21f769c0d054 tempest-GroupsTest-342520804 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:21:14 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-0dba4c46-e6fa-425b-9c70-21f769c0d054 tempest-GroupsTest-342520804 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:21:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-0dba4c46-e6fa-425b-9c70-21f769c0d054 tempest-GroupsTest-342520804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-aff2dbb3-a04e-4bbf-b30a-1014eadebcd9 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:14 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2793738-a2c8-4a32-a1d7-fe79b3f9752e tempest-VolumesTestJSON-835164019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:21:14 devstack sudo[92675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-aff2dbb3-a04e-4bbf-b30a-1014eadebcd9 1073741824 Nov 03 20:21:14 devstack sudo[92675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:14 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b2793738-a2c8-4a32-a1d7-fe79b3f9752e tempest-VolumesTestJSON-835164019 None] Flow 'volume_create_manager' (96d85be6-455d-49f7-97f0-23c3ebc1fc5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:21:14 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b2793738-a2c8-4a32-a1d7-fe79b3f9752e tempest-VolumesTestJSON-835164019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eda2cb24-b52b-4b3b-8612-f396dfb8154e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:14 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-672e3daf-e7fb-41e5-b94d-09ec7829a31f tempest-GroupSnapshotsV319Test-936336535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b6269b6-8561-4c2f-a46f-e4b88defb9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:14 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-672e3daf-e7fb-41e5-b94d-09ec7829a31f tempest-GroupSnapshotsV319Test-936336535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d9c68e-f3b6-4ebe-ad8e-9ba49b9f9348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:14 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b2793738-a2c8-4a32-a1d7-fe79b3f9752e tempest-VolumesTestJSON-835164019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eda2cb24-b52b-4b3b-8612-f396dfb8154e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1317452558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe9f5579-d160-4efb-930a-1d7224d87969,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c8ae52b66632435fbdb34fc16a24e611',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:21:14Z,use_quota=True,user_id='52b7f283610e49b5ab7fd6b994632772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:14 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b2793738-a2c8-4a32-a1d7-fe79b3f9752e tempest-VolumesTestJSON-835164019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2e83bd5-ce25-422d-8dcb-5f135ba229cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:14 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b2793738-a2c8-4a32-a1d7-fe79b3f9752e tempest-VolumesTestJSON-835164019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2e83bd5-ce25-422d-8dcb-5f135ba229cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:14 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b2793738-a2c8-4a32-a1d7-fe79b3f9752e tempest-VolumesTestJSON-835164019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e56b2d9-148a-4848-9710-d69539814b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:14 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b2793738-a2c8-4a32-a1d7-fe79b3f9752e tempest-VolumesTestJSON-835164019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e56b2d9-148a-4848-9710-d69539814b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe9f5579-d160-4efb-930a-1d7224d87969', 'volume_name': 'volume-fe9f5579-d160-4efb-930a-1d7224d87969', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:14 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b2793738-a2c8-4a32-a1d7-fe79b3f9752e tempest-VolumesTestJSON-835164019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adfe84b4-f0c0-49dd-8c84-9627c1d2610d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:14 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b2793738-a2c8-4a32-a1d7-fe79b3f9752e tempest-VolumesTestJSON-835164019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adfe84b4-f0c0-49dd-8c84-9627c1d2610d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:14 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b2793738-a2c8-4a32-a1d7-fe79b3f9752e tempest-VolumesTestJSON-835164019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64e70e58-43dd-48a5-ad0b-44288dda972e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:14 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-b2793738-a2c8-4a32-a1d7-fe79b3f9752e tempest-VolumesTestJSON-835164019 None] Volume fe9f5579-d160-4efb-930a-1d7224d87969: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe9f5579-d160-4efb-930a-1d7224d87969', 'volume_size': 1} Nov 03 20:21:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b2793738-a2c8-4a32-a1d7-fe79b3f9752e tempest-VolumesTestJSON-835164019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:14 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-672e3daf-e7fb-41e5-b94d-09ec7829a31f tempest-GroupSnapshotsV319Test-936336535 None] Volume volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c (56f1b6fe-e6fd-45f8-b92d-75ccc800d65c): created successfully Nov 03 20:21:14 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-672e3daf-e7fb-41e5-b94d-09ec7829a31f tempest-GroupSnapshotsV319Test-936336535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d9c68e-f3b6-4ebe-ad8e-9ba49b9f9348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:14 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-672e3daf-e7fb-41e5-b94d-09ec7829a31f tempest-GroupSnapshotsV319Test-936336535 None] Flow 'volume_create_manager' (b7c863c0-7dd7-4e3b-8bea-9a8bdee31a47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:21:14 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-672e3daf-e7fb-41e5-b94d-09ec7829a31f tempest-GroupSnapshotsV319Test-936336535 None] Created volume successfully. Nov 03 20:21:14 devstack sudo[92675]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-0dba4c46-e6fa-425b-9c70-21f769c0d054 tempest-GroupsTest-342520804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-aff2dbb3-a04e-4bbf-b30a-1014eadebcd9 1073741824" returned: 0 in 0.567s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-0dba4c46-e6fa-425b-9c70-21f769c0d054 tempest-GroupsTest-342520804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-aff2dbb3-a04e-4bbf-b30a-1014eadebcd9 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:14 devstack sudo[92684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-aff2dbb3-a04e-4bbf-b30a-1014eadebcd9 Nov 03 20:21:14 devstack sudo[92684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:14 devstack sudo[92684]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-0dba4c46-e6fa-425b-9c70-21f769c0d054 tempest-GroupsTest-342520804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-aff2dbb3-a04e-4bbf-b30a-1014eadebcd9" returned: 0 in 0.301s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:14 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-0dba4c46-e6fa-425b-9c70-21f769c0d054 tempest-GroupsTest-342520804 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:21:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-0dba4c46-e6fa-425b-9c70-21f769c0d054 tempest-GroupsTest-342520804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b2793738-a2c8-4a32-a1d7-fe79b3f9752e tempest-VolumesTestJSON-835164019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.766s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:14 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-b2793738-a2c8-4a32-a1d7-fe79b3f9752e tempest-VolumesTestJSON-835164019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1317452558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe9f5579-d160-4efb-930a-1d7224d87969,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c8ae52b66632435fbdb34fc16a24e611',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:21:14Z,use_quota=True,user_id='52b7f283610e49b5ab7fd6b994632772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:21:14 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-b2793738-a2c8-4a32-a1d7-fe79b3f9752e tempest-VolumesTestJSON-835164019 None] Creating volume fe9f5579-d160-4efb-930a-1d7224d87969 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:21:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b2793738-a2c8-4a32-a1d7-fe79b3f9752e tempest-VolumesTestJSON-835164019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b2793738-a2c8-4a32-a1d7-fe79b3f9752e tempest-VolumesTestJSON-835164019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:14 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-b2793738-a2c8-4a32-a1d7-fe79b3f9752e tempest-VolumesTestJSON-835164019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:21:14 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-b2793738-a2c8-4a32-a1d7-fe79b3f9752e tempest-VolumesTestJSON-835164019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:21:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b2793738-a2c8-4a32-a1d7-fe79b3f9752e tempest-VolumesTestJSON-835164019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:14 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-b2793738-a2c8-4a32-a1d7-fe79b3f9752e tempest-VolumesTestJSON-835164019 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:21:14 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-b2793738-a2c8-4a32-a1d7-fe79b3f9752e tempest-VolumesTestJSON-835164019 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:21:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b2793738-a2c8-4a32-a1d7-fe79b3f9752e tempest-VolumesTestJSON-835164019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-fe9f5579-d160-4efb-930a-1d7224d87969 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0dba4c46-e6fa-425b-9c70-21f769c0d054 tempest-GroupsTest-342520804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f4a5a46-8fe2-47dc-8e84-b4ff6e3359c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aff2dbb3-a04e-4bbf-b30a-1014eadebcd9', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0dba4c46-e6fa-425b-9c70-21f769c0d054 tempest-GroupsTest-342520804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71bf3ab5-0874-4680-a9f5-738250195d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:15 devstack sudo[92689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-fe9f5579-d160-4efb-930a-1d7224d87969 1073741824 Nov 03 20:21:15 devstack sudo[92689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:15 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-0dba4c46-e6fa-425b-9c70-21f769c0d054 tempest-GroupsTest-342520804 None] Volume volume-aff2dbb3-a04e-4bbf-b30a-1014eadebcd9 (aff2dbb3-a04e-4bbf-b30a-1014eadebcd9): created successfully Nov 03 20:21:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0dba4c46-e6fa-425b-9c70-21f769c0d054 tempest-GroupsTest-342520804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71bf3ab5-0874-4680-a9f5-738250195d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0dba4c46-e6fa-425b-9c70-21f769c0d054 tempest-GroupsTest-342520804 None] Flow 'volume_create_manager' (c081a555-ac7b-4183-a43a-0dfa92d42611) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:21:15 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-0dba4c46-e6fa-425b-9c70-21f769c0d054 tempest-GroupsTest-342520804 None] Created volume successfully. Nov 03 20:21:15 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-f32e2f0a-a03e-412a-b7fa-27a1d4416462 tempest-GroupSnapshotsV319Test-936336535 None] GroupSnapshot 0488218a-5a0f-4845-9561-a678b3725639: creating. Nov 03 20:21:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f32e2f0a-a03e-412a-b7fa-27a1d4416462 tempest-GroupSnapshotsV319Test-936336535 None] Group snapshot 0488218a-5a0f-4845-9561-a678b3725639: creating. {{(pid=87248) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 20:21:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f32e2f0a-a03e-412a-b7fa-27a1d4416462 tempest-GroupSnapshotsV319Test-936336535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:15 devstack sudo[92689]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b2793738-a2c8-4a32-a1d7-fe79b3f9752e tempest-VolumesTestJSON-835164019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-fe9f5579-d160-4efb-930a-1d7224d87969 1073741824" returned: 0 in 0.574s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:15 devstack sudo[92665]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_4ko4vfg1devstack@QuobyteHD /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6bbd0803-74df-43c1-a49e-75f29e4f1597" returned: 0 in 2.151s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:15 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_4ko4vfg1devstack@QuobyteHD, size 112.00 MB, duration 2.15 sec, destination /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6bbd0803-74df-43c1-a49e-75f29e4f1597 {{(pid=87248) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:21:15 devstack cinder-volume[87248]: INFO cinder.image.image_utils [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Converted 112.00 MB image at 52.03 MB/s Nov 03 20:21:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6bbd0803-74df-43c1-a49e-75f29e4f1597 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b2793738-a2c8-4a32-a1d7-fe79b3f9752e tempest-VolumesTestJSON-835164019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-fe9f5579-d160-4efb-930a-1d7224d87969 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:15 devstack sudo[92695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6bbd0803-74df-43c1-a49e-75f29e4f1597 1G Nov 03 20:21:15 devstack sudo[92695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:15 devstack sudo[92697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-fe9f5579-d160-4efb-930a-1d7224d87969 Nov 03 20:21:15 devstack sudo[92697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:15 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-ba04d73d-37b4-42e5-bfdb-7d2c4e69a02a tempest-GroupsTest-342520804 None] Update group completed successfully. Nov 03 20:21:15 devstack sudo[92697]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b2793738-a2c8-4a32-a1d7-fe79b3f9752e tempest-VolumesTestJSON-835164019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-fe9f5579-d160-4efb-930a-1d7224d87969" returned: 0 in 0.283s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:15 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-b2793738-a2c8-4a32-a1d7-fe79b3f9752e tempest-VolumesTestJSON-835164019 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:21:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b2793738-a2c8-4a32-a1d7-fe79b3f9752e tempest-VolumesTestJSON-835164019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f32e2f0a-a03e-412a-b7fa-27a1d4416462 tempest-GroupSnapshotsV319Test-936336535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.703s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:15 devstack sudo[92695]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b2793738-a2c8-4a32-a1d7-fe79b3f9752e tempest-VolumesTestJSON-835164019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64e70e58-43dd-48a5-ad0b-44288dda972e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe9f5579-d160-4efb-930a-1d7224d87969', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b2793738-a2c8-4a32-a1d7-fe79b3f9752e tempest-VolumesTestJSON-835164019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3352a8a-2cd7-4015-9f56-32a0c2131710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6bbd0803-74df-43c1-a49e-75f29e4f1597 1G" returned: 0 in 0.339s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:15 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-f32e2f0a-a03e-412a-b7fa-27a1d4416462 tempest-GroupSnapshotsV319Test-936336535 None] Creating offline snapshot 0a385959-8e3e-4af5-b37b-969ec1e39dac of volume 56f1b6fe-e6fd-45f8-b92d-75ccc800d65c {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:21:15 devstack cinder-volume[87248]: DEBUG cinder.volume.volume_utils [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Downloaded image 346de059-5b9a-438e-a6dd-24e9fc9a1ee3 ((None, [{'url': 'file:///opt/stack/data/glance/images/346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'metadata': {}}])) to volume 6bbd0803-74df-43c1-a49e-75f29e4f1597 successfully. {{(pid=87248) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 20:21:15 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Temporary image 346de059-5b9a-438e-a6dd-24e9fc9a1ee3 for user e2249889f62c48e3bfb18526317bb6e4 is deleted. {{(pid=87248) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 20:21:15 devstack cinder-volume[87248]: DEBUG cinder.volume.volume_utils [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Marking volume 6bbd0803-74df-43c1-a49e-75f29e4f1597 as bootable. {{(pid=87248) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 20:21:15 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-b2793738-a2c8-4a32-a1d7-fe79b3f9752e tempest-VolumesTestJSON-835164019 None] Volume volume-fe9f5579-d160-4efb-930a-1d7224d87969 (fe9f5579-d160-4efb-930a-1d7224d87969): created successfully Nov 03 20:21:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b2793738-a2c8-4a32-a1d7-fe79b3f9752e tempest-VolumesTestJSON-835164019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3352a8a-2cd7-4015-9f56-32a0c2131710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b2793738-a2c8-4a32-a1d7-fe79b3f9752e tempest-VolumesTestJSON-835164019 None] Flow 'volume_create_manager' (96d85be6-455d-49f7-97f0-23c3ebc1fc5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:21:15 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbea9410-3add-4501-a889-0099fee96376]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:21:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f32e2f0a-a03e-412a-b7fa-27a1d4416462 tempest-GroupSnapshotsV319Test-936336535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:15 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Copying metadata from image 346de059-5b9a-438e-a6dd-24e9fc9a1ee3 to 6bbd0803-74df-43c1-a49e-75f29e4f1597. {{(pid=87248) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 20:21:15 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Creating volume glance metadata for volume 6bbd0803-74df-43c1-a49e-75f29e4f1597 backed by image 346de059-5b9a-438e-a6dd-24e9fc9a1ee3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87248) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 20:21:16 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-b2793738-a2c8-4a32-a1d7-fe79b3f9752e tempest-VolumesTestJSON-835164019 None] Created volume successfully. Nov 03 20:21:16 devstack sudo[92703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c Nov 03 20:21:16 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2642d955-6902-425b-ae1b-9b4e0d53e15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bbd0803-74df-43c1-a49e-75f29e4f1597', 'volume_size': 1, 'image_id': '346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a647f64245a54dad95167f6d04c75eaa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'created_at': datetime.datetime(2026, 11, 3, 19, 11, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 11, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/346de059-5b9a-438e-a6dd-24e9fc9a1ee3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:16 devstack sudo[92703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:16 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37ef5c4e-736a-4211-9049-7fe46c2d765c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:16 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Volume volume-6bbd0803-74df-43c1-a49e-75f29e4f1597 (6bbd0803-74df-43c1-a49e-75f29e4f1597): created successfully Nov 03 20:21:16 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37ef5c4e-736a-4211-9049-7fe46c2d765c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:16 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Flow 'volume_create_manager' (3bf42f5a-e42c-4172-a642-5926511a4c2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:21:16 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-6904b7b9-0486-4e91-98c7-0f7082a40711 tempest-ServerActionsTestOtherA-836700016 None] Created volume successfully. Nov 03 20:21:16 devstack sudo[92703]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f32e2f0a-a03e-412a-b7fa-27a1d4416462 tempest-GroupSnapshotsV319Test-936336535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c" returned: 0 in 0.383s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f32e2f0a-a03e-412a-b7fa-27a1d4416462 tempest-GroupSnapshotsV319Test-936336535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c.0a385959-8e3e-4af5-b37b-969ec1e39dac 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:16 devstack sudo[92708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c.0a385959-8e3e-4af5-b37b-969ec1e39dac 1G Nov 03 20:21:16 devstack sudo[92708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:16 devstack sudo[92708]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f32e2f0a-a03e-412a-b7fa-27a1d4416462 tempest-GroupSnapshotsV319Test-936336535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c.0a385959-8e3e-4af5-b37b-969ec1e39dac 1G" returned: 0 in 0.571s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f32e2f0a-a03e-412a-b7fa-27a1d4416462 tempest-GroupSnapshotsV319Test-936336535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c.0a385959-8e3e-4af5-b37b-969ec1e39dac {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:16 devstack sudo[92714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c.0a385959-8e3e-4af5-b37b-969ec1e39dac Nov 03 20:21:16 devstack sudo[92714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:17 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a58efcc1-58cd-4bc6-b031-bd77b1a90e13 tempest-VolumesTestJSON-835164019 None] Acquiring lock "cinder-fe9f5579-d160-4efb-930a-1d7224d87969-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:21:17 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a58efcc1-58cd-4bc6-b031-bd77b1a90e13 tempest-VolumesTestJSON-835164019 None] Lock "cinder-fe9f5579-d160-4efb-930a-1d7224d87969-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:21:17 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a58efcc1-58cd-4bc6-b031-bd77b1a90e13 tempest-VolumesTestJSON-835164019 None] Acquiring lock "cinder-quobyte-fe9f5579-d160-4efb-930a-1d7224d87969" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:21:17 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a58efcc1-58cd-4bc6-b031-bd77b1a90e13 tempest-VolumesTestJSON-835164019 None] Lock "cinder-quobyte-fe9f5579-d160-4efb-930a-1d7224d87969" acquired by "delete_volume" :: waited 0.038s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:21:17 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[13df02dc-0911-47da-ac6d-9887044ca4a7]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:21:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a58efcc1-58cd-4bc6-b031-bd77b1a90e13 tempest-VolumesTestJSON-835164019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-fe9f5579-d160-4efb-930a-1d7224d87969 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:17 devstack sudo[92714]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f32e2f0a-a03e-412a-b7fa-27a1d4416462 tempest-GroupSnapshotsV319Test-936336535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c.0a385959-8e3e-4af5-b37b-969ec1e39dac" returned: 0 in 0.493s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:17 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-c803c5fa-1698-43f9-bd3b-6a6fa6889279 tempest-GroupsTest-342520804 None] Update group completed successfully. Nov 03 20:21:17 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-f32e2f0a-a03e-412a-b7fa-27a1d4416462 tempest-GroupSnapshotsV319Test-936336535 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c.0a385959-8e3e-4af5-b37b-969ec1e39dac is being set with open permissions: ugo+rw: NotImplementedError Nov 03 20:21:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f32e2f0a-a03e-412a-b7fa-27a1d4416462 tempest-GroupSnapshotsV319Test-936336535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c.0a385959-8e3e-4af5-b37b-969ec1e39dac {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:17 devstack sudo[92728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c.0a385959-8e3e-4af5-b37b-969ec1e39dac Nov 03 20:21:17 devstack sudo[92728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:17 devstack sudo[92723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-fe9f5579-d160-4efb-930a-1d7224d87969 Nov 03 20:21:17 devstack sudo[92723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:17 devstack sudo[92728]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f32e2f0a-a03e-412a-b7fa-27a1d4416462 tempest-GroupSnapshotsV319Test-936336535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c.0a385959-8e3e-4af5-b37b-969ec1e39dac" returned: 0 in 0.290s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f32e2f0a-a03e-412a-b7fa-27a1d4416462 tempest-GroupSnapshotsV319Test-936336535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:17 devstack sudo[92737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c.info Nov 03 20:21:17 devstack sudo[92737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:17 devstack sudo[92723]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a58efcc1-58cd-4bc6-b031-bd77b1a90e13 tempest-VolumesTestJSON-835164019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-fe9f5579-d160-4efb-930a-1d7224d87969" returned: 0 in 0.464s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a58efcc1-58cd-4bc6-b031-bd77b1a90e13 tempest-VolumesTestJSON-835164019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-fe9f5579-d160-4efb-930a-1d7224d87969 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:17 devstack sudo[92741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-fe9f5579-d160-4efb-930a-1d7224d87969 Nov 03 20:21:17 devstack sudo[92741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:18 devstack sudo[92737]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f32e2f0a-a03e-412a-b7fa-27a1d4416462 tempest-GroupSnapshotsV319Test-936336535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c.info" returned: 0 in 0.411s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:18 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-f32e2f0a-a03e-412a-b7fa-27a1d4416462 tempest-GroupSnapshotsV319Test-936336535 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 20:21:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f32e2f0a-a03e-412a-b7fa-27a1d4416462 tempest-GroupSnapshotsV319Test-936336535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:18 devstack sudo[92741]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a58efcc1-58cd-4bc6-b031-bd77b1a90e13 tempest-VolumesTestJSON-835164019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-fe9f5579-d160-4efb-930a-1d7224d87969" returned: 0 in 0.334s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:18 devstack sudo[92747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c.info Nov 03 20:21:18 devstack sudo[92747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:18 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a58efcc1-58cd-4bc6-b031-bd77b1a90e13 tempest-VolumesTestJSON-835164019 None] Lock "cinder-quobyte-fe9f5579-d160-4efb-930a-1d7224d87969" released by "delete_volume" :: held 0.872s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:21:18 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-a58efcc1-58cd-4bc6-b031-bd77b1a90e13 tempest-VolumesTestJSON-835164019 None] Created reservations ['c4c30305-c713-47e6-821b-4d800f9984f6', '2ff661d2-fa67-49c7-a3bc-1e69e0f6fe9a', 'e686151f-d4d6-42c2-9caa-a49021255641', '727a38a4-7756-4e61-80f4-6617170106c9'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:21:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a58efcc1-58cd-4bc6-b031-bd77b1a90e13 tempest-VolumesTestJSON-835164019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a58efcc1-58cd-4bc6-b031-bd77b1a90e13 tempest-VolumesTestJSON-835164019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:18 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a58efcc1-58cd-4bc6-b031-bd77b1a90e13 tempest-VolumesTestJSON-835164019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:21:18 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a58efcc1-58cd-4bc6-b031-bd77b1a90e13 tempest-VolumesTestJSON-835164019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:21:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a58efcc1-58cd-4bc6-b031-bd77b1a90e13 tempest-VolumesTestJSON-835164019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a58efcc1-58cd-4bc6-b031-bd77b1a90e13 tempest-VolumesTestJSON-835164019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:18 devstack sudo[92747]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f32e2f0a-a03e-412a-b7fa-27a1d4416462 tempest-GroupSnapshotsV319Test-936336535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c.info" returned: 0 in 0.324s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:18 devstack sudo[92750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:21:18 devstack sudo[92750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f32e2f0a-a03e-412a-b7fa-27a1d4416462 tempest-GroupSnapshotsV319Test-936336535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.615s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:18 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-f32e2f0a-a03e-412a-b7fa-27a1d4416462 tempest-GroupSnapshotsV319Test-936336535 None] group_snapshot 0488218a-5a0f-4845-9561-a678b3725639: created successfully Nov 03 20:21:18 devstack sudo[92750]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a58efcc1-58cd-4bc6-b031-bd77b1a90e13 tempest-VolumesTestJSON-835164019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.285s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:18 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-a58efcc1-58cd-4bc6-b031-bd77b1a90e13 tempest-VolumesTestJSON-835164019 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:21:18 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-a58efcc1-58cd-4bc6-b031-bd77b1a90e13 tempest-VolumesTestJSON-835164019 None] Deleted volume successfully. Nov 03 20:21:18 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a58efcc1-58cd-4bc6-b031-bd77b1a90e13 tempest-VolumesTestJSON-835164019 None] Lock "cinder-fe9f5579-d160-4efb-930a-1d7224d87969-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:21:19 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9ad23fab-a0ed-467d-aee4-2781f43e5c14 tempest-GroupsTest-342520804 None] Acquiring lock "cinder-quobyte-63146ce8-38c1-43e1-b60e-a33266f7b429" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:21:19 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9ad23fab-a0ed-467d-aee4-2781f43e5c14 tempest-GroupsTest-342520804 None] Lock "cinder-quobyte-63146ce8-38c1-43e1-b60e-a33266f7b429" acquired by "delete_volume" :: waited 0.025s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:21:19 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba990b6-935e-48cb-9b48-6cc83233602e]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:21:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9ad23fab-a0ed-467d-aee4-2781f43e5c14 tempest-GroupsTest-342520804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63146ce8-38c1-43e1-b60e-a33266f7b429 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:19 devstack sudo[92754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63146ce8-38c1-43e1-b60e-a33266f7b429 Nov 03 20:21:19 devstack sudo[92754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:19 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2c1e01cb-e48f-4b4f-bb65-1617dbe90ab9 tempest-VolumesTestJSON-835164019 None] Acquiring lock "cinder-cd54e463-c5ad-471d-8c27-a8485488cd41-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:21:19 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2c1e01cb-e48f-4b4f-bb65-1617dbe90ab9 tempest-VolumesTestJSON-835164019 None] Lock "cinder-cd54e463-c5ad-471d-8c27-a8485488cd41-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:21:19 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2c1e01cb-e48f-4b4f-bb65-1617dbe90ab9 tempest-VolumesTestJSON-835164019 None] Acquiring lock "cinder-quobyte-cd54e463-c5ad-471d-8c27-a8485488cd41" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:21:19 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2c1e01cb-e48f-4b4f-bb65-1617dbe90ab9 tempest-VolumesTestJSON-835164019 None] Lock "cinder-quobyte-cd54e463-c5ad-471d-8c27-a8485488cd41" acquired by "delete_volume" :: waited 0.030s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:21:19 devstack sudo[92754]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9ad23fab-a0ed-467d-aee4-2781f43e5c14 tempest-GroupsTest-342520804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63146ce8-38c1-43e1-b60e-a33266f7b429" returned: 0 in 0.607s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9ad23fab-a0ed-467d-aee4-2781f43e5c14 tempest-GroupsTest-342520804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63146ce8-38c1-43e1-b60e-a33266f7b429 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:19 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec87575e-8ddf-444e-835d-6910523d1294]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:21:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2c1e01cb-e48f-4b4f-bb65-1617dbe90ab9 tempest-VolumesTestJSON-835164019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cd54e463-c5ad-471d-8c27-a8485488cd41 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:19 devstack sudo[92767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63146ce8-38c1-43e1-b60e-a33266f7b429 Nov 03 20:21:19 devstack sudo[92767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-826d54c8-55ec-4d57-a459-b0ae46c1d3c6 req-06204bf0-3b76-4843-870b-374a75e8744d tempest-ServerActionsTestOtherA-836700016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-826d54c8-55ec-4d57-a459-b0ae46c1d3c6 req-06204bf0-3b76-4843-870b-374a75e8744d tempest-ServerActionsTestOtherA-836700016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-826d54c8-55ec-4d57-a459-b0ae46c1d3c6 req-06204bf0-3b76-4843-870b-374a75e8744d tempest-ServerActionsTestOtherA-836700016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:19 devstack sudo[92768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cd54e463-c5ad-471d-8c27-a8485488cd41 Nov 03 20:21:19 devstack sudo[92768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:19 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-826d54c8-55ec-4d57-a459-b0ae46c1d3c6 req-06204bf0-3b76-4843-870b-374a75e8744d tempest-ServerActionsTestOtherA-836700016 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8', 'name': 'volume-6bbd0803-74df-43c1-a49e-75f29e4f1597', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '90a052b7-bbcc-4808-921c-7fc0644b8ec9', 'enforce_multipath': True} {{(pid=87248) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 20:21:20 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-826d54c8-55ec-4d57-a459-b0ae46c1d3c6 req-06204bf0-3b76-4843-870b-374a75e8744d tempest-ServerActionsTestOtherA-836700016 None] attachment_update completed successfully. Nov 03 20:21:20 devstack sudo[92767]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9ad23fab-a0ed-467d-aee4-2781f43e5c14 tempest-GroupsTest-342520804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63146ce8-38c1-43e1-b60e-a33266f7b429" returned: 0 in 0.491s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:20 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9ad23fab-a0ed-467d-aee4-2781f43e5c14 tempest-GroupsTest-342520804 None] Lock "cinder-quobyte-63146ce8-38c1-43e1-b60e-a33266f7b429" released by "delete_volume" :: held 1.168s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:21:20 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9ad23fab-a0ed-467d-aee4-2781f43e5c14 tempest-GroupsTest-342520804 None] Acquiring lock "cinder-quobyte-aff2dbb3-a04e-4bbf-b30a-1014eadebcd9" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:21:20 devstack sudo[92768]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2c1e01cb-e48f-4b4f-bb65-1617dbe90ab9 tempest-VolumesTestJSON-835164019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cd54e463-c5ad-471d-8c27-a8485488cd41" returned: 0 in 0.538s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2c1e01cb-e48f-4b4f-bb65-1617dbe90ab9 tempest-VolumesTestJSON-835164019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cd54e463-c5ad-471d-8c27-a8485488cd41 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:20 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9ad23fab-a0ed-467d-aee4-2781f43e5c14 tempest-GroupsTest-342520804 None] Lock "cinder-quobyte-aff2dbb3-a04e-4bbf-b30a-1014eadebcd9" acquired by "delete_volume" :: waited 0.053s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:21:20 devstack sudo[92775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cd54e463-c5ad-471d-8c27-a8485488cd41 Nov 03 20:21:20 devstack sudo[92775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:20 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-60369c92-1273-46fe-a92f-0b1c43da3fe2 tempest-GroupSnapshotsV319Test-936336535 None] group_snapshot 0488218a-5a0f-4845-9561-a678b3725639: deleting Nov 03 20:21:20 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ffe709-f449-49a8-90f2-145096f420ab]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:21:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9ad23fab-a0ed-467d-aee4-2781f43e5c14 tempest-GroupsTest-342520804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-aff2dbb3-a04e-4bbf-b30a-1014eadebcd9 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-60369c92-1273-46fe-a92f-0b1c43da3fe2 tempest-GroupSnapshotsV319Test-936336535 None] group_snapshot 0488218a-5a0f-4845-9561-a678b3725639: deleting {{(pid=87248) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 20:21:20 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-60369c92-1273-46fe-a92f-0b1c43da3fe2 tempest-GroupSnapshotsV319Test-936336535 None] Acquiring lock "cinder-quobyte-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:21:20 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-60369c92-1273-46fe-a92f-0b1c43da3fe2 tempest-GroupSnapshotsV319Test-936336535 None] Lock "cinder-quobyte-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:21:20 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-60369c92-1273-46fe-a92f-0b1c43da3fe2 tempest-GroupSnapshotsV319Test-936336535 None] Acquiring lock "cinder-quobyte-0a385959-8e3e-4af5-b37b-969ec1e39dac" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:21:20 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-60369c92-1273-46fe-a92f-0b1c43da3fe2 tempest-GroupSnapshotsV319Test-936336535 None] Lock "cinder-quobyte-0a385959-8e3e-4af5-b37b-969ec1e39dac" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:21:20 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-60369c92-1273-46fe-a92f-0b1c43da3fe2 tempest-GroupSnapshotsV319Test-936336535 None] Deleting offline snapshot 0a385959-8e3e-4af5-b37b-969ec1e39dac of volume 56f1b6fe-e6fd-45f8-b92d-75ccc800d65c {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:21:20 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-60369c92-1273-46fe-a92f-0b1c43da3fe2 tempest-GroupSnapshotsV319Test-936336535 None] snapshot_file for this snap is: volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c.0a385959-8e3e-4af5-b37b-969ec1e39dac {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:21:20 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[1417b68d-1974-4f99-bc34-20095660ad83]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:21:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-60369c92-1273-46fe-a92f-0b1c43da3fe2 tempest-GroupSnapshotsV319Test-936336535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c.0a385959-8e3e-4af5-b37b-969ec1e39dac {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:20 devstack sudo[92777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-aff2dbb3-a04e-4bbf-b30a-1014eadebcd9 Nov 03 20:21:20 devstack sudo[92777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:20 devstack sudo[92775]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2c1e01cb-e48f-4b4f-bb65-1617dbe90ab9 tempest-VolumesTestJSON-835164019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cd54e463-c5ad-471d-8c27-a8485488cd41" returned: 0 in 0.499s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:20 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2c1e01cb-e48f-4b4f-bb65-1617dbe90ab9 tempest-VolumesTestJSON-835164019 None] Lock "cinder-quobyte-cd54e463-c5ad-471d-8c27-a8485488cd41" released by "delete_volume" :: held 1.157s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:21:20 devstack sudo[92778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c.0a385959-8e3e-4af5-b37b-969ec1e39dac Nov 03 20:21:20 devstack sudo[92778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:20 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-2c1e01cb-e48f-4b4f-bb65-1617dbe90ab9 tempest-VolumesTestJSON-835164019 None] Created reservations ['7dcac42a-769c-4696-9176-72f8101a522d', '4b9c06fe-c242-4dfb-873e-25a424d923d3', 'a160042a-54b4-4afa-a8b8-e4518940407d', '9b77e064-2a87-4356-bc8b-d3cafec7d5da'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:21:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2c1e01cb-e48f-4b4f-bb65-1617dbe90ab9 tempest-VolumesTestJSON-835164019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2c1e01cb-e48f-4b4f-bb65-1617dbe90ab9 tempest-VolumesTestJSON-835164019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2c1e01cb-e48f-4b4f-bb65-1617dbe90ab9 tempest-VolumesTestJSON-835164019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:21:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2c1e01cb-e48f-4b4f-bb65-1617dbe90ab9 tempest-VolumesTestJSON-835164019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:21:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2c1e01cb-e48f-4b4f-bb65-1617dbe90ab9 tempest-VolumesTestJSON-835164019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2c1e01cb-e48f-4b4f-bb65-1617dbe90ab9 tempest-VolumesTestJSON-835164019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:21 devstack sudo[92784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:21:21 devstack sudo[92784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:21 devstack sudo[92777]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9ad23fab-a0ed-467d-aee4-2781f43e5c14 tempest-GroupsTest-342520804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-aff2dbb3-a04e-4bbf-b30a-1014eadebcd9" returned: 0 in 0.662s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9ad23fab-a0ed-467d-aee4-2781f43e5c14 tempest-GroupsTest-342520804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-aff2dbb3-a04e-4bbf-b30a-1014eadebcd9 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:21 devstack sudo[92788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-aff2dbb3-a04e-4bbf-b30a-1014eadebcd9 Nov 03 20:21:21 devstack sudo[92788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:21 devstack sudo[92778]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-60369c92-1273-46fe-a92f-0b1c43da3fe2 tempest-GroupSnapshotsV319Test-936336535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c.0a385959-8e3e-4af5-b37b-969ec1e39dac" returned: 0 in 0.605s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-60369c92-1273-46fe-a92f-0b1c43da3fe2 tempest-GroupSnapshotsV319Test-936336535 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:21:21 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[10302d66-5bca-4ed8-9ffd-a9036ad9d6aa]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:21:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-60369c92-1273-46fe-a92f-0b1c43da3fe2 tempest-GroupSnapshotsV319Test-936336535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:21 devstack sudo[92784]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2c1e01cb-e48f-4b4f-bb65-1617dbe90ab9 tempest-VolumesTestJSON-835164019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.289s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:21 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-2c1e01cb-e48f-4b4f-bb65-1617dbe90ab9 tempest-VolumesTestJSON-835164019 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:21:21 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-2c1e01cb-e48f-4b4f-bb65-1617dbe90ab9 tempest-VolumesTestJSON-835164019 None] Deleted volume successfully. Nov 03 20:21:21 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2c1e01cb-e48f-4b4f-bb65-1617dbe90ab9 tempest-VolumesTestJSON-835164019 None] Lock "cinder-cd54e463-c5ad-471d-8c27-a8485488cd41-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:21:21 devstack sudo[92788]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9ad23fab-a0ed-467d-aee4-2781f43e5c14 tempest-GroupsTest-342520804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-aff2dbb3-a04e-4bbf-b30a-1014eadebcd9" returned: 0 in 0.293s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:21 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9ad23fab-a0ed-467d-aee4-2781f43e5c14 tempest-GroupsTest-342520804 None] Lock "cinder-quobyte-aff2dbb3-a04e-4bbf-b30a-1014eadebcd9" released by "delete_volume" :: held 1.046s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:21:21 devstack sudo[92795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c Nov 03 20:21:21 devstack sudo[92795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:21 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-9ad23fab-a0ed-467d-aee4-2781f43e5c14 tempest-GroupsTest-342520804 None] Created reservations ['77d76d6b-f4e8-4ae5-8a35-78a4b404dc28'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:21:21 devstack cinder-volume[87248]: WARNING cinder.quota [None req-9ad23fab-a0ed-467d-aee4-2781f43e5c14 tempest-GroupsTest-342520804 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1742418003 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1742418003, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:21:21 devstack cinder-volume[87248]: WARNING cinder.quota [None req-9ad23fab-a0ed-467d-aee4-2781f43e5c14 tempest-GroupsTest-342520804 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1742418003 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1742418003, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:21:21 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-9ad23fab-a0ed-467d-aee4-2781f43e5c14 tempest-GroupsTest-342520804 None] Created reservations ['c2c0842c-a2dc-4978-bfd2-596c39e165f4', '9214b0c8-5bad-47db-b0a7-431e5800edb9', 'dc7c258e-45dc-48c7-a0d7-4fa6045f12aa', '06d8ab70-b594-4bc7-845a-b02a068c2e68'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:21:21 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-9ad23fab-a0ed-467d-aee4-2781f43e5c14 tempest-GroupsTest-342520804 None] Created reservations ['97ddf96a-d2e6-405d-b00a-fecbd1e4de1f', 'ca1ab743-2926-4c82-98d9-fd0453aeab0a', 'eff5b32a-3dd5-4144-a795-6e684a9a00b8', 'dcc71c68-9981-4506-87ee-eb4a7f8f464e'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:21:21 devstack sudo[92795]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-60369c92-1273-46fe-a92f-0b1c43da3fe2 tempest-GroupSnapshotsV319Test-936336535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c" returned: 0 in 0.439s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-60369c92-1273-46fe-a92f-0b1c43da3fe2 tempest-GroupSnapshotsV319Test-936336535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c.0a385959-8e3e-4af5-b37b-969ec1e39dac {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:21 devstack sudo[92803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c.0a385959-8e3e-4af5-b37b-969ec1e39dac Nov 03 20:21:21 devstack sudo[92803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-9ad23fab-a0ed-467d-aee4-2781f43e5c14 tempest-GroupsTest-342520804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-9ad23fab-a0ed-467d-aee4-2781f43e5c14 tempest-GroupsTest-342520804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-9ad23fab-a0ed-467d-aee4-2781f43e5c14 tempest-GroupsTest-342520804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:21:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-9ad23fab-a0ed-467d-aee4-2781f43e5c14 tempest-GroupsTest-342520804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:21:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-9ad23fab-a0ed-467d-aee4-2781f43e5c14 tempest-GroupsTest-342520804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9ad23fab-a0ed-467d-aee4-2781f43e5c14 tempest-GroupsTest-342520804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:21 devstack sudo[92805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:21:21 devstack sudo[92805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:22 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-161b7cbb-c0f1-4912-b039-848d70c47b72 tempest-VolumesTestJSON-835164019 None] Acquiring lock "cinder-aa4f8d49-32ac-4011-b5c3-49f027a810db-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:21:22 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-161b7cbb-c0f1-4912-b039-848d70c47b72 tempest-VolumesTestJSON-835164019 None] Lock "cinder-aa4f8d49-32ac-4011-b5c3-49f027a810db-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:21:22 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-161b7cbb-c0f1-4912-b039-848d70c47b72 tempest-VolumesTestJSON-835164019 None] Acquiring lock "cinder-quobyte-aa4f8d49-32ac-4011-b5c3-49f027a810db" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:21:22 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-161b7cbb-c0f1-4912-b039-848d70c47b72 tempest-VolumesTestJSON-835164019 None] Lock "cinder-quobyte-aa4f8d49-32ac-4011-b5c3-49f027a810db" acquired by "delete_volume" :: waited 0.018s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:21:22 devstack sudo[92805]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:22 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[e666332c-ea66-49cd-b36f-1bdce1b79396]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:21:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-161b7cbb-c0f1-4912-b039-848d70c47b72 tempest-VolumesTestJSON-835164019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-aa4f8d49-32ac-4011-b5c3-49f027a810db {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9ad23fab-a0ed-467d-aee4-2781f43e5c14 tempest-GroupsTest-342520804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.371s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:22 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-9ad23fab-a0ed-467d-aee4-2781f43e5c14 tempest-GroupsTest-342520804 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:21:22 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-9ad23fab-a0ed-467d-aee4-2781f43e5c14 tempest-GroupsTest-342520804 None] Delete group completed successfully. Nov 03 20:21:22 devstack sudo[92803]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-60369c92-1273-46fe-a92f-0b1c43da3fe2 tempest-GroupSnapshotsV319Test-936336535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c.0a385959-8e3e-4af5-b37b-969ec1e39dac" returned: 0 in 0.532s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-60369c92-1273-46fe-a92f-0b1c43da3fe2 tempest-GroupSnapshotsV319Test-936336535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c.0a385959-8e3e-4af5-b37b-969ec1e39dac {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:22 devstack sudo[92813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c.0a385959-8e3e-4af5-b37b-969ec1e39dac Nov 03 20:21:22 devstack sudo[92813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:22 devstack sudo[92811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-aa4f8d49-32ac-4011-b5c3-49f027a810db Nov 03 20:21:22 devstack sudo[92811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:22 devstack sudo[92813]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-60369c92-1273-46fe-a92f-0b1c43da3fe2 tempest-GroupSnapshotsV319Test-936336535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c.0a385959-8e3e-4af5-b37b-969ec1e39dac" returned: 0 in 0.292s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:22 devstack sudo[92811]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-161b7cbb-c0f1-4912-b039-848d70c47b72 tempest-VolumesTestJSON-835164019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-aa4f8d49-32ac-4011-b5c3-49f027a810db" returned: 0 in 0.426s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-161b7cbb-c0f1-4912-b039-848d70c47b72 tempest-VolumesTestJSON-835164019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-aa4f8d49-32ac-4011-b5c3-49f027a810db {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:22 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-60369c92-1273-46fe-a92f-0b1c43da3fe2 tempest-GroupSnapshotsV319Test-936336535 None] Lock "cinder-quobyte-0a385959-8e3e-4af5-b37b-969ec1e39dac" released by "_delete_snapshot" :: held 2.061s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:21:22 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-60369c92-1273-46fe-a92f-0b1c43da3fe2 tempest-GroupSnapshotsV319Test-936336535 None] Lock "cinder-quobyte-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c" released by "delete_snapshot" :: held 2.110s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:21:22 devstack sudo[92822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-aa4f8d49-32ac-4011-b5c3-49f027a810db Nov 03 20:21:22 devstack sudo[92822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:22 devstack cinder-volume[87248]: WARNING cinder.quota [None req-60369c92-1273-46fe-a92f-0b1c43da3fe2 tempest-GroupSnapshotsV319Test-936336535 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1869387826 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1869387826, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:21:22 devstack cinder-volume[87248]: WARNING cinder.quota [None req-60369c92-1273-46fe-a92f-0b1c43da3fe2 tempest-GroupSnapshotsV319Test-936336535 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1869387826 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1869387826, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:21:22 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-60369c92-1273-46fe-a92f-0b1c43da3fe2 tempest-GroupSnapshotsV319Test-936336535 None] Created reservations ['32a5a905-3b77-4501-9108-3a1af4b8c6a2', '4ec0d705-ad5a-4907-a0b0-2dc70eac3478', '3d119f25-6424-4caa-a348-866dfe1a6462', 'cf455353-bf7f-48ab-b08d-2e23fff8c9d1'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:21:22 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-60369c92-1273-46fe-a92f-0b1c43da3fe2 tempest-GroupSnapshotsV319Test-936336535 None] group_snapshot 0488218a-5a0f-4845-9561-a678b3725639: deleted successfully Nov 03 20:21:22 devstack sudo[92822]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-161b7cbb-c0f1-4912-b039-848d70c47b72 tempest-VolumesTestJSON-835164019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-aa4f8d49-32ac-4011-b5c3-49f027a810db" returned: 0 in 0.316s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:22 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-161b7cbb-c0f1-4912-b039-848d70c47b72 tempest-VolumesTestJSON-835164019 None] Lock "cinder-quobyte-aa4f8d49-32ac-4011-b5c3-49f027a810db" released by "delete_volume" :: held 0.797s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:21:23 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-161b7cbb-c0f1-4912-b039-848d70c47b72 tempest-VolumesTestJSON-835164019 None] Created reservations ['6dad9b24-bab4-400d-a509-edc33e5ca993', '9a6862d3-c140-43d4-9204-2cd5bcf891c2', 'e3de2c68-c78c-4057-9322-6df07e16a8c4', 'b6d095c6-a8c8-47fe-a637-fc962c52796d'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:21:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-161b7cbb-c0f1-4912-b039-848d70c47b72 tempest-VolumesTestJSON-835164019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-161b7cbb-c0f1-4912-b039-848d70c47b72 tempest-VolumesTestJSON-835164019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:23 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-161b7cbb-c0f1-4912-b039-848d70c47b72 tempest-VolumesTestJSON-835164019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:21:23 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-161b7cbb-c0f1-4912-b039-848d70c47b72 tempest-VolumesTestJSON-835164019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:21:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-161b7cbb-c0f1-4912-b039-848d70c47b72 tempest-VolumesTestJSON-835164019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-161b7cbb-c0f1-4912-b039-848d70c47b72 tempest-VolumesTestJSON-835164019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:23 devstack sudo[92909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:21:23 devstack sudo[92909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:23 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-16b647f5-11ad-4fcf-afaa-ee8b7cfc59b3 tempest-GroupSnapshotsV319Test-936336535 None] Acquiring lock "cinder-quobyte-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:21:23 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-16b647f5-11ad-4fcf-afaa-ee8b7cfc59b3 tempest-GroupSnapshotsV319Test-936336535 None] Lock "cinder-quobyte-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c" acquired by "delete_volume" :: waited 0.060s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:21:23 devstack sudo[92909]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-161b7cbb-c0f1-4912-b039-848d70c47b72 tempest-VolumesTestJSON-835164019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.607s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:23 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-161b7cbb-c0f1-4912-b039-848d70c47b72 tempest-VolumesTestJSON-835164019 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:21:23 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-161b7cbb-c0f1-4912-b039-848d70c47b72 tempest-VolumesTestJSON-835164019 None] Deleted volume successfully. Nov 03 20:21:23 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[86eac592-cb4a-4b39-a68c-93a32cb3f733]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:21:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-16b647f5-11ad-4fcf-afaa-ee8b7cfc59b3 tempest-GroupSnapshotsV319Test-936336535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:23 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-161b7cbb-c0f1-4912-b039-848d70c47b72 tempest-VolumesTestJSON-835164019 None] Lock "cinder-aa4f8d49-32ac-4011-b5c3-49f027a810db-delete_volume" released by "delete_volume" :: held 1.872s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:21:24 devstack sudo[92945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c Nov 03 20:21:24 devstack sudo[92945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:24 devstack sudo[92945]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-16b647f5-11ad-4fcf-afaa-ee8b7cfc59b3 tempest-GroupSnapshotsV319Test-936336535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c" returned: 0 in 0.719s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-16b647f5-11ad-4fcf-afaa-ee8b7cfc59b3 tempest-GroupSnapshotsV319Test-936336535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:24 devstack sudo[93286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c Nov 03 20:21:24 devstack sudo[93286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:25 devstack sudo[93286]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-16b647f5-11ad-4fcf-afaa-ee8b7cfc59b3 tempest-GroupSnapshotsV319Test-936336535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c" returned: 0 in 0.442s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:25 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-16b647f5-11ad-4fcf-afaa-ee8b7cfc59b3 tempest-GroupSnapshotsV319Test-936336535 None] Lock "cinder-quobyte-56f1b6fe-e6fd-45f8-b92d-75ccc800d65c" released by "delete_volume" :: held 1.369s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:21:25 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-16b647f5-11ad-4fcf-afaa-ee8b7cfc59b3 tempest-GroupSnapshotsV319Test-936336535 None] Created reservations ['504bbcd7-8cf0-4511-a45b-c7a19d69ce86'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:21:25 devstack cinder-volume[87248]: WARNING cinder.quota [None req-16b647f5-11ad-4fcf-afaa-ee8b7cfc59b3 tempest-GroupSnapshotsV319Test-936336535 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1869387826 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1869387826, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:21:25 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-16b647f5-11ad-4fcf-afaa-ee8b7cfc59b3 tempest-GroupSnapshotsV319Test-936336535 None] Created reservations ['3630ef93-3647-42ca-84cd-0ade83ac6366', 'cb8e0eca-db6e-4223-9799-bcb9dff7a6f5', '478c0a5a-5b32-4c36-bd24-902fedd201e6', '7af081a9-6eb8-441f-9455-eeb6b448c9a4'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:21:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-16b647f5-11ad-4fcf-afaa-ee8b7cfc59b3 tempest-GroupSnapshotsV319Test-936336535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-16b647f5-11ad-4fcf-afaa-ee8b7cfc59b3 tempest-GroupSnapshotsV319Test-936336535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:25 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-16b647f5-11ad-4fcf-afaa-ee8b7cfc59b3 tempest-GroupSnapshotsV319Test-936336535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:21:25 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-16b647f5-11ad-4fcf-afaa-ee8b7cfc59b3 tempest-GroupSnapshotsV319Test-936336535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:21:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-16b647f5-11ad-4fcf-afaa-ee8b7cfc59b3 tempest-GroupSnapshotsV319Test-936336535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-16b647f5-11ad-4fcf-afaa-ee8b7cfc59b3 tempest-GroupSnapshotsV319Test-936336535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:25 devstack sudo[93290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:21:25 devstack sudo[93290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:25 devstack sudo[93290]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-16b647f5-11ad-4fcf-afaa-ee8b7cfc59b3 tempest-GroupSnapshotsV319Test-936336535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.499s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:25 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-16b647f5-11ad-4fcf-afaa-ee8b7cfc59b3 tempest-GroupSnapshotsV319Test-936336535 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:21:25 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-16b647f5-11ad-4fcf-afaa-ee8b7cfc59b3 tempest-GroupSnapshotsV319Test-936336535 None] Delete group completed successfully. Nov 03 20:21:28 devstack cinder-volume[87248]: DEBUG oslo_service.periodic_task [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:21:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:21:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:21:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:28 devstack sudo[93297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:21:28 devstack sudo[93297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:29 devstack sudo[93297]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.615s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:29 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:21:29 devstack cinder-volume[87248]: DEBUG oslo_service.periodic_task [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running periodic task VolumeManager._thread_info {{(pid=87248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:21:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] thread count: 28 {{(pid=87248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:21:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] thread info: [<_MainThread(MainThread, started 124862067372160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:21:35 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:SELECT=124,cinder:UPDATE=129,cinder:INSERT=30,cinder:DELETE=7 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:21:35 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:SELECT=112,cinder:UPDATE=120,cinder:INSERT=37,cinder:DELETE=4 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:21:38 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-fd4c8e7a-1131-4d62-9dc3-d75a9acf0f66 req-457476e9-50e9-47a8-a038-7277b58ec858 tempest-ServerActionsTestOtherA-836700016 None] Terminate volume connection completed successfully. Nov 03 20:21:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-fd4c8e7a-1131-4d62-9dc3-d75a9acf0f66 req-457476e9-50e9-47a8-a038-7277b58ec858 tempest-ServerActionsTestOtherA-836700016 None] Deleting attachment 90a052b7-bbcc-4808-921c-7fc0644b8ec9. {{(pid=87248) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 20:21:39 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-35d25beb-7aea-4884-8857-8d102a87c1a3 tempest-GroupsV314Test-1541269695 None] Group tempest-GroupsV314Test-Group-1156725898: creating Nov 03 20:21:39 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-35d25beb-7aea-4884-8857-8d102a87c1a3 tempest-GroupsV314Test-1541269695 None] Group tempest-GroupsV314Test-Group-1156725898: created successfully Nov 03 20:21:39 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-35d25beb-7aea-4884-8857-8d102a87c1a3 tempest-GroupsV314Test-1541269695 None] Create group completed successfully. Nov 03 20:21:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-fd4c8e7a-1131-4d62-9dc3-d75a9acf0f66 req-0b4b5c86-0cef-4eeb-96f0-767c04fbe723 tempest-ServerActionsTestOtherA-836700016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-fd4c8e7a-1131-4d62-9dc3-d75a9acf0f66 req-0b4b5c86-0cef-4eeb-96f0-767c04fbe723 tempest-ServerActionsTestOtherA-836700016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-fd4c8e7a-1131-4d62-9dc3-d75a9acf0f66 req-0b4b5c86-0cef-4eeb-96f0-767c04fbe723 tempest-ServerActionsTestOtherA-836700016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:40 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-fd4c8e7a-1131-4d62-9dc3-d75a9acf0f66 req-0b4b5c86-0cef-4eeb-96f0-767c04fbe723 tempest-ServerActionsTestOtherA-836700016 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8', 'name': 'volume-6bbd0803-74df-43c1-a49e-75f29e4f1597', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0e338795-a18e-476b-a7aa-cc62ea4e9a23', 'enforce_multipath': True} {{(pid=87248) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 20:21:41 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-fd4c8e7a-1131-4d62-9dc3-d75a9acf0f66 req-0b4b5c86-0cef-4eeb-96f0-767c04fbe723 tempest-ServerActionsTestOtherA-836700016 None] attachment_update completed successfully. Nov 03 20:21:41 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-d014df89-5bb8-4f77-824d-c77116d3d8b0 tempest-GroupsV314Test-1541269695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:21:41 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d014df89-5bb8-4f77-824d-c77116d3d8b0 tempest-GroupsV314Test-1541269695 None] Flow 'volume_create_manager' (e0e2f35e-797c-43ab-a43c-a8ab8c0a7a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:21:41 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d014df89-5bb8-4f77-824d-c77116d3d8b0 tempest-GroupsV314Test-1541269695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8665c9fd-5fa3-463c-8ae4-a2ea8103a672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:41 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d014df89-5bb8-4f77-824d-c77116d3d8b0 tempest-GroupsV314Test-1541269695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8665c9fd-5fa3-463c-8ae4-a2ea8103a672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2004308582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c62879f1-1405-4517-b1a8-723ade8e2659,host='devstack@QuobyteHD#QuobyteHD',id=7c6c4cb3-559d-4b65-82d0-23754545a0b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3a1f9973d24ffea4bbb66b3ade209e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:21:41Z,use_quota=True,user_id='161aca820fe649dfa56a70815ad57660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(19a56b91-d635-4e58-aa71-4597f159f024),volume_type_id=19a56b91-d635-4e58-aa71-4597f159f024)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:41 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d014df89-5bb8-4f77-824d-c77116d3d8b0 tempest-GroupsV314Test-1541269695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a3e6ef6-5a90-4b1e-998f-bcf7c0f03116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:41 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d014df89-5bb8-4f77-824d-c77116d3d8b0 tempest-GroupsV314Test-1541269695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a3e6ef6-5a90-4b1e-998f-bcf7c0f03116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:41 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d014df89-5bb8-4f77-824d-c77116d3d8b0 tempest-GroupsV314Test-1541269695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b5e694a-0333-4978-9183-748db6716bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:41 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d014df89-5bb8-4f77-824d-c77116d3d8b0 tempest-GroupsV314Test-1541269695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b5e694a-0333-4978-9183-748db6716bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c6c4cb3-559d-4b65-82d0-23754545a0b4', 'volume_name': 'volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:41 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d014df89-5bb8-4f77-824d-c77116d3d8b0 tempest-GroupsV314Test-1541269695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a459dd9-9f65-4a4e-ad14-0c2d088c6548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:41 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d014df89-5bb8-4f77-824d-c77116d3d8b0 tempest-GroupsV314Test-1541269695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a459dd9-9f65-4a4e-ad14-0c2d088c6548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:41 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d014df89-5bb8-4f77-824d-c77116d3d8b0 tempest-GroupsV314Test-1541269695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bfc8cef-f3f0-41c3-921b-abea3aa9cd0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:41 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-d014df89-5bb8-4f77-824d-c77116d3d8b0 tempest-GroupsV314Test-1541269695 None] Volume 7c6c4cb3-559d-4b65-82d0-23754545a0b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4', 'volume_size': 1} Nov 03 20:21:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d014df89-5bb8-4f77-824d-c77116d3d8b0 tempest-GroupsV314Test-1541269695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d014df89-5bb8-4f77-824d-c77116d3d8b0 tempest-GroupsV314Test-1541269695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:41 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-d014df89-5bb8-4f77-824d-c77116d3d8b0 tempest-GroupsV314Test-1541269695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c62879f1-1405-4517-b1a8-723ade8e2659,created_at=2026-11-03T19:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2004308582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c62879f1-1405-4517-b1a8-723ade8e2659,host='devstack@QuobyteHD#QuobyteHD',id=7c6c4cb3-559d-4b65-82d0-23754545a0b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3a1f9973d24ffea4bbb66b3ade209e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:21:41Z,use_quota=True,user_id='161aca820fe649dfa56a70815ad57660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(19a56b91-d635-4e58-aa71-4597f159f024),volume_type_id=19a56b91-d635-4e58-aa71-4597f159f024)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:21:41 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-d014df89-5bb8-4f77-824d-c77116d3d8b0 tempest-GroupsV314Test-1541269695 None] Creating volume 7c6c4cb3-559d-4b65-82d0-23754545a0b4 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:21:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d014df89-5bb8-4f77-824d-c77116d3d8b0 tempest-GroupsV314Test-1541269695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d014df89-5bb8-4f77-824d-c77116d3d8b0 tempest-GroupsV314Test-1541269695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:41 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-d014df89-5bb8-4f77-824d-c77116d3d8b0 tempest-GroupsV314Test-1541269695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:21:41 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-d014df89-5bb8-4f77-824d-c77116d3d8b0 tempest-GroupsV314Test-1541269695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:21:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d014df89-5bb8-4f77-824d-c77116d3d8b0 tempest-GroupsV314Test-1541269695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:41 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-d014df89-5bb8-4f77-824d-c77116d3d8b0 tempest-GroupsV314Test-1541269695 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:21:41 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-d014df89-5bb8-4f77-824d-c77116d3d8b0 tempest-GroupsV314Test-1541269695 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:21:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d014df89-5bb8-4f77-824d-c77116d3d8b0 tempest-GroupsV314Test-1541269695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:41 devstack sudo[93444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4 1073741824 Nov 03 20:21:41 devstack sudo[93444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:42 devstack sudo[93444]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d014df89-5bb8-4f77-824d-c77116d3d8b0 tempest-GroupsV314Test-1541269695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4 1073741824" returned: 0 in 0.882s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d014df89-5bb8-4f77-824d-c77116d3d8b0 tempest-GroupsV314Test-1541269695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:42 devstack sudo[93817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4 Nov 03 20:21:42 devstack sudo[93817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:43 devstack sudo[93817]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d014df89-5bb8-4f77-824d-c77116d3d8b0 tempest-GroupsV314Test-1541269695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4" returned: 0 in 0.598s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:43 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-d014df89-5bb8-4f77-824d-c77116d3d8b0 tempest-GroupsV314Test-1541269695 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:21:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d014df89-5bb8-4f77-824d-c77116d3d8b0 tempest-GroupsV314Test-1541269695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.563s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:43 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d014df89-5bb8-4f77-824d-c77116d3d8b0 tempest-GroupsV314Test-1541269695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bfc8cef-f3f0-41c3-921b-abea3aa9cd0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:43 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d014df89-5bb8-4f77-824d-c77116d3d8b0 tempest-GroupsV314Test-1541269695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73ed518e-4079-418a-a5ac-d19f97801ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:43 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-d014df89-5bb8-4f77-824d-c77116d3d8b0 tempest-GroupsV314Test-1541269695 None] Volume volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4 (7c6c4cb3-559d-4b65-82d0-23754545a0b4): created successfully Nov 03 20:21:43 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d014df89-5bb8-4f77-824d-c77116d3d8b0 tempest-GroupsV314Test-1541269695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73ed518e-4079-418a-a5ac-d19f97801ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:43 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d014df89-5bb8-4f77-824d-c77116d3d8b0 tempest-GroupsV314Test-1541269695 None] Flow 'volume_create_manager' (e0e2f35e-797c-43ab-a43c-a8ab8c0a7a38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:21:43 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-d014df89-5bb8-4f77-824d-c77116d3d8b0 tempest-GroupsV314Test-1541269695 None] Created volume successfully. Nov 03 20:21:44 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-d34415da-128f-4fb3-8099-2e213b99ef15 tempest-SnapshotsActionsTest-781432807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:21:44 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d34415da-128f-4fb3-8099-2e213b99ef15 tempest-SnapshotsActionsTest-781432807 None] Flow 'volume_create_manager' (59049de0-e309-4385-b552-f2b865a1d623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:21:44 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d34415da-128f-4fb3-8099-2e213b99ef15 tempest-SnapshotsActionsTest-781432807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b90159e7-a470-46da-8517-f5fb6e8e5515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:44 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d34415da-128f-4fb3-8099-2e213b99ef15 tempest-SnapshotsActionsTest-781432807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b90159e7-a470-46da-8517-f5fb6e8e5515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-440834417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f95c6e9-a7fc-415a-915c-f9a7b581a097,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6127321eca934263bee6b369805ce8d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:21:44Z,use_quota=True,user_id='c48d7fae3f31429889c8aabeb65669c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:44 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d34415da-128f-4fb3-8099-2e213b99ef15 tempest-SnapshotsActionsTest-781432807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (378da4cb-4e82-4282-baae-93f691c91483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:44 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d34415da-128f-4fb3-8099-2e213b99ef15 tempest-SnapshotsActionsTest-781432807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (378da4cb-4e82-4282-baae-93f691c91483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:44 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d34415da-128f-4fb3-8099-2e213b99ef15 tempest-SnapshotsActionsTest-781432807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97121624-69fd-44b5-9ddc-0928fe4e48ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:44 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d34415da-128f-4fb3-8099-2e213b99ef15 tempest-SnapshotsActionsTest-781432807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97121624-69fd-44b5-9ddc-0928fe4e48ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f95c6e9-a7fc-415a-915c-f9a7b581a097', 'volume_name': 'volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:44 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d34415da-128f-4fb3-8099-2e213b99ef15 tempest-SnapshotsActionsTest-781432807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e88a383e-854b-4439-8b71-5c41d768f05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:44 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d34415da-128f-4fb3-8099-2e213b99ef15 tempest-SnapshotsActionsTest-781432807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e88a383e-854b-4439-8b71-5c41d768f05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:44 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d34415da-128f-4fb3-8099-2e213b99ef15 tempest-SnapshotsActionsTest-781432807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d513141-6455-46cc-b49e-44742b90f873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:44 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-d34415da-128f-4fb3-8099-2e213b99ef15 tempest-SnapshotsActionsTest-781432807 None] Volume 1f95c6e9-a7fc-415a-915c-f9a7b581a097: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097', 'volume_size': 1} Nov 03 20:21:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d34415da-128f-4fb3-8099-2e213b99ef15 tempest-SnapshotsActionsTest-781432807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d34415da-128f-4fb3-8099-2e213b99ef15 tempest-SnapshotsActionsTest-781432807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:44 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-d34415da-128f-4fb3-8099-2e213b99ef15 tempest-SnapshotsActionsTest-781432807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-440834417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f95c6e9-a7fc-415a-915c-f9a7b581a097,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6127321eca934263bee6b369805ce8d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:21:44Z,use_quota=True,user_id='c48d7fae3f31429889c8aabeb65669c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:21:44 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-d34415da-128f-4fb3-8099-2e213b99ef15 tempest-SnapshotsActionsTest-781432807 None] Creating volume 1f95c6e9-a7fc-415a-915c-f9a7b581a097 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:21:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d34415da-128f-4fb3-8099-2e213b99ef15 tempest-SnapshotsActionsTest-781432807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d34415da-128f-4fb3-8099-2e213b99ef15 tempest-SnapshotsActionsTest-781432807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:44 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-d34415da-128f-4fb3-8099-2e213b99ef15 tempest-SnapshotsActionsTest-781432807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:21:44 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-d34415da-128f-4fb3-8099-2e213b99ef15 tempest-SnapshotsActionsTest-781432807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:21:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d34415da-128f-4fb3-8099-2e213b99ef15 tempest-SnapshotsActionsTest-781432807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:44 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-d34415da-128f-4fb3-8099-2e213b99ef15 tempest-SnapshotsActionsTest-781432807 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:21:44 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-d34415da-128f-4fb3-8099-2e213b99ef15 tempest-SnapshotsActionsTest-781432807 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:21:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d34415da-128f-4fb3-8099-2e213b99ef15 tempest-SnapshotsActionsTest-781432807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:44 devstack sudo[93829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097 1073741824 Nov 03 20:21:44 devstack sudo[93829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:45 devstack sudo[93829]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d34415da-128f-4fb3-8099-2e213b99ef15 tempest-SnapshotsActionsTest-781432807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097 1073741824" returned: 0 in 0.819s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d34415da-128f-4fb3-8099-2e213b99ef15 tempest-SnapshotsActionsTest-781432807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:45 devstack sudo[93835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097 Nov 03 20:21:45 devstack sudo[93835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:46 devstack sudo[93835]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d34415da-128f-4fb3-8099-2e213b99ef15 tempest-SnapshotsActionsTest-781432807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097" returned: 0 in 0.452s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:46 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-d34415da-128f-4fb3-8099-2e213b99ef15 tempest-SnapshotsActionsTest-781432807 None] <== create_volume: return (1342ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:21:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d34415da-128f-4fb3-8099-2e213b99ef15 tempest-SnapshotsActionsTest-781432807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.350s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.636s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:46 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] Cloning volume 7c6c4cb3-559d-4b65-82d0-23754545a0b4 to volume 70133e0a-3eba-4a13-bc12-850163d45c16 Nov 03 20:21:46 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d34415da-128f-4fb3-8099-2e213b99ef15 tempest-SnapshotsActionsTest-781432807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d513141-6455-46cc-b49e-44742b90f873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:46 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d34415da-128f-4fb3-8099-2e213b99ef15 tempest-SnapshotsActionsTest-781432807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dcd79f4-d99e-4696-85df-bdd2dc7ff858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:21:46 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-d34415da-128f-4fb3-8099-2e213b99ef15 tempest-SnapshotsActionsTest-781432807 None] Volume volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097 (1f95c6e9-a7fc-415a-915c-f9a7b581a097): created successfully Nov 03 20:21:46 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d34415da-128f-4fb3-8099-2e213b99ef15 tempest-SnapshotsActionsTest-781432807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dcd79f4-d99e-4696-85df-bdd2dc7ff858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:21:46 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d34415da-128f-4fb3-8099-2e213b99ef15 tempest-SnapshotsActionsTest-781432807 None] Flow 'volume_create_manager' (59049de0-e309-4385-b552-f2b865a1d623) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:21:46 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] Creating offline snapshot 49706ea2-6d67-4491-9c0d-17e5fc707b2d of volume 7c6c4cb3-559d-4b65-82d0-23754545a0b4 {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:21:46 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-d34415da-128f-4fb3-8099-2e213b99ef15 tempest-SnapshotsActionsTest-781432807 None] Created volume successfully. Nov 03 20:21:46 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3a87ae-cef5-4536-b804-bdbcbad3b876]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:21:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:46 devstack sudo[93839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4 Nov 03 20:21:46 devstack sudo[93839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:46 devstack sudo[93839]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4" returned: 0 in 0.588s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4.49706ea2-6d67-4491-9c0d-17e5fc707b2d 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:47 devstack sudo[93844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4.49706ea2-6d67-4491-9c0d-17e5fc707b2d 1G Nov 03 20:21:47 devstack sudo[93844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-86fec716-a126-43b2-b018-b0a465e8bb4d tempest-SnapshotsActionsTest-781432807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:47 devstack sudo[93844]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4.49706ea2-6d67-4491-9c0d-17e5fc707b2d 1G" returned: 0 in 0.820s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4.49706ea2-6d67-4491-9c0d-17e5fc707b2d {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:47 devstack sudo[93850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4.49706ea2-6d67-4491-9c0d-17e5fc707b2d Nov 03 20:21:47 devstack sudo[93850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:48 devstack sudo[93850]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4.49706ea2-6d67-4491-9c0d-17e5fc707b2d" returned: 0 in 0.493s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:48 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4.49706ea2-6d67-4491-9c0d-17e5fc707b2d is being set with open permissions: ugo+rw: NotImplementedError Nov 03 20:21:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4.49706ea2-6d67-4491-9c0d-17e5fc707b2d {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:48 devstack sudo[93858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4.49706ea2-6d67-4491-9c0d-17e5fc707b2d Nov 03 20:21:48 devstack sudo[93858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:48 devstack sudo[93858]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4.49706ea2-6d67-4491-9c0d-17e5fc707b2d" returned: 0 in 0.389s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:48 devstack sudo[93861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4.info Nov 03 20:21:48 devstack sudo[93861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:49 devstack sudo[93861]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4.info" returned: 0 in 0.565s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:49 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 20:21:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:49 devstack sudo[93864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4.info Nov 03 20:21:49 devstack sudo[93864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:49 devstack sudo[93864]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4.info" returned: 0 in 0.462s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:49 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] Acquiring lock "cinder-quobyte-70133e0a-3eba-4a13-bc12-850163d45c16" by "_copy_volume_from_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:21:49 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] Lock "cinder-quobyte-70133e0a-3eba-4a13-bc12-850163d45c16" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:21:49 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] snapshot: 49706ea2-6d67-4491-9c0d-17e5fc707b2d, volume: 70133e0a-3eba-4a13-bc12-850163d45c16, {{(pid=87248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 20:21:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:21:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:21:49 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:21:49 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:21:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:21:49 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5a8796-a5df-4324-a120-6596a0981d9e]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:21:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4.49706ea2-6d67-4491-9c0d-17e5fc707b2d {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:50 devstack sudo[93867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4.49706ea2-6d67-4491-9c0d-17e5fc707b2d Nov 03 20:21:50 devstack sudo[93867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:50 devstack sudo[93867]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4.49706ea2-6d67-4491-9c0d-17e5fc707b2d" returned: 0 in 0.728s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:50 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:21:50 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3332db8-cf10-47ac-b49c-926953040267]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:21:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:50 devstack sudo[93874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4 Nov 03 20:21:50 devstack sudo[93874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:51 devstack sudo[93874]: pam_unix(sudo:session): session closed for user root Nov 03 20:21:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4" returned: 0 in 0.414s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:21:51 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4 {{(pid=87248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 20:21:51 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] Creating direct copy from snapshot {{(pid=87248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 20:21:51 devstack cinder-volume[87248]: DEBUG cinder.utils [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] Path /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-70133e0a-3eba-4a13-bc12-850163d45c16 not found in is_blk_device check {{(pid=87248) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 20:21:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-70133e0a-3eba-4a13-bc12-850163d45c16 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:21:51 devstack sudo[93879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-70133e0a-3eba-4a13-bc12-850163d45c16 Nov 03 20:21:51 devstack sudo[93879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:21:58 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:SELECT=20,cinder:UPDATE=12,cinder:INSERT=3 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:21:58 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:SELECT=18,cinder:UPDATE=7,cinder:DELETE=2,cinder:INSERT=1 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:22:00 devstack sudo[93879]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-70133e0a-3eba-4a13-bc12-850163d45c16" returned: 0 in 8.952s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:00 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] Image conversion details: src /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4, size 1024.00 MB, duration 8.95 sec, destination /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-70133e0a-3eba-4a13-bc12-850163d45c16 {{(pid=87248) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:22:00 devstack cinder-volume[87248]: INFO cinder.image.image_utils [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] Converted 1024.00 MB image at 114.37 MB/s Nov 03 20:22:00 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-70133e0a-3eba-4a13-bc12-850163d45c16 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 20:22:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-70133e0a-3eba-4a13-bc12-850163d45c16 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:00 devstack sudo[93929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-70133e0a-3eba-4a13-bc12-850163d45c16 Nov 03 20:22:00 devstack sudo[93929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:00 devstack sudo[93929]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-70133e0a-3eba-4a13-bc12-850163d45c16" returned: 0 in 0.303s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:00 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] Lock "cinder-quobyte-70133e0a-3eba-4a13-bc12-850163d45c16" released by "_copy_volume_from_snapshot" :: held 10.537s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:00 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] Acquiring lock "cinder-quobyte-49706ea2-6d67-4491-9c0d-17e5fc707b2d" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:00 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] Lock "cinder-quobyte-49706ea2-6d67-4491-9c0d-17e5fc707b2d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:00 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] Deleting offline snapshot 49706ea2-6d67-4491-9c0d-17e5fc707b2d of volume 7c6c4cb3-559d-4b65-82d0-23754545a0b4 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:22:00 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] snapshot_file for this snap is: volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4.49706ea2-6d67-4491-9c0d-17e5fc707b2d {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:22:00 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d58a19-6e35-454e-ac62-348ed661117c]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4.49706ea2-6d67-4491-9c0d-17e5fc707b2d {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:00 devstack sudo[93933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4.49706ea2-6d67-4491-9c0d-17e5fc707b2d Nov 03 20:22:00 devstack sudo[93933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:00 devstack sudo[93933]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4.49706ea2-6d67-4491-9c0d-17e5fc707b2d" returned: 0 in 0.463s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:00 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:22:00 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[4165d821-6903-48f8-a49e-a84e03a12b14]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:01 devstack sudo[93941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4 Nov 03 20:22:01 devstack sudo[93941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:01 devstack sudo[93941]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4" returned: 0 in 0.671s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4.49706ea2-6d67-4491-9c0d-17e5fc707b2d {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:01 devstack sudo[93980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4.49706ea2-6d67-4491-9c0d-17e5fc707b2d Nov 03 20:22:01 devstack sudo[93980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:02 devstack sudo[93980]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4.49706ea2-6d67-4491-9c0d-17e5fc707b2d" returned: 0 in 0.450s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4.49706ea2-6d67-4491-9c0d-17e5fc707b2d {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:02 devstack sudo[93986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4.49706ea2-6d67-4491-9c0d-17e5fc707b2d Nov 03 20:22:02 devstack sudo[93986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:02 devstack sudo[93986]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4.49706ea2-6d67-4491-9c0d-17e5fc707b2d" returned: 0 in 0.347s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:02 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] Lock "cinder-quobyte-49706ea2-6d67-4491-9c0d-17e5fc707b2d" released by "_delete_snapshot" :: held 2.102s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.377s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-86fec716-a126-43b2-b018-b0a465e8bb4d tempest-SnapshotsActionsTest-781432807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 15.264s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:02 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-86fec716-a126-43b2-b018-b0a465e8bb4d tempest-SnapshotsActionsTest-781432807 None] Creating offline snapshot 4cb93afc-9646-496e-90ff-976ab70c2ea0 of volume 1f95c6e9-a7fc-415a-915c-f9a7b581a097 {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:22:02 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5dcbdfb-cab7-4705-9499-7929b75e9e77]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-86fec716-a126-43b2-b018-b0a465e8bb4d tempest-SnapshotsActionsTest-781432807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:02 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-6a0995b7-0801-4261-bed8-4b2afaf857f1 tempest-GroupsV314Test-1541269695 None] Create group from source-group-c62879f1-1405-4517-b1a8-723ade8e2659 completed successfully. Nov 03 20:22:02 devstack sudo[93999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097 Nov 03 20:22:02 devstack sudo[93999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:02 devstack sudo[93999]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-86fec716-a126-43b2-b018-b0a465e8bb4d tempest-SnapshotsActionsTest-781432807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097" returned: 0 in 0.433s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-86fec716-a126-43b2-b018-b0a465e8bb4d tempest-SnapshotsActionsTest-781432807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:03 devstack sudo[94004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0 1G Nov 03 20:22:03 devstack sudo[94004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:03 devstack sudo[94004]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-86fec716-a126-43b2-b018-b0a465e8bb4d tempest-SnapshotsActionsTest-781432807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0 1G" returned: 0 in 0.442s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-86fec716-a126-43b2-b018-b0a465e8bb4d tempest-SnapshotsActionsTest-781432807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:03 devstack sudo[94010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0 Nov 03 20:22:03 devstack sudo[94010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:03 devstack sudo[94010]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-86fec716-a126-43b2-b018-b0a465e8bb4d tempest-SnapshotsActionsTest-781432807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0" returned: 0 in 0.339s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:03 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-86fec716-a126-43b2-b018-b0a465e8bb4d tempest-SnapshotsActionsTest-781432807 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0 is being set with open permissions: ugo+rw Nov 03 20:22:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-86fec716-a126-43b2-b018-b0a465e8bb4d tempest-SnapshotsActionsTest-781432807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:03 devstack sudo[94015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0 Nov 03 20:22:03 devstack sudo[94015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:03 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d4509f9b-b3a7-4279-9984-2e07227c9234 tempest-GroupsV314Test-1541269695 None] Acquiring lock "cinder-quobyte-70133e0a-3eba-4a13-bc12-850163d45c16" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:03 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d4509f9b-b3a7-4279-9984-2e07227c9234 tempest-GroupsV314Test-1541269695 None] Lock "cinder-quobyte-70133e0a-3eba-4a13-bc12-850163d45c16" acquired by "delete_volume" :: waited 0.022s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:03 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e4cbf0-dfa2-4b80-a097-98543c7efb3d]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d4509f9b-b3a7-4279-9984-2e07227c9234 tempest-GroupsV314Test-1541269695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-70133e0a-3eba-4a13-bc12-850163d45c16 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:04 devstack sudo[94015]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-86fec716-a126-43b2-b018-b0a465e8bb4d tempest-SnapshotsActionsTest-781432807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0" returned: 0 in 0.301s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-86fec716-a126-43b2-b018-b0a465e8bb4d tempest-SnapshotsActionsTest-781432807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:04 devstack sudo[94017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-70133e0a-3eba-4a13-bc12-850163d45c16 Nov 03 20:22:04 devstack sudo[94017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:04 devstack sudo[94019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.info Nov 03 20:22:04 devstack sudo[94019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:04 devstack sudo[94019]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-86fec716-a126-43b2-b018-b0a465e8bb4d tempest-SnapshotsActionsTest-781432807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.info" returned: 0 in 0.302s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:04 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-86fec716-a126-43b2-b018-b0a465e8bb4d tempest-SnapshotsActionsTest-781432807 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.info is being set with open permissions: ugo+rw Nov 03 20:22:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-86fec716-a126-43b2-b018-b0a465e8bb4d tempest-SnapshotsActionsTest-781432807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:04 devstack sudo[94017]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d4509f9b-b3a7-4279-9984-2e07227c9234 tempest-GroupsV314Test-1541269695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-70133e0a-3eba-4a13-bc12-850163d45c16" returned: 0 in 0.445s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d4509f9b-b3a7-4279-9984-2e07227c9234 tempest-GroupsV314Test-1541269695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-70133e0a-3eba-4a13-bc12-850163d45c16 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:04 devstack sudo[94026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.info Nov 03 20:22:04 devstack sudo[94026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:04 devstack sudo[94027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-70133e0a-3eba-4a13-bc12-850163d45c16 Nov 03 20:22:04 devstack sudo[94027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:04 devstack sudo[94026]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-86fec716-a126-43b2-b018-b0a465e8bb4d tempest-SnapshotsActionsTest-781432807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.info" returned: 0 in 0.271s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:04 devstack sudo[94027]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-86fec716-a126-43b2-b018-b0a465e8bb4d tempest-SnapshotsActionsTest-781432807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.225s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d4509f9b-b3a7-4279-9984-2e07227c9234 tempest-GroupsV314Test-1541269695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-70133e0a-3eba-4a13-bc12-850163d45c16" returned: 0 in 0.284s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:04 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d4509f9b-b3a7-4279-9984-2e07227c9234 tempest-GroupsV314Test-1541269695 None] Lock "cinder-quobyte-70133e0a-3eba-4a13-bc12-850163d45c16" released by "delete_volume" :: held 0.788s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:04 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-86fec716-a126-43b2-b018-b0a465e8bb4d tempest-SnapshotsActionsTest-781432807 None] Create snapshot completed successfully Nov 03 20:22:04 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-d4509f9b-b3a7-4279-9984-2e07227c9234 tempest-GroupsV314Test-1541269695 None] Created reservations ['a163c162-fe86-4631-b6d1-b539c38b4b0b'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:22:04 devstack cinder-volume[87248]: WARNING cinder.quota [None req-d4509f9b-b3a7-4279-9984-2e07227c9234 tempest-GroupsV314Test-1541269695 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1323474840 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1323474840, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:22:04 devstack cinder-volume[87248]: WARNING cinder.quota [None req-d4509f9b-b3a7-4279-9984-2e07227c9234 tempest-GroupsV314Test-1541269695 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1323474840 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1323474840, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:22:04 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-d4509f9b-b3a7-4279-9984-2e07227c9234 tempest-GroupsV314Test-1541269695 None] Created reservations ['3cba74a2-7ad3-4cb2-bb94-13243d1b8aea', '12509225-9362-4089-9e62-1dc7c9a1fa84', '4d46e1ea-3f6c-424d-8c9f-1d56a18048d9', '8d69a656-bae1-49bb-8789-9598aa0baa27'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:22:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d4509f9b-b3a7-4279-9984-2e07227c9234 tempest-GroupsV314Test-1541269695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d4509f9b-b3a7-4279-9984-2e07227c9234 tempest-GroupsV314Test-1541269695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:04 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-d4509f9b-b3a7-4279-9984-2e07227c9234 tempest-GroupsV314Test-1541269695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:22:04 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-d4509f9b-b3a7-4279-9984-2e07227c9234 tempest-GroupsV314Test-1541269695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:22:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d4509f9b-b3a7-4279-9984-2e07227c9234 tempest-GroupsV314Test-1541269695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d4509f9b-b3a7-4279-9984-2e07227c9234 tempest-GroupsV314Test-1541269695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:05 devstack sudo[94033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:22:05 devstack sudo[94033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:05 devstack sudo[94033]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d4509f9b-b3a7-4279-9984-2e07227c9234 tempest-GroupsV314Test-1541269695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.260s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:05 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-d4509f9b-b3a7-4279-9984-2e07227c9234 tempest-GroupsV314Test-1541269695 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:22:05 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-d4509f9b-b3a7-4279-9984-2e07227c9234 tempest-GroupsV314Test-1541269695 None] Delete group completed successfully. Nov 03 20:22:05 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7773a84b-410f-4f4f-be5f-df6f65a9bb2e tempest-GroupsV314Test-1541269695 None] Acquiring lock "cinder-quobyte-7c6c4cb3-559d-4b65-82d0-23754545a0b4" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:05 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7773a84b-410f-4f4f-be5f-df6f65a9bb2e tempest-GroupsV314Test-1541269695 None] Lock "cinder-quobyte-7c6c4cb3-559d-4b65-82d0-23754545a0b4" acquired by "delete_volume" :: waited 0.019s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:05 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[c112a4e1-ca26-4837-ad7b-6ae46eb516fd]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7773a84b-410f-4f4f-be5f-df6f65a9bb2e tempest-GroupsV314Test-1541269695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:05 devstack sudo[94036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4 Nov 03 20:22:05 devstack sudo[94036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:05 devstack sudo[94036]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7773a84b-410f-4f4f-be5f-df6f65a9bb2e tempest-GroupsV314Test-1541269695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4" returned: 0 in 0.469s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7773a84b-410f-4f4f-be5f-df6f65a9bb2e tempest-GroupsV314Test-1541269695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:06 devstack sudo[94041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4 Nov 03 20:22:06 devstack sudo[94041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:06 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d017de8-7cfa-4a9e-b163-53eba9e90fbf tempest-VolumeQuotasNegativeTestJSON-111842112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:22:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2d017de8-7cfa-4a9e-b163-53eba9e90fbf tempest-VolumeQuotasNegativeTestJSON-111842112 None] Flow 'volume_create_manager' (e457abbc-f32d-4d40-b1e5-820ed48dc019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:22:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2d017de8-7cfa-4a9e-b163-53eba9e90fbf tempest-VolumeQuotasNegativeTestJSON-111842112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fe30723-d210-41a9-8aca-afd7c8d46753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2d017de8-7cfa-4a9e-b163-53eba9e90fbf tempest-VolumeQuotasNegativeTestJSON-111842112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fe30723-d210-41a9-8aca-afd7c8d46753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1876322168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9879b229-a338-4fd3-b38a-779f4693fa4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5edf4c939898461d9bd2d2a243bc74b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:22:06Z,use_quota=True,user_id='94b9257c48ce4f86b112ff61d0c7e185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2d017de8-7cfa-4a9e-b163-53eba9e90fbf tempest-VolumeQuotasNegativeTestJSON-111842112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b134e333-d86c-40f5-a7b7-4affd18f826e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2d017de8-7cfa-4a9e-b163-53eba9e90fbf tempest-VolumeQuotasNegativeTestJSON-111842112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b134e333-d86c-40f5-a7b7-4affd18f826e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2d017de8-7cfa-4a9e-b163-53eba9e90fbf tempest-VolumeQuotasNegativeTestJSON-111842112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efc4a24e-83d5-4070-97fc-38e877cd78e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2d017de8-7cfa-4a9e-b163-53eba9e90fbf tempest-VolumeQuotasNegativeTestJSON-111842112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efc4a24e-83d5-4070-97fc-38e877cd78e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9879b229-a338-4fd3-b38a-779f4693fa4b', 'volume_name': 'volume-9879b229-a338-4fd3-b38a-779f4693fa4b', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2d017de8-7cfa-4a9e-b163-53eba9e90fbf tempest-VolumeQuotasNegativeTestJSON-111842112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae286605-7cd9-463f-b93f-b5169527e869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2d017de8-7cfa-4a9e-b163-53eba9e90fbf tempest-VolumeQuotasNegativeTestJSON-111842112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae286605-7cd9-463f-b93f-b5169527e869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2d017de8-7cfa-4a9e-b163-53eba9e90fbf tempest-VolumeQuotasNegativeTestJSON-111842112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e757a20-2c7e-4d2d-a6fe-1ad8f8273d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:06 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-2d017de8-7cfa-4a9e-b163-53eba9e90fbf tempest-VolumeQuotasNegativeTestJSON-111842112 None] Volume 9879b229-a338-4fd3-b38a-779f4693fa4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9879b229-a338-4fd3-b38a-779f4693fa4b', 'volume_size': 1} Nov 03 20:22:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2d017de8-7cfa-4a9e-b163-53eba9e90fbf tempest-VolumeQuotasNegativeTestJSON-111842112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2d017de8-7cfa-4a9e-b163-53eba9e90fbf tempest-VolumeQuotasNegativeTestJSON-111842112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2d017de8-7cfa-4a9e-b163-53eba9e90fbf tempest-VolumeQuotasNegativeTestJSON-111842112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1876322168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9879b229-a338-4fd3-b38a-779f4693fa4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5edf4c939898461d9bd2d2a243bc74b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:22:06Z,use_quota=True,user_id='94b9257c48ce4f86b112ff61d0c7e185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:22:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-2d017de8-7cfa-4a9e-b163-53eba9e90fbf tempest-VolumeQuotasNegativeTestJSON-111842112 None] Creating volume 9879b229-a338-4fd3-b38a-779f4693fa4b {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:22:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2d017de8-7cfa-4a9e-b163-53eba9e90fbf tempest-VolumeQuotasNegativeTestJSON-111842112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2d017de8-7cfa-4a9e-b163-53eba9e90fbf tempest-VolumeQuotasNegativeTestJSON-111842112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2d017de8-7cfa-4a9e-b163-53eba9e90fbf tempest-VolumeQuotasNegativeTestJSON-111842112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:22:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2d017de8-7cfa-4a9e-b163-53eba9e90fbf tempest-VolumeQuotasNegativeTestJSON-111842112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:22:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2d017de8-7cfa-4a9e-b163-53eba9e90fbf tempest-VolumeQuotasNegativeTestJSON-111842112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2d017de8-7cfa-4a9e-b163-53eba9e90fbf tempest-VolumeQuotasNegativeTestJSON-111842112 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:22:06 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-2d017de8-7cfa-4a9e-b163-53eba9e90fbf tempest-VolumeQuotasNegativeTestJSON-111842112 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:22:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2d017de8-7cfa-4a9e-b163-53eba9e90fbf tempest-VolumeQuotasNegativeTestJSON-111842112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-9879b229-a338-4fd3-b38a-779f4693fa4b 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:06 devstack sudo[94043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-9879b229-a338-4fd3-b38a-779f4693fa4b 1073741824 Nov 03 20:22:06 devstack sudo[94043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-57f78074-43c1-4da4-9183-82d5a984291f tempest-SnapshotsActionsTest-781432807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:06 devstack sudo[94041]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7773a84b-410f-4f4f-be5f-df6f65a9bb2e tempest-GroupsV314Test-1541269695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c6c4cb3-559d-4b65-82d0-23754545a0b4" returned: 0 in 0.285s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:06 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7773a84b-410f-4f4f-be5f-df6f65a9bb2e tempest-GroupsV314Test-1541269695 None] Lock "cinder-quobyte-7c6c4cb3-559d-4b65-82d0-23754545a0b4" released by "delete_volume" :: held 0.842s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:06 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-7773a84b-410f-4f4f-be5f-df6f65a9bb2e tempest-GroupsV314Test-1541269695 None] Created reservations ['fc53a69d-2267-4862-b33c-a2a26b9c2411'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:22:06 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-7773a84b-410f-4f4f-be5f-df6f65a9bb2e tempest-GroupsV314Test-1541269695 None] Created reservations ['65462964-e7fa-4e3e-8b2f-dcbe55f1ee94', 'dc7fdd91-c8e4-4ff5-b636-4c75def7762d', '59f789a1-4e0f-43c6-88d3-a77ff7826880', 'e98a7f10-e90b-431b-a5b1-aca286773a5c'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:22:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7773a84b-410f-4f4f-be5f-df6f65a9bb2e tempest-GroupsV314Test-1541269695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7773a84b-410f-4f4f-be5f-df6f65a9bb2e tempest-GroupsV314Test-1541269695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-7773a84b-410f-4f4f-be5f-df6f65a9bb2e tempest-GroupsV314Test-1541269695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:22:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-7773a84b-410f-4f4f-be5f-df6f65a9bb2e tempest-GroupsV314Test-1541269695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:22:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7773a84b-410f-4f4f-be5f-df6f65a9bb2e tempest-GroupsV314Test-1541269695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7773a84b-410f-4f4f-be5f-df6f65a9bb2e tempest-GroupsV314Test-1541269695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:06 devstack sudo[94049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:22:06 devstack sudo[94049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:06 devstack sudo[94043]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2d017de8-7cfa-4a9e-b163-53eba9e90fbf tempest-VolumeQuotasNegativeTestJSON-111842112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-9879b229-a338-4fd3-b38a-779f4693fa4b 1073741824" returned: 0 in 0.519s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2d017de8-7cfa-4a9e-b163-53eba9e90fbf tempest-VolumeQuotasNegativeTestJSON-111842112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-9879b229-a338-4fd3-b38a-779f4693fa4b {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:06 devstack sudo[94049]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:06 devstack sudo[94052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-9879b229-a338-4fd3-b38a-779f4693fa4b Nov 03 20:22:06 devstack sudo[94052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7773a84b-410f-4f4f-be5f-df6f65a9bb2e tempest-GroupsV314Test-1541269695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.277s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:06 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-7773a84b-410f-4f4f-be5f-df6f65a9bb2e tempest-GroupsV314Test-1541269695 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:22:06 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-7773a84b-410f-4f4f-be5f-df6f65a9bb2e tempest-GroupsV314Test-1541269695 None] Delete group completed successfully. Nov 03 20:22:06 devstack sudo[94052]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2d017de8-7cfa-4a9e-b163-53eba9e90fbf tempest-VolumeQuotasNegativeTestJSON-111842112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-9879b229-a338-4fd3-b38a-779f4693fa4b" returned: 0 in 0.266s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2d017de8-7cfa-4a9e-b163-53eba9e90fbf tempest-VolumeQuotasNegativeTestJSON-111842112 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:22:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2d017de8-7cfa-4a9e-b163-53eba9e90fbf tempest-VolumeQuotasNegativeTestJSON-111842112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-57f78074-43c1-4da4-9183-82d5a984291f tempest-SnapshotsActionsTest-781432807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.766s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2d017de8-7cfa-4a9e-b163-53eba9e90fbf tempest-VolumeQuotasNegativeTestJSON-111842112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e757a20-2c7e-4d2d-a6fe-1ad8f8273d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9879b229-a338-4fd3-b38a-779f4693fa4b', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2d017de8-7cfa-4a9e-b163-53eba9e90fbf tempest-VolumeQuotasNegativeTestJSON-111842112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22b427c1-69bc-41f1-98b1-3e3ca92712f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:07 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-57f78074-43c1-4da4-9183-82d5a984291f tempest-SnapshotsActionsTest-781432807 None] Creating offline snapshot ecac0ae3-b0a8-4932-9342-2e4a4f6192a3 of volume 1f95c6e9-a7fc-415a-915c-f9a7b581a097 {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:22:07 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-2d017de8-7cfa-4a9e-b163-53eba9e90fbf tempest-VolumeQuotasNegativeTestJSON-111842112 None] Volume volume-9879b229-a338-4fd3-b38a-779f4693fa4b (9879b229-a338-4fd3-b38a-779f4693fa4b): created successfully Nov 03 20:22:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2d017de8-7cfa-4a9e-b163-53eba9e90fbf tempest-VolumeQuotasNegativeTestJSON-111842112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22b427c1-69bc-41f1-98b1-3e3ca92712f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2d017de8-7cfa-4a9e-b163-53eba9e90fbf tempest-VolumeQuotasNegativeTestJSON-111842112 None] Flow 'volume_create_manager' (e457abbc-f32d-4d40-b1e5-820ed48dc019) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:22:07 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[4324f242-8500-4846-bece-b3bef66deecf]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-57f78074-43c1-4da4-9183-82d5a984291f tempest-SnapshotsActionsTest-781432807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:07 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-2d017de8-7cfa-4a9e-b163-53eba9e90fbf tempest-VolumeQuotasNegativeTestJSON-111842112 None] Created volume successfully. Nov 03 20:22:07 devstack sudo[94055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0 Nov 03 20:22:07 devstack sudo[94055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:07 devstack sudo[94055]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-57f78074-43c1-4da4-9183-82d5a984291f tempest-SnapshotsActionsTest-781432807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0" returned: 0 in 0.393s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:07 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-57f78074-43c1-4da4-9183-82d5a984291f tempest-SnapshotsActionsTest-781432807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:22:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-57f78074-43c1-4da4-9183-82d5a984291f tempest-SnapshotsActionsTest-781432807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.ecac0ae3-b0a8-4932-9342-2e4a4f6192a3 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:07 devstack sudo[94060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.ecac0ae3-b0a8-4932-9342-2e4a4f6192a3 1G Nov 03 20:22:07 devstack sudo[94060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:07 devstack sudo[94060]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-57f78074-43c1-4da4-9183-82d5a984291f tempest-SnapshotsActionsTest-781432807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.ecac0ae3-b0a8-4932-9342-2e4a4f6192a3 1G" returned: 0 in 0.458s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-57f78074-43c1-4da4-9183-82d5a984291f tempest-SnapshotsActionsTest-781432807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.ecac0ae3-b0a8-4932-9342-2e4a4f6192a3 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:08 devstack sudo[94066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.ecac0ae3-b0a8-4932-9342-2e4a4f6192a3 Nov 03 20:22:08 devstack sudo[94066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:08 devstack sudo[94066]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-57f78074-43c1-4da4-9183-82d5a984291f tempest-SnapshotsActionsTest-781432807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.ecac0ae3-b0a8-4932-9342-2e4a4f6192a3" returned: 0 in 0.363s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:08 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-57f78074-43c1-4da4-9183-82d5a984291f tempest-SnapshotsActionsTest-781432807 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.ecac0ae3-b0a8-4932-9342-2e4a4f6192a3 is being set with open permissions: ugo+rw Nov 03 20:22:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-57f78074-43c1-4da4-9183-82d5a984291f tempest-SnapshotsActionsTest-781432807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.ecac0ae3-b0a8-4932-9342-2e4a4f6192a3 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:08 devstack sudo[94072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.ecac0ae3-b0a8-4932-9342-2e4a4f6192a3 Nov 03 20:22:08 devstack sudo[94072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:08 devstack sudo[94072]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-57f78074-43c1-4da4-9183-82d5a984291f tempest-SnapshotsActionsTest-781432807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.ecac0ae3-b0a8-4932-9342-2e4a4f6192a3" returned: 0 in 0.289s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-57f78074-43c1-4da4-9183-82d5a984291f tempest-SnapshotsActionsTest-781432807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.664s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:08 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-57f78074-43c1-4da4-9183-82d5a984291f tempest-SnapshotsActionsTest-781432807 None] Create snapshot completed successfully Nov 03 20:22:09 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-40721e22-ea0c-4b09-bf1e-fcfe1bf08892 tempest-SnapshotsActionsTest-1452323867 None] Acquiring lock "cinder-ecac0ae3-b0a8-4932-9342-2e4a4f6192a3-delete_snapshot" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:09 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-40721e22-ea0c-4b09-bf1e-fcfe1bf08892 tempest-SnapshotsActionsTest-1452323867 None] Lock "cinder-ecac0ae3-b0a8-4932-9342-2e4a4f6192a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:09 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-40721e22-ea0c-4b09-bf1e-fcfe1bf08892 tempest-SnapshotsActionsTest-1452323867 None] Acquiring lock "cinder-quobyte-1f95c6e9-a7fc-415a-915c-f9a7b581a097" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:09 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-40721e22-ea0c-4b09-bf1e-fcfe1bf08892 tempest-SnapshotsActionsTest-1452323867 None] Lock "cinder-quobyte-1f95c6e9-a7fc-415a-915c-f9a7b581a097" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:09 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-40721e22-ea0c-4b09-bf1e-fcfe1bf08892 tempest-SnapshotsActionsTest-1452323867 None] Acquiring lock "cinder-quobyte-ecac0ae3-b0a8-4932-9342-2e4a4f6192a3" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:09 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-40721e22-ea0c-4b09-bf1e-fcfe1bf08892 tempest-SnapshotsActionsTest-1452323867 None] Lock "cinder-quobyte-ecac0ae3-b0a8-4932-9342-2e4a4f6192a3" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:09 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-40721e22-ea0c-4b09-bf1e-fcfe1bf08892 tempest-SnapshotsActionsTest-1452323867 None] Deleting offline snapshot ecac0ae3-b0a8-4932-9342-2e4a4f6192a3 of volume 1f95c6e9-a7fc-415a-915c-f9a7b581a097 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:22:09 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-40721e22-ea0c-4b09-bf1e-fcfe1bf08892 tempest-SnapshotsActionsTest-1452323867 None] snapshot_file for this snap is: volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.ecac0ae3-b0a8-4932-9342-2e4a4f6192a3 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:22:09 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[540223c0-756c-4d47-87af-b3e4e283efaa]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-40721e22-ea0c-4b09-bf1e-fcfe1bf08892 tempest-SnapshotsActionsTest-1452323867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.ecac0ae3-b0a8-4932-9342-2e4a4f6192a3 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:09 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c321dc25-e990-47ac-b739-a992a98d51bc tempest-VolumeQuotasNegativeTestJSON-111842112 None] Acquiring lock "cinder-9879b229-a338-4fd3-b38a-779f4693fa4b-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:09 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c321dc25-e990-47ac-b739-a992a98d51bc tempest-VolumeQuotasNegativeTestJSON-111842112 None] Lock "cinder-9879b229-a338-4fd3-b38a-779f4693fa4b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:09 devstack sudo[94075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.ecac0ae3-b0a8-4932-9342-2e4a4f6192a3 Nov 03 20:22:09 devstack sudo[94075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:10 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c321dc25-e990-47ac-b739-a992a98d51bc tempest-VolumeQuotasNegativeTestJSON-111842112 None] Acquiring lock "cinder-quobyte-9879b229-a338-4fd3-b38a-779f4693fa4b" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:10 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c321dc25-e990-47ac-b739-a992a98d51bc tempest-VolumeQuotasNegativeTestJSON-111842112 None] Lock "cinder-quobyte-9879b229-a338-4fd3-b38a-779f4693fa4b" acquired by "delete_volume" :: waited 0.022s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:10 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c04231-4473-47d8-b5eb-fd5043d72f7d]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c321dc25-e990-47ac-b739-a992a98d51bc tempest-VolumeQuotasNegativeTestJSON-111842112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-9879b229-a338-4fd3-b38a-779f4693fa4b {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:10 devstack sudo[94077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-9879b229-a338-4fd3-b38a-779f4693fa4b Nov 03 20:22:10 devstack sudo[94077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:10 devstack sudo[94075]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-40721e22-ea0c-4b09-bf1e-fcfe1bf08892 tempest-SnapshotsActionsTest-1452323867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.ecac0ae3-b0a8-4932-9342-2e4a4f6192a3" returned: 0 in 0.562s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:10 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-40721e22-ea0c-4b09-bf1e-fcfe1bf08892 tempest-SnapshotsActionsTest-1452323867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:22:10 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7abf59-17c4-4fe9-9d97-a2104cd1bd93]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-40721e22-ea0c-4b09-bf1e-fcfe1bf08892 tempest-SnapshotsActionsTest-1452323867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:10 devstack sudo[94077]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c321dc25-e990-47ac-b739-a992a98d51bc tempest-VolumeQuotasNegativeTestJSON-111842112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-9879b229-a338-4fd3-b38a-779f4693fa4b" returned: 0 in 0.481s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c321dc25-e990-47ac-b739-a992a98d51bc tempest-VolumeQuotasNegativeTestJSON-111842112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-9879b229-a338-4fd3-b38a-779f4693fa4b {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:10 devstack sudo[94088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-9879b229-a338-4fd3-b38a-779f4693fa4b Nov 03 20:22:10 devstack sudo[94088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:10 devstack sudo[94086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0 Nov 03 20:22:10 devstack sudo[94086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:10 devstack sudo[94088]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c321dc25-e990-47ac-b739-a992a98d51bc tempest-VolumeQuotasNegativeTestJSON-111842112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-9879b229-a338-4fd3-b38a-779f4693fa4b" returned: 0 in 0.291s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:10 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c321dc25-e990-47ac-b739-a992a98d51bc tempest-VolumeQuotasNegativeTestJSON-111842112 None] Lock "cinder-quobyte-9879b229-a338-4fd3-b38a-779f4693fa4b" released by "delete_volume" :: held 0.837s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:10 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-c321dc25-e990-47ac-b739-a992a98d51bc tempest-VolumeQuotasNegativeTestJSON-111842112 None] Created reservations ['6c8b7456-43b9-4674-92ba-7db2377ede7d', 'd0188163-8960-4fee-ad32-aeef110acbf7', '51b6baa0-e2af-4f82-823c-34081f11401d', '12184ab8-4728-491c-9d43-30b071678b40'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:22:10 devstack sudo[94086]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-40721e22-ea0c-4b09-bf1e-fcfe1bf08892 tempest-SnapshotsActionsTest-1452323867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0" returned: 0 in 0.477s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:10 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-40721e22-ea0c-4b09-bf1e-fcfe1bf08892 tempest-SnapshotsActionsTest-1452323867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:22:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-40721e22-ea0c-4b09-bf1e-fcfe1bf08892 tempest-SnapshotsActionsTest-1452323867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.ecac0ae3-b0a8-4932-9342-2e4a4f6192a3 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:11 devstack sudo[94095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.ecac0ae3-b0a8-4932-9342-2e4a4f6192a3 Nov 03 20:22:11 devstack sudo[94095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c321dc25-e990-47ac-b739-a992a98d51bc tempest-VolumeQuotasNegativeTestJSON-111842112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c321dc25-e990-47ac-b739-a992a98d51bc tempest-VolumeQuotasNegativeTestJSON-111842112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:11 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c321dc25-e990-47ac-b739-a992a98d51bc tempest-VolumeQuotasNegativeTestJSON-111842112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:22:11 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c321dc25-e990-47ac-b739-a992a98d51bc tempest-VolumeQuotasNegativeTestJSON-111842112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:22:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c321dc25-e990-47ac-b739-a992a98d51bc tempest-VolumeQuotasNegativeTestJSON-111842112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c321dc25-e990-47ac-b739-a992a98d51bc tempest-VolumeQuotasNegativeTestJSON-111842112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:11 devstack sudo[94097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:22:11 devstack sudo[94097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:11 devstack sudo[94097]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c321dc25-e990-47ac-b739-a992a98d51bc tempest-VolumeQuotasNegativeTestJSON-111842112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.297s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:11 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-c321dc25-e990-47ac-b739-a992a98d51bc tempest-VolumeQuotasNegativeTestJSON-111842112 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:22:11 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-c321dc25-e990-47ac-b739-a992a98d51bc tempest-VolumeQuotasNegativeTestJSON-111842112 None] Deleted volume successfully. Nov 03 20:22:11 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c321dc25-e990-47ac-b739-a992a98d51bc tempest-VolumeQuotasNegativeTestJSON-111842112 None] Lock "cinder-9879b229-a338-4fd3-b38a-779f4693fa4b-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:11 devstack sudo[94095]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-40721e22-ea0c-4b09-bf1e-fcfe1bf08892 tempest-SnapshotsActionsTest-1452323867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.ecac0ae3-b0a8-4932-9342-2e4a4f6192a3" returned: 0 in 0.528s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-40721e22-ea0c-4b09-bf1e-fcfe1bf08892 tempest-SnapshotsActionsTest-1452323867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.ecac0ae3-b0a8-4932-9342-2e4a4f6192a3 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:11 devstack sudo[94109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.ecac0ae3-b0a8-4932-9342-2e4a4f6192a3 Nov 03 20:22:11 devstack sudo[94109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:11 devstack sudo[94109]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-40721e22-ea0c-4b09-bf1e-fcfe1bf08892 tempest-SnapshotsActionsTest-1452323867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.ecac0ae3-b0a8-4932-9342-2e4a4f6192a3" returned: 0 in 0.334s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:11 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-40721e22-ea0c-4b09-bf1e-fcfe1bf08892 tempest-SnapshotsActionsTest-1452323867 None] Lock "cinder-quobyte-ecac0ae3-b0a8-4932-9342-2e4a4f6192a3" released by "_delete_snapshot" :: held 2.144s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:11 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-40721e22-ea0c-4b09-bf1e-fcfe1bf08892 tempest-SnapshotsActionsTest-1452323867 None] Lock "cinder-quobyte-1f95c6e9-a7fc-415a-915c-f9a7b581a097" released by "delete_snapshot" :: held 2.189s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:12 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-40721e22-ea0c-4b09-bf1e-fcfe1bf08892 tempest-SnapshotsActionsTest-1452323867 None] Created reservations ['2fed8b12-aa5f-4838-9b89-f66e99e30bac', 'd3f2656c-e260-48a8-975a-d3a213e5017a', 'af86c551-33a3-412d-862c-41c89ffb3108', 'ebdc4db5-68d9-404f-aa56-da2527fc1d34'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:22:12 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-40721e22-ea0c-4b09-bf1e-fcfe1bf08892 tempest-SnapshotsActionsTest-1452323867 None] Delete snapshot completed successfully. Nov 03 20:22:12 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-40721e22-ea0c-4b09-bf1e-fcfe1bf08892 tempest-SnapshotsActionsTest-1452323867 None] Lock "cinder-ecac0ae3-b0a8-4932-9342-2e4a4f6192a3-delete_snapshot" released by "delete_snapshot" :: held 2.489s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-74eeb0ad-950d-468b-8b6f-c326962415c2 tempest-SnapshotsActionsTest-781432807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-74eeb0ad-950d-468b-8b6f-c326962415c2 tempest-SnapshotsActionsTest-781432807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:13 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-74eeb0ad-950d-468b-8b6f-c326962415c2 tempest-SnapshotsActionsTest-781432807 None] Creating offline snapshot f0d577fd-a4bb-45c0-a2f2-271bd04501d6 of volume 1f95c6e9-a7fc-415a-915c-f9a7b581a097 {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:22:13 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[21cfaffd-b6fe-4851-bf84-4d7152d23ecf]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-74eeb0ad-950d-468b-8b6f-c326962415c2 tempest-SnapshotsActionsTest-781432807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:13 devstack sudo[94115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0 Nov 03 20:22:13 devstack sudo[94115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:14 devstack sudo[94115]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-74eeb0ad-950d-468b-8b6f-c326962415c2 tempest-SnapshotsActionsTest-781432807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0" returned: 0 in 0.582s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:14 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-74eeb0ad-950d-468b-8b6f-c326962415c2 tempest-SnapshotsActionsTest-781432807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:22:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-74eeb0ad-950d-468b-8b6f-c326962415c2 tempest-SnapshotsActionsTest-781432807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.f0d577fd-a4bb-45c0-a2f2-271bd04501d6 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:14 devstack sudo[94120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.f0d577fd-a4bb-45c0-a2f2-271bd04501d6 1G Nov 03 20:22:14 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-eda64c52-dc07-489d-95e6-f0010f7d5b56 tempest-GroupsV320Test-1738183126 None] Group tempest-GroupsV320Test-Group-2010566050: creating Nov 03 20:22:14 devstack sudo[94120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:14 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-eda64c52-dc07-489d-95e6-f0010f7d5b56 tempest-GroupsV320Test-1738183126 None] Group tempest-GroupsV320Test-Group-2010566050: created successfully Nov 03 20:22:14 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-eda64c52-dc07-489d-95e6-f0010f7d5b56 tempest-GroupsV320Test-1738183126 None] Create group completed successfully. Nov 03 20:22:14 devstack sudo[94120]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-74eeb0ad-950d-468b-8b6f-c326962415c2 tempest-SnapshotsActionsTest-781432807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.f0d577fd-a4bb-45c0-a2f2-271bd04501d6 1G" returned: 0 in 0.722s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-74eeb0ad-950d-468b-8b6f-c326962415c2 tempest-SnapshotsActionsTest-781432807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.f0d577fd-a4bb-45c0-a2f2-271bd04501d6 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:14 devstack sudo[94145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.f0d577fd-a4bb-45c0-a2f2-271bd04501d6 Nov 03 20:22:14 devstack sudo[94145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:15 devstack sudo[94145]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-74eeb0ad-950d-468b-8b6f-c326962415c2 tempest-SnapshotsActionsTest-781432807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.f0d577fd-a4bb-45c0-a2f2-271bd04501d6" returned: 0 in 0.453s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:15 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-74eeb0ad-950d-468b-8b6f-c326962415c2 tempest-SnapshotsActionsTest-781432807 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.f0d577fd-a4bb-45c0-a2f2-271bd04501d6 is being set with open permissions: ugo+rw Nov 03 20:22:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-74eeb0ad-950d-468b-8b6f-c326962415c2 tempest-SnapshotsActionsTest-781432807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.f0d577fd-a4bb-45c0-a2f2-271bd04501d6 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:15 devstack sudo[94159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.f0d577fd-a4bb-45c0-a2f2-271bd04501d6 Nov 03 20:22:15 devstack sudo[94159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:15 devstack sudo[94159]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-74eeb0ad-950d-468b-8b6f-c326962415c2 tempest-SnapshotsActionsTest-781432807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.f0d577fd-a4bb-45c0-a2f2-271bd04501d6" returned: 0 in 0.406s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-74eeb0ad-950d-468b-8b6f-c326962415c2 tempest-SnapshotsActionsTest-781432807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.331s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:15 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-74eeb0ad-950d-468b-8b6f-c326962415c2 tempest-SnapshotsActionsTest-781432807 None] Create snapshot completed successfully Nov 03 20:22:15 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-adfa24c5-a8ca-4a86-a734-f69fe0a31a26 tempest-GroupsV320Test-1738183126 None] Created reservations ['fc69442f-8aa7-4972-b045-28e3a305d59e'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:22:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-adfa24c5-a8ca-4a86-a734-f69fe0a31a26 tempest-GroupsV320Test-1738183126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-adfa24c5-a8ca-4a86-a734-f69fe0a31a26 tempest-GroupsV320Test-1738183126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:16 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-adfa24c5-a8ca-4a86-a734-f69fe0a31a26 tempest-GroupsV320Test-1738183126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:22:16 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-adfa24c5-a8ca-4a86-a734-f69fe0a31a26 tempest-GroupsV320Test-1738183126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:22:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-adfa24c5-a8ca-4a86-a734-f69fe0a31a26 tempest-GroupsV320Test-1738183126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-adfa24c5-a8ca-4a86-a734-f69fe0a31a26 tempest-GroupsV320Test-1738183126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:16 devstack sudo[94163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:22:16 devstack sudo[94163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:16 devstack sudo[94163]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-adfa24c5-a8ca-4a86-a734-f69fe0a31a26 tempest-GroupsV320Test-1738183126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.298s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:16 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-adfa24c5-a8ca-4a86-a734-f69fe0a31a26 tempest-GroupsV320Test-1738183126 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:22:16 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-adfa24c5-a8ca-4a86-a734-f69fe0a31a26 tempest-GroupsV320Test-1738183126 None] Delete group completed successfully. Nov 03 20:22:16 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-8ab639a0-8ea7-4fb5-b6dc-cb7b25472e9c req-a4864e04-bcfd-4625-a234-b7db5e4cdb2a tempest-ServerActionsTestOtherA-836700016 None] Terminate volume connection completed successfully. Nov 03 20:22:16 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-8ab639a0-8ea7-4fb5-b6dc-cb7b25472e9c req-a4864e04-bcfd-4625-a234-b7db5e4cdb2a tempest-ServerActionsTestOtherA-836700016 None] Deleting attachment 0e338795-a18e-476b-a7aa-cc62ea4e9a23. {{(pid=87248) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 20:22:16 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-be233d06-7865-45a4-96c1-396fe5254126 tempest-SnapshotsActionsTest-1452323867 None] Acquiring lock "cinder-f0d577fd-a4bb-45c0-a2f2-271bd04501d6-delete_snapshot" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:16 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-be233d06-7865-45a4-96c1-396fe5254126 tempest-SnapshotsActionsTest-1452323867 None] Lock "cinder-f0d577fd-a4bb-45c0-a2f2-271bd04501d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:16 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-be233d06-7865-45a4-96c1-396fe5254126 tempest-SnapshotsActionsTest-1452323867 None] Acquiring lock "cinder-quobyte-1f95c6e9-a7fc-415a-915c-f9a7b581a097" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:16 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-be233d06-7865-45a4-96c1-396fe5254126 tempest-SnapshotsActionsTest-1452323867 None] Lock "cinder-quobyte-1f95c6e9-a7fc-415a-915c-f9a7b581a097" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:16 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-be233d06-7865-45a4-96c1-396fe5254126 tempest-SnapshotsActionsTest-1452323867 None] Acquiring lock "cinder-quobyte-f0d577fd-a4bb-45c0-a2f2-271bd04501d6" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:16 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-be233d06-7865-45a4-96c1-396fe5254126 tempest-SnapshotsActionsTest-1452323867 None] Lock "cinder-quobyte-f0d577fd-a4bb-45c0-a2f2-271bd04501d6" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:16 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-be233d06-7865-45a4-96c1-396fe5254126 tempest-SnapshotsActionsTest-1452323867 None] Deleting offline snapshot f0d577fd-a4bb-45c0-a2f2-271bd04501d6 of volume 1f95c6e9-a7fc-415a-915c-f9a7b581a097 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:22:16 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-be233d06-7865-45a4-96c1-396fe5254126 tempest-SnapshotsActionsTest-1452323867 None] snapshot_file for this snap is: volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.f0d577fd-a4bb-45c0-a2f2-271bd04501d6 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:22:16 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a922f3-9d26-43e4-824c-3dd63be2da90]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-be233d06-7865-45a4-96c1-396fe5254126 tempest-SnapshotsActionsTest-1452323867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.f0d577fd-a4bb-45c0-a2f2-271bd04501d6 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:16 devstack cinder-volume[87248]: DEBUG cinder.coordination [req-8ab639a0-8ea7-4fb5-b6dc-cb7b25472e9c req-1f1887d9-062d-4971-9de9-11389d12c549 tempest-ServerActionsTestOtherA-836700016 None] Acquiring lock "cinder-6bbd0803-74df-43c1-a49e-75f29e4f1597-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:16 devstack cinder-volume[87248]: DEBUG cinder.coordination [req-8ab639a0-8ea7-4fb5-b6dc-cb7b25472e9c req-1f1887d9-062d-4971-9de9-11389d12c549 tempest-ServerActionsTestOtherA-836700016 None] Lock "cinder-6bbd0803-74df-43c1-a49e-75f29e4f1597-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:16 devstack sudo[94168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.f0d577fd-a4bb-45c0-a2f2-271bd04501d6 Nov 03 20:22:16 devstack sudo[94168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:16 devstack cinder-volume[87248]: DEBUG cinder.coordination [req-8ab639a0-8ea7-4fb5-b6dc-cb7b25472e9c req-1f1887d9-062d-4971-9de9-11389d12c549 tempest-ServerActionsTestOtherA-836700016 None] Acquiring lock "cinder-quobyte-6bbd0803-74df-43c1-a49e-75f29e4f1597" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:16 devstack cinder-volume[87248]: DEBUG cinder.coordination [req-8ab639a0-8ea7-4fb5-b6dc-cb7b25472e9c req-1f1887d9-062d-4971-9de9-11389d12c549 tempest-ServerActionsTestOtherA-836700016 None] Lock "cinder-quobyte-6bbd0803-74df-43c1-a49e-75f29e4f1597" acquired by "delete_volume" :: waited 0.039s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:17 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[683d89dd-0f4b-4a42-8fbd-e2223fce5256]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-8ab639a0-8ea7-4fb5-b6dc-cb7b25472e9c req-1f1887d9-062d-4971-9de9-11389d12c549 tempest-ServerActionsTestOtherA-836700016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6bbd0803-74df-43c1-a49e-75f29e4f1597 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:17 devstack sudo[94170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6bbd0803-74df-43c1-a49e-75f29e4f1597 Nov 03 20:22:17 devstack sudo[94170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:17 devstack sudo[94168]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-be233d06-7865-45a4-96c1-396fe5254126 tempest-SnapshotsActionsTest-1452323867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.f0d577fd-a4bb-45c0-a2f2-271bd04501d6" returned: 0 in 0.714s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:17 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-be233d06-7865-45a4-96c1-396fe5254126 tempest-SnapshotsActionsTest-1452323867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:22:17 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbb1490-2bd7-417d-a72b-06ac584269c1]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-be233d06-7865-45a4-96c1-396fe5254126 tempest-SnapshotsActionsTest-1452323867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:17 devstack sudo[94181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0 Nov 03 20:22:17 devstack sudo[94181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:17 devstack sudo[94170]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-8ab639a0-8ea7-4fb5-b6dc-cb7b25472e9c req-1f1887d9-062d-4971-9de9-11389d12c549 tempest-ServerActionsTestOtherA-836700016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6bbd0803-74df-43c1-a49e-75f29e4f1597" returned: 0 in 0.796s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-8ab639a0-8ea7-4fb5-b6dc-cb7b25472e9c req-1f1887d9-062d-4971-9de9-11389d12c549 tempest-ServerActionsTestOtherA-836700016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6bbd0803-74df-43c1-a49e-75f29e4f1597 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:17 devstack sudo[94191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6bbd0803-74df-43c1-a49e-75f29e4f1597 Nov 03 20:22:17 devstack sudo[94191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:18 devstack sudo[94181]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-be233d06-7865-45a4-96c1-396fe5254126 tempest-SnapshotsActionsTest-1452323867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0" returned: 0 in 0.591s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:18 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-be233d06-7865-45a4-96c1-396fe5254126 tempest-SnapshotsActionsTest-1452323867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:22:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-be233d06-7865-45a4-96c1-396fe5254126 tempest-SnapshotsActionsTest-1452323867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.f0d577fd-a4bb-45c0-a2f2-271bd04501d6 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:18 devstack sudo[94197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.f0d577fd-a4bb-45c0-a2f2-271bd04501d6 Nov 03 20:22:18 devstack sudo[94197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:18 devstack sudo[94191]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-8ab639a0-8ea7-4fb5-b6dc-cb7b25472e9c req-1f1887d9-062d-4971-9de9-11389d12c549 tempest-ServerActionsTestOtherA-836700016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6bbd0803-74df-43c1-a49e-75f29e4f1597" returned: 0 in 0.419s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:18 devstack cinder-volume[87248]: DEBUG cinder.coordination [req-8ab639a0-8ea7-4fb5-b6dc-cb7b25472e9c req-1f1887d9-062d-4971-9de9-11389d12c549 tempest-ServerActionsTestOtherA-836700016 None] Lock "cinder-quobyte-6bbd0803-74df-43c1-a49e-75f29e4f1597" released by "delete_volume" :: held 1.318s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:18 devstack cinder-volume[87248]: DEBUG cinder.quota [req-8ab639a0-8ea7-4fb5-b6dc-cb7b25472e9c req-1f1887d9-062d-4971-9de9-11389d12c549 tempest-ServerActionsTestOtherA-836700016 None] Created reservations ['93acd6ee-6f1e-4b90-806e-82dca2426eb9', '28717fc6-5d45-493f-99b4-375aafa62287', '1ef136c3-e17f-463e-8e33-719f487b7021', '999bc0d3-a8ba-412d-80fd-fce0e62dc202'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:22:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-8ab639a0-8ea7-4fb5-b6dc-cb7b25472e9c req-1f1887d9-062d-4971-9de9-11389d12c549 tempest-ServerActionsTestOtherA-836700016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-8ab639a0-8ea7-4fb5-b6dc-cb7b25472e9c req-1f1887d9-062d-4971-9de9-11389d12c549 tempest-ServerActionsTestOtherA-836700016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:18 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [req-8ab639a0-8ea7-4fb5-b6dc-cb7b25472e9c req-1f1887d9-062d-4971-9de9-11389d12c549 tempest-ServerActionsTestOtherA-836700016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:22:18 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [req-8ab639a0-8ea7-4fb5-b6dc-cb7b25472e9c req-1f1887d9-062d-4971-9de9-11389d12c549 tempest-ServerActionsTestOtherA-836700016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:22:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-8ab639a0-8ea7-4fb5-b6dc-cb7b25472e9c req-1f1887d9-062d-4971-9de9-11389d12c549 tempest-ServerActionsTestOtherA-836700016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-8ab639a0-8ea7-4fb5-b6dc-cb7b25472e9c req-1f1887d9-062d-4971-9de9-11389d12c549 tempest-ServerActionsTestOtherA-836700016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:18 devstack sudo[94203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:22:18 devstack sudo[94203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:18 devstack sudo[94197]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-be233d06-7865-45a4-96c1-396fe5254126 tempest-SnapshotsActionsTest-1452323867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.f0d577fd-a4bb-45c0-a2f2-271bd04501d6" returned: 0 in 0.485s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-be233d06-7865-45a4-96c1-396fe5254126 tempest-SnapshotsActionsTest-1452323867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.f0d577fd-a4bb-45c0-a2f2-271bd04501d6 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:18 devstack sudo[94206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.f0d577fd-a4bb-45c0-a2f2-271bd04501d6 Nov 03 20:22:18 devstack sudo[94206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:18 devstack sudo[94203]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-8ab639a0-8ea7-4fb5-b6dc-cb7b25472e9c req-1f1887d9-062d-4971-9de9-11389d12c549 tempest-ServerActionsTestOtherA-836700016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.299s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:18 devstack cinder-volume[87248]: DEBUG cinder.manager [req-8ab639a0-8ea7-4fb5-b6dc-cb7b25472e9c req-1f1887d9-062d-4971-9de9-11389d12c549 tempest-ServerActionsTestOtherA-836700016 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:22:18 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-8ab639a0-8ea7-4fb5-b6dc-cb7b25472e9c req-1f1887d9-062d-4971-9de9-11389d12c549 tempest-ServerActionsTestOtherA-836700016 None] Deleted volume successfully. Nov 03 20:22:18 devstack cinder-volume[87248]: DEBUG cinder.coordination [req-8ab639a0-8ea7-4fb5-b6dc-cb7b25472e9c req-1f1887d9-062d-4971-9de9-11389d12c549 tempest-ServerActionsTestOtherA-836700016 None] Lock "cinder-6bbd0803-74df-43c1-a49e-75f29e4f1597-delete_volume" released by "delete_volume" :: held 1.966s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:18 devstack sudo[94206]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-be233d06-7865-45a4-96c1-396fe5254126 tempest-SnapshotsActionsTest-1452323867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.f0d577fd-a4bb-45c0-a2f2-271bd04501d6" returned: 0 in 0.346s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:19 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-be233d06-7865-45a4-96c1-396fe5254126 tempest-SnapshotsActionsTest-1452323867 None] Lock "cinder-quobyte-f0d577fd-a4bb-45c0-a2f2-271bd04501d6" released by "_delete_snapshot" :: held 2.313s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:19 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-be233d06-7865-45a4-96c1-396fe5254126 tempest-SnapshotsActionsTest-1452323867 None] Lock "cinder-quobyte-1f95c6e9-a7fc-415a-915c-f9a7b581a097" released by "delete_snapshot" :: held 2.340s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:19 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ce209372-4a45-40ef-b96a-4b7e51866d56 tempest-ServerActionsTestOtherA-836700016 None] Acquiring lock "cinder-5061afd4-d0a0-4715-809b-d47a7c2b83e4-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:19 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-be233d06-7865-45a4-96c1-396fe5254126 tempest-SnapshotsActionsTest-1452323867 None] Created reservations ['257c9d4c-469b-422c-937a-9d598e19f24a', '4013c999-ec89-49ae-94a7-030bfb5e7c56', '1d4144c8-de62-40e8-b3f6-87874e4ddb1a', 'c8c5d696-c90e-4c93-b002-e5a530f02158'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:22:19 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ce209372-4a45-40ef-b96a-4b7e51866d56 tempest-ServerActionsTestOtherA-836700016 None] Lock "cinder-5061afd4-d0a0-4715-809b-d47a7c2b83e4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:19 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ce209372-4a45-40ef-b96a-4b7e51866d56 tempest-ServerActionsTestOtherA-836700016 None] Acquiring lock "cinder-quobyte-5061afd4-d0a0-4715-809b-d47a7c2b83e4" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:19 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ce209372-4a45-40ef-b96a-4b7e51866d56 tempest-ServerActionsTestOtherA-836700016 None] Lock "cinder-quobyte-5061afd4-d0a0-4715-809b-d47a7c2b83e4" acquired by "delete_volume" :: waited 0.028s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:19 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-be233d06-7865-45a4-96c1-396fe5254126 tempest-SnapshotsActionsTest-1452323867 None] Delete snapshot completed successfully. Nov 03 20:22:19 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-be233d06-7865-45a4-96c1-396fe5254126 tempest-SnapshotsActionsTest-1452323867 None] Lock "cinder-f0d577fd-a4bb-45c0-a2f2-271bd04501d6-delete_snapshot" released by "delete_snapshot" :: held 2.574s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:19 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4ba774-ead7-49f0-b741-d83a6e7731e5]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ce209372-4a45-40ef-b96a-4b7e51866d56 tempest-ServerActionsTestOtherA-836700016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5061afd4-d0a0-4715-809b-d47a7c2b83e4 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:19 devstack sudo[94210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5061afd4-d0a0-4715-809b-d47a7c2b83e4 Nov 03 20:22:19 devstack sudo[94210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:19 devstack sudo[94210]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ce209372-4a45-40ef-b96a-4b7e51866d56 tempest-ServerActionsTestOtherA-836700016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5061afd4-d0a0-4715-809b-d47a7c2b83e4" returned: 0 in 0.437s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ce209372-4a45-40ef-b96a-4b7e51866d56 tempest-ServerActionsTestOtherA-836700016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5061afd4-d0a0-4715-809b-d47a7c2b83e4 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:19 devstack sudo[94215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5061afd4-d0a0-4715-809b-d47a7c2b83e4 Nov 03 20:22:19 devstack sudo[94215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:20 devstack sudo[94215]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ce209372-4a45-40ef-b96a-4b7e51866d56 tempest-ServerActionsTestOtherA-836700016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5061afd4-d0a0-4715-809b-d47a7c2b83e4" returned: 0 in 0.379s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:20 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ce209372-4a45-40ef-b96a-4b7e51866d56 tempest-ServerActionsTestOtherA-836700016 None] Lock "cinder-quobyte-5061afd4-d0a0-4715-809b-d47a7c2b83e4" released by "delete_volume" :: held 0.881s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:20 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-ce209372-4a45-40ef-b96a-4b7e51866d56 tempest-ServerActionsTestOtherA-836700016 None] Created reservations ['0e686c31-297c-4d50-beab-595369a30f63', '9c14fdea-116f-4a3d-96d5-0e014ccd872d', '2bb2b8cc-76e5-4476-b5fc-727c3e806749', '02003668-05d6-4fbf-92d5-5da925621c91'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:22:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ce209372-4a45-40ef-b96a-4b7e51866d56 tempest-ServerActionsTestOtherA-836700016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ce209372-4a45-40ef-b96a-4b7e51866d56 tempest-ServerActionsTestOtherA-836700016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:20 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-ce209372-4a45-40ef-b96a-4b7e51866d56 tempest-ServerActionsTestOtherA-836700016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:22:20 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-ce209372-4a45-40ef-b96a-4b7e51866d56 tempest-ServerActionsTestOtherA-836700016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:22:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ce209372-4a45-40ef-b96a-4b7e51866d56 tempest-ServerActionsTestOtherA-836700016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ce209372-4a45-40ef-b96a-4b7e51866d56 tempest-ServerActionsTestOtherA-836700016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:20 devstack sudo[94218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:22:20 devstack sudo[94218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-13f9ace7-72b3-48b0-93e7-784b638cd75e tempest-SnapshotsActionsTest-781432807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-13f9ace7-72b3-48b0-93e7-784b638cd75e tempest-SnapshotsActionsTest-781432807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:20 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-13f9ace7-72b3-48b0-93e7-784b638cd75e tempest-SnapshotsActionsTest-781432807 None] Creating offline snapshot 6f44580d-91b3-4d36-bfd2-dac3b6d2214a of volume 1f95c6e9-a7fc-415a-915c-f9a7b581a097 {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:22:20 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a0cd5d-f5f5-40ce-909a-6ab2b9c3b7a9]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-13f9ace7-72b3-48b0-93e7-784b638cd75e tempest-SnapshotsActionsTest-781432807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:20 devstack sudo[94221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0 Nov 03 20:22:20 devstack sudo[94221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:20 devstack sudo[94218]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ce209372-4a45-40ef-b96a-4b7e51866d56 tempest-ServerActionsTestOtherA-836700016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.485s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:20 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-ce209372-4a45-40ef-b96a-4b7e51866d56 tempest-ServerActionsTestOtherA-836700016 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:22:20 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-ce209372-4a45-40ef-b96a-4b7e51866d56 tempest-ServerActionsTestOtherA-836700016 None] Deleted volume successfully. Nov 03 20:22:20 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ce209372-4a45-40ef-b96a-4b7e51866d56 tempest-ServerActionsTestOtherA-836700016 None] Lock "cinder-5061afd4-d0a0-4715-809b-d47a7c2b83e4-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:21 devstack sudo[94221]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-13f9ace7-72b3-48b0-93e7-784b638cd75e tempest-SnapshotsActionsTest-781432807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0" returned: 0 in 0.647s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-13f9ace7-72b3-48b0-93e7-784b638cd75e tempest-SnapshotsActionsTest-781432807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:22:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-13f9ace7-72b3-48b0-93e7-784b638cd75e tempest-SnapshotsActionsTest-781432807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.6f44580d-91b3-4d36-bfd2-dac3b6d2214a 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:21 devstack sudo[94246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.6f44580d-91b3-4d36-bfd2-dac3b6d2214a 1G Nov 03 20:22:21 devstack sudo[94246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:21 devstack sudo[94246]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-13f9ace7-72b3-48b0-93e7-784b638cd75e tempest-SnapshotsActionsTest-781432807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.6f44580d-91b3-4d36-bfd2-dac3b6d2214a 1G" returned: 0 in 0.678s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-13f9ace7-72b3-48b0-93e7-784b638cd75e tempest-SnapshotsActionsTest-781432807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.6f44580d-91b3-4d36-bfd2-dac3b6d2214a {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:21 devstack sudo[94258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.6f44580d-91b3-4d36-bfd2-dac3b6d2214a Nov 03 20:22:21 devstack sudo[94258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:22 devstack sudo[94258]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-13f9ace7-72b3-48b0-93e7-784b638cd75e tempest-SnapshotsActionsTest-781432807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.6f44580d-91b3-4d36-bfd2-dac3b6d2214a" returned: 0 in 0.468s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:22 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-13f9ace7-72b3-48b0-93e7-784b638cd75e tempest-SnapshotsActionsTest-781432807 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.6f44580d-91b3-4d36-bfd2-dac3b6d2214a is being set with open permissions: ugo+rw Nov 03 20:22:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-13f9ace7-72b3-48b0-93e7-784b638cd75e tempest-SnapshotsActionsTest-781432807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.6f44580d-91b3-4d36-bfd2-dac3b6d2214a {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:22 devstack sudo[94266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.6f44580d-91b3-4d36-bfd2-dac3b6d2214a Nov 03 20:22:22 devstack sudo[94266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:22 devstack sudo[94266]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-13f9ace7-72b3-48b0-93e7-784b638cd75e tempest-SnapshotsActionsTest-781432807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.6f44580d-91b3-4d36-bfd2-dac3b6d2214a" returned: 0 in 0.385s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-13f9ace7-72b3-48b0-93e7-784b638cd75e tempest-SnapshotsActionsTest-781432807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.411s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:22 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-13f9ace7-72b3-48b0-93e7-784b638cd75e tempest-SnapshotsActionsTest-781432807 None] Create snapshot completed successfully Nov 03 20:22:23 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d15411d1-6c88-4a6c-802f-56607adc1097 tempest-SnapshotsActionsTest-1452323867 None] Acquiring lock "cinder-6f44580d-91b3-4d36-bfd2-dac3b6d2214a-delete_snapshot" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:23 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d15411d1-6c88-4a6c-802f-56607adc1097 tempest-SnapshotsActionsTest-1452323867 None] Lock "cinder-6f44580d-91b3-4d36-bfd2-dac3b6d2214a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:23 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d15411d1-6c88-4a6c-802f-56607adc1097 tempest-SnapshotsActionsTest-1452323867 None] Acquiring lock "cinder-quobyte-1f95c6e9-a7fc-415a-915c-f9a7b581a097" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:23 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d15411d1-6c88-4a6c-802f-56607adc1097 tempest-SnapshotsActionsTest-1452323867 None] Lock "cinder-quobyte-1f95c6e9-a7fc-415a-915c-f9a7b581a097" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:23 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d15411d1-6c88-4a6c-802f-56607adc1097 tempest-SnapshotsActionsTest-1452323867 None] Acquiring lock "cinder-quobyte-6f44580d-91b3-4d36-bfd2-dac3b6d2214a" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:23 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d15411d1-6c88-4a6c-802f-56607adc1097 tempest-SnapshotsActionsTest-1452323867 None] Lock "cinder-quobyte-6f44580d-91b3-4d36-bfd2-dac3b6d2214a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:23 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-d15411d1-6c88-4a6c-802f-56607adc1097 tempest-SnapshotsActionsTest-1452323867 None] Deleting offline snapshot 6f44580d-91b3-4d36-bfd2-dac3b6d2214a of volume 1f95c6e9-a7fc-415a-915c-f9a7b581a097 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:22:23 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-d15411d1-6c88-4a6c-802f-56607adc1097 tempest-SnapshotsActionsTest-1452323867 None] snapshot_file for this snap is: volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.6f44580d-91b3-4d36-bfd2-dac3b6d2214a {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:22:23 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[5187c4e3-7ba4-4008-95dd-ceef12a60487]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d15411d1-6c88-4a6c-802f-56607adc1097 tempest-SnapshotsActionsTest-1452323867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.6f44580d-91b3-4d36-bfd2-dac3b6d2214a {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:23 devstack sudo[94269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.6f44580d-91b3-4d36-bfd2-dac3b6d2214a Nov 03 20:22:23 devstack sudo[94269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:24 devstack sudo[94269]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d15411d1-6c88-4a6c-802f-56607adc1097 tempest-SnapshotsActionsTest-1452323867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.6f44580d-91b3-4d36-bfd2-dac3b6d2214a" returned: 0 in 0.522s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:24 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-d15411d1-6c88-4a6c-802f-56607adc1097 tempest-SnapshotsActionsTest-1452323867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:22:24 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[5952067b-4a87-4a80-8116-e6059cf35a00]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d15411d1-6c88-4a6c-802f-56607adc1097 tempest-SnapshotsActionsTest-1452323867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:24 devstack sudo[94275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0 Nov 03 20:22:24 devstack sudo[94275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:24 devstack sudo[94275]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d15411d1-6c88-4a6c-802f-56607adc1097 tempest-SnapshotsActionsTest-1452323867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0" returned: 0 in 0.512s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:24 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-d15411d1-6c88-4a6c-802f-56607adc1097 tempest-SnapshotsActionsTest-1452323867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:22:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d15411d1-6c88-4a6c-802f-56607adc1097 tempest-SnapshotsActionsTest-1452323867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.6f44580d-91b3-4d36-bfd2-dac3b6d2214a {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:24 devstack sudo[94281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.6f44580d-91b3-4d36-bfd2-dac3b6d2214a Nov 03 20:22:24 devstack sudo[94281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:25 devstack sudo[94281]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d15411d1-6c88-4a6c-802f-56607adc1097 tempest-SnapshotsActionsTest-1452323867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.6f44580d-91b3-4d36-bfd2-dac3b6d2214a" returned: 0 in 0.544s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d15411d1-6c88-4a6c-802f-56607adc1097 tempest-SnapshotsActionsTest-1452323867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.6f44580d-91b3-4d36-bfd2-dac3b6d2214a {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:25 devstack sudo[94286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.6f44580d-91b3-4d36-bfd2-dac3b6d2214a Nov 03 20:22:25 devstack sudo[94286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:25 devstack sudo[94286]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d15411d1-6c88-4a6c-802f-56607adc1097 tempest-SnapshotsActionsTest-1452323867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.6f44580d-91b3-4d36-bfd2-dac3b6d2214a" returned: 0 in 0.299s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:25 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d15411d1-6c88-4a6c-802f-56607adc1097 tempest-SnapshotsActionsTest-1452323867 None] Lock "cinder-quobyte-6f44580d-91b3-4d36-bfd2-dac3b6d2214a" released by "_delete_snapshot" :: held 2.030s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:25 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d15411d1-6c88-4a6c-802f-56607adc1097 tempest-SnapshotsActionsTest-1452323867 None] Lock "cinder-quobyte-1f95c6e9-a7fc-415a-915c-f9a7b581a097" released by "delete_snapshot" :: held 2.059s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:25 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-d15411d1-6c88-4a6c-802f-56607adc1097 tempest-SnapshotsActionsTest-1452323867 None] Created reservations ['64b046b0-da3b-48ff-ac2d-f25a59d84387', 'c20cc059-0290-4f3f-a414-40cc6e9f3c69', '9d227759-69f1-4ac7-9536-4a5a74f55aa4', 'eb09f99b-730d-4eb0-bf10-fbd6fc963677'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:22:25 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-d15411d1-6c88-4a6c-802f-56607adc1097 tempest-SnapshotsActionsTest-1452323867 None] Delete snapshot completed successfully. Nov 03 20:22:25 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d15411d1-6c88-4a6c-802f-56607adc1097 tempest-SnapshotsActionsTest-1452323867 None] Lock "cinder-6f44580d-91b3-4d36-bfd2-dac3b6d2214a-delete_snapshot" released by "delete_snapshot" :: held 2.288s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d08c86d5-ddc2-42e9-aeb5-716ee5cb92db tempest-SnapshotsActionsTest-781432807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d08c86d5-ddc2-42e9-aeb5-716ee5cb92db tempest-SnapshotsActionsTest-781432807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:27 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-d08c86d5-ddc2-42e9-aeb5-716ee5cb92db tempest-SnapshotsActionsTest-781432807 None] Creating offline snapshot 6ed2ace5-c5c7-4442-8f93-38ab9eb39bb5 of volume 1f95c6e9-a7fc-415a-915c-f9a7b581a097 {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:22:27 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[935df408-f14e-4f65-80d8-b030fec31f75]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d08c86d5-ddc2-42e9-aeb5-716ee5cb92db tempest-SnapshotsActionsTest-781432807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:27 devstack sudo[94290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0 Nov 03 20:22:27 devstack sudo[94290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:28 devstack sudo[94290]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d08c86d5-ddc2-42e9-aeb5-716ee5cb92db tempest-SnapshotsActionsTest-781432807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0" returned: 0 in 0.502s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-d08c86d5-ddc2-42e9-aeb5-716ee5cb92db tempest-SnapshotsActionsTest-781432807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:22:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d08c86d5-ddc2-42e9-aeb5-716ee5cb92db tempest-SnapshotsActionsTest-781432807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.6ed2ace5-c5c7-4442-8f93-38ab9eb39bb5 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:28 devstack sudo[94296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.6ed2ace5-c5c7-4442-8f93-38ab9eb39bb5 1G Nov 03 20:22:28 devstack sudo[94296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:28 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2927ae9-9f9f-43fe-a7bc-fef8e0615570 tempest-VolumesListAdminTestJSON-1825396183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:22:28 devstack sudo[94296]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:28 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a2927ae9-9f9f-43fe-a7bc-fef8e0615570 tempest-VolumesListAdminTestJSON-1825396183 None] Flow 'volume_create_manager' (01a2b939-9165-44dd-9058-4628a1d543e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:22:28 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a2927ae9-9f9f-43fe-a7bc-fef8e0615570 tempest-VolumesListAdminTestJSON-1825396183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b3c282c-5788-4faa-813b-83b276f018d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d08c86d5-ddc2-42e9-aeb5-716ee5cb92db tempest-SnapshotsActionsTest-781432807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.6ed2ace5-c5c7-4442-8f93-38ab9eb39bb5 1G" returned: 0 in 0.609s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d08c86d5-ddc2-42e9-aeb5-716ee5cb92db tempest-SnapshotsActionsTest-781432807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.6ed2ace5-c5c7-4442-8f93-38ab9eb39bb5 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:28 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a2927ae9-9f9f-43fe-a7bc-fef8e0615570 tempest-VolumesListAdminTestJSON-1825396183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b3c282c-5788-4faa-813b-83b276f018d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1096372607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e50eaf9-2927-4967-8272-686b5122d7ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b74a681ed3d4ff6b83d2fcf74a3f0f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:22:29Z,use_quota=True,user_id='bca733f17ad446bea9ef8f99d400559a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:28 devstack sudo[94302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.6ed2ace5-c5c7-4442-8f93-38ab9eb39bb5 Nov 03 20:22:28 devstack sudo[94302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:28 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a2927ae9-9f9f-43fe-a7bc-fef8e0615570 tempest-VolumesListAdminTestJSON-1825396183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f72931-e3fa-42f3-ba4b-34f01c67d750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:28 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a2927ae9-9f9f-43fe-a7bc-fef8e0615570 tempest-VolumesListAdminTestJSON-1825396183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f72931-e3fa-42f3-ba4b-34f01c67d750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:28 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a2927ae9-9f9f-43fe-a7bc-fef8e0615570 tempest-VolumesListAdminTestJSON-1825396183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cb62def-3f75-4d2d-8de8-322d757b9c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:28 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a2927ae9-9f9f-43fe-a7bc-fef8e0615570 tempest-VolumesListAdminTestJSON-1825396183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cb62def-3f75-4d2d-8de8-322d757b9c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e50eaf9-2927-4967-8272-686b5122d7ac', 'volume_name': 'volume-4e50eaf9-2927-4967-8272-686b5122d7ac', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:28 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a2927ae9-9f9f-43fe-a7bc-fef8e0615570 tempest-VolumesListAdminTestJSON-1825396183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fe14b91-26c5-4037-9b2e-9e7deee0ed0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:28 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a2927ae9-9f9f-43fe-a7bc-fef8e0615570 tempest-VolumesListAdminTestJSON-1825396183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fe14b91-26c5-4037-9b2e-9e7deee0ed0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:28 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a2927ae9-9f9f-43fe-a7bc-fef8e0615570 tempest-VolumesListAdminTestJSON-1825396183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (777b6e19-52a4-461c-8ac1-f3b33eb53230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:28 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-a2927ae9-9f9f-43fe-a7bc-fef8e0615570 tempest-VolumesListAdminTestJSON-1825396183 None] Volume 4e50eaf9-2927-4967-8272-686b5122d7ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e50eaf9-2927-4967-8272-686b5122d7ac', 'volume_size': 1} Nov 03 20:22:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a2927ae9-9f9f-43fe-a7bc-fef8e0615570 tempest-VolumesListAdminTestJSON-1825396183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:28 devstack cinder-volume[87248]: DEBUG oslo_service.periodic_task [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:22:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:22:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:22:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:28 devstack sudo[94304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:22:28 devstack sudo[94304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:29 devstack sudo[94302]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d08c86d5-ddc2-42e9-aeb5-716ee5cb92db tempest-SnapshotsActionsTest-781432807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.6ed2ace5-c5c7-4442-8f93-38ab9eb39bb5" returned: 0 in 0.485s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:29 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-d08c86d5-ddc2-42e9-aeb5-716ee5cb92db tempest-SnapshotsActionsTest-781432807 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.6ed2ace5-c5c7-4442-8f93-38ab9eb39bb5 is being set with open permissions: ugo+rw Nov 03 20:22:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d08c86d5-ddc2-42e9-aeb5-716ee5cb92db tempest-SnapshotsActionsTest-781432807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.6ed2ace5-c5c7-4442-8f93-38ab9eb39bb5 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:29 devstack sudo[94304]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.410s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:29 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:22:29 devstack sudo[94311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.6ed2ace5-c5c7-4442-8f93-38ab9eb39bb5 Nov 03 20:22:29 devstack sudo[94311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:29 devstack cinder-volume[87248]: DEBUG oslo_service.periodic_task [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running periodic task VolumeManager._thread_info {{(pid=87248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:22:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] thread count: 28 {{(pid=87248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:22:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] thread info: [<_MainThread(MainThread, started 124862067372160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:22:29 devstack sudo[94311]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d08c86d5-ddc2-42e9-aeb5-716ee5cb92db tempest-SnapshotsActionsTest-781432807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.6ed2ace5-c5c7-4442-8f93-38ab9eb39bb5" returned: 0 in 0.308s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d08c86d5-ddc2-42e9-aeb5-716ee5cb92db tempest-SnapshotsActionsTest-781432807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.023s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a2927ae9-9f9f-43fe-a7bc-fef8e0615570 tempest-VolumesListAdminTestJSON-1825396183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.775s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:29 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a2927ae9-9f9f-43fe-a7bc-fef8e0615570 tempest-VolumesListAdminTestJSON-1825396183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1096372607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e50eaf9-2927-4967-8272-686b5122d7ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b74a681ed3d4ff6b83d2fcf74a3f0f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:22:29Z,use_quota=True,user_id='bca733f17ad446bea9ef8f99d400559a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:22:29 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-a2927ae9-9f9f-43fe-a7bc-fef8e0615570 tempest-VolumesListAdminTestJSON-1825396183 None] Creating volume 4e50eaf9-2927-4967-8272-686b5122d7ac {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:22:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a2927ae9-9f9f-43fe-a7bc-fef8e0615570 tempest-VolumesListAdminTestJSON-1825396183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a2927ae9-9f9f-43fe-a7bc-fef8e0615570 tempest-VolumesListAdminTestJSON-1825396183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:29 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a2927ae9-9f9f-43fe-a7bc-fef8e0615570 tempest-VolumesListAdminTestJSON-1825396183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:22:29 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a2927ae9-9f9f-43fe-a7bc-fef8e0615570 tempest-VolumesListAdminTestJSON-1825396183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:22:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a2927ae9-9f9f-43fe-a7bc-fef8e0615570 tempest-VolumesListAdminTestJSON-1825396183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:29 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a2927ae9-9f9f-43fe-a7bc-fef8e0615570 tempest-VolumesListAdminTestJSON-1825396183 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:22:29 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-a2927ae9-9f9f-43fe-a7bc-fef8e0615570 tempest-VolumesListAdminTestJSON-1825396183 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:22:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a2927ae9-9f9f-43fe-a7bc-fef8e0615570 tempest-VolumesListAdminTestJSON-1825396183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4e50eaf9-2927-4967-8272-686b5122d7ac 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:29 devstack sudo[94314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4e50eaf9-2927-4967-8272-686b5122d7ac 1073741824 Nov 03 20:22:29 devstack sudo[94314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:29 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-d08c86d5-ddc2-42e9-aeb5-716ee5cb92db tempest-SnapshotsActionsTest-781432807 None] Create snapshot completed successfully Nov 03 20:22:30 devstack sudo[94314]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a2927ae9-9f9f-43fe-a7bc-fef8e0615570 tempest-VolumesListAdminTestJSON-1825396183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4e50eaf9-2927-4967-8272-686b5122d7ac 1073741824" returned: 0 in 0.530s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a2927ae9-9f9f-43fe-a7bc-fef8e0615570 tempest-VolumesListAdminTestJSON-1825396183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4e50eaf9-2927-4967-8272-686b5122d7ac {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:30 devstack sudo[94321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4e50eaf9-2927-4967-8272-686b5122d7ac Nov 03 20:22:30 devstack sudo[94321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:30 devstack sudo[94321]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a2927ae9-9f9f-43fe-a7bc-fef8e0615570 tempest-VolumesListAdminTestJSON-1825396183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4e50eaf9-2927-4967-8272-686b5122d7ac" returned: 0 in 0.274s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:30 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a2927ae9-9f9f-43fe-a7bc-fef8e0615570 tempest-VolumesListAdminTestJSON-1825396183 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:22:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a2927ae9-9f9f-43fe-a7bc-fef8e0615570 tempest-VolumesListAdminTestJSON-1825396183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:30 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a2927ae9-9f9f-43fe-a7bc-fef8e0615570 tempest-VolumesListAdminTestJSON-1825396183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (777b6e19-52a4-461c-8ac1-f3b33eb53230) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e50eaf9-2927-4967-8272-686b5122d7ac', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:30 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a2927ae9-9f9f-43fe-a7bc-fef8e0615570 tempest-VolumesListAdminTestJSON-1825396183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab87f3f0-be76-4def-be35-0ae26d231c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:30 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-a2927ae9-9f9f-43fe-a7bc-fef8e0615570 tempest-VolumesListAdminTestJSON-1825396183 None] Volume volume-4e50eaf9-2927-4967-8272-686b5122d7ac (4e50eaf9-2927-4967-8272-686b5122d7ac): created successfully Nov 03 20:22:30 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a2927ae9-9f9f-43fe-a7bc-fef8e0615570 tempest-VolumesListAdminTestJSON-1825396183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab87f3f0-be76-4def-be35-0ae26d231c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:30 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a2927ae9-9f9f-43fe-a7bc-fef8e0615570 tempest-VolumesListAdminTestJSON-1825396183 None] Flow 'volume_create_manager' (01a2b939-9165-44dd-9058-4628a1d543e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:22:30 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-a2927ae9-9f9f-43fe-a7bc-fef8e0615570 tempest-VolumesListAdminTestJSON-1825396183 None] Created volume successfully. Nov 03 20:22:30 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6bfe5d9c-90c4-4d4f-9e4b-30504a4658db tempest-SnapshotsActionsTest-1452323867 None] Acquiring lock "cinder-6ed2ace5-c5c7-4442-8f93-38ab9eb39bb5-delete_snapshot" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:30 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6bfe5d9c-90c4-4d4f-9e4b-30504a4658db tempest-SnapshotsActionsTest-1452323867 None] Lock "cinder-6ed2ace5-c5c7-4442-8f93-38ab9eb39bb5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.075s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:30 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6bfe5d9c-90c4-4d4f-9e4b-30504a4658db tempest-SnapshotsActionsTest-1452323867 None] Acquiring lock "cinder-quobyte-1f95c6e9-a7fc-415a-915c-f9a7b581a097" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:30 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6bfe5d9c-90c4-4d4f-9e4b-30504a4658db tempest-SnapshotsActionsTest-1452323867 None] Lock "cinder-quobyte-1f95c6e9-a7fc-415a-915c-f9a7b581a097" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:30 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6bfe5d9c-90c4-4d4f-9e4b-30504a4658db tempest-SnapshotsActionsTest-1452323867 None] Acquiring lock "cinder-quobyte-6ed2ace5-c5c7-4442-8f93-38ab9eb39bb5" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:30 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6bfe5d9c-90c4-4d4f-9e4b-30504a4658db tempest-SnapshotsActionsTest-1452323867 None] Lock "cinder-quobyte-6ed2ace5-c5c7-4442-8f93-38ab9eb39bb5" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:30 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-6bfe5d9c-90c4-4d4f-9e4b-30504a4658db tempest-SnapshotsActionsTest-1452323867 None] Deleting offline snapshot 6ed2ace5-c5c7-4442-8f93-38ab9eb39bb5 of volume 1f95c6e9-a7fc-415a-915c-f9a7b581a097 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:22:31 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-6bfe5d9c-90c4-4d4f-9e4b-30504a4658db tempest-SnapshotsActionsTest-1452323867 None] snapshot_file for this snap is: volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.6ed2ace5-c5c7-4442-8f93-38ab9eb39bb5 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:22:31 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[90843fc8-3d3e-4f56-9c2b-20a5a49a3597]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6bfe5d9c-90c4-4d4f-9e4b-30504a4658db tempest-SnapshotsActionsTest-1452323867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.6ed2ace5-c5c7-4442-8f93-38ab9eb39bb5 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:31 devstack sudo[94324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.6ed2ace5-c5c7-4442-8f93-38ab9eb39bb5 Nov 03 20:22:31 devstack sudo[94324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:31 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-0245357e-c0c5-4da9-ba29-be1208fd6898 tempest-VolumesListAdminTestJSON-1825396183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:22:31 devstack sudo[94324]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:31 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0245357e-c0c5-4da9-ba29-be1208fd6898 tempest-VolumesListAdminTestJSON-1825396183 None] Flow 'volume_create_manager' (0392bd03-2a18-4d48-a354-09869f1e136d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:22:31 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0245357e-c0c5-4da9-ba29-be1208fd6898 tempest-VolumesListAdminTestJSON-1825396183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (157cbfaa-9266-4d64-8e98-8ca9fac5c334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6bfe5d9c-90c4-4d4f-9e4b-30504a4658db tempest-SnapshotsActionsTest-1452323867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.6ed2ace5-c5c7-4442-8f93-38ab9eb39bb5" returned: 0 in 0.504s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:31 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-6bfe5d9c-90c4-4d4f-9e4b-30504a4658db tempest-SnapshotsActionsTest-1452323867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:22:31 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0245357e-c0c5-4da9-ba29-be1208fd6898 tempest-VolumesListAdminTestJSON-1825396183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (157cbfaa-9266-4d64-8e98-8ca9fac5c334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-750622555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af43ae23-a003-4067-a481-5fdeac75c68e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b74a681ed3d4ff6b83d2fcf74a3f0f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:22:31Z,use_quota=True,user_id='bca733f17ad446bea9ef8f99d400559a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:31 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0245357e-c0c5-4da9-ba29-be1208fd6898 tempest-VolumesListAdminTestJSON-1825396183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23e32965-e47b-46ae-a00f-139cef748f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:31 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0245357e-c0c5-4da9-ba29-be1208fd6898 tempest-VolumesListAdminTestJSON-1825396183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23e32965-e47b-46ae-a00f-139cef748f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:31 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0245357e-c0c5-4da9-ba29-be1208fd6898 tempest-VolumesListAdminTestJSON-1825396183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab154038-d8ac-48ae-b098-f8309f9a8858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:31 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0245357e-c0c5-4da9-ba29-be1208fd6898 tempest-VolumesListAdminTestJSON-1825396183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab154038-d8ac-48ae-b098-f8309f9a8858) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af43ae23-a003-4067-a481-5fdeac75c68e', 'volume_name': 'volume-af43ae23-a003-4067-a481-5fdeac75c68e', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:31 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0245357e-c0c5-4da9-ba29-be1208fd6898 tempest-VolumesListAdminTestJSON-1825396183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (785ed303-8ed3-43dd-8d37-30d3701d3485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:31 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0245357e-c0c5-4da9-ba29-be1208fd6898 tempest-VolumesListAdminTestJSON-1825396183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (785ed303-8ed3-43dd-8d37-30d3701d3485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:31 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0245357e-c0c5-4da9-ba29-be1208fd6898 tempest-VolumesListAdminTestJSON-1825396183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81a8d6d4-7bfb-4de4-b678-3a0385345369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:31 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-0245357e-c0c5-4da9-ba29-be1208fd6898 tempest-VolumesListAdminTestJSON-1825396183 None] Volume af43ae23-a003-4067-a481-5fdeac75c68e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af43ae23-a003-4067-a481-5fdeac75c68e', 'volume_size': 1} Nov 03 20:22:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-0245357e-c0c5-4da9-ba29-be1208fd6898 tempest-VolumesListAdminTestJSON-1825396183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-0245357e-c0c5-4da9-ba29-be1208fd6898 tempest-VolumesListAdminTestJSON-1825396183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:31 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-0245357e-c0c5-4da9-ba29-be1208fd6898 tempest-VolumesListAdminTestJSON-1825396183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-750622555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af43ae23-a003-4067-a481-5fdeac75c68e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b74a681ed3d4ff6b83d2fcf74a3f0f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:22:31Z,use_quota=True,user_id='bca733f17ad446bea9ef8f99d400559a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:22:31 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-0245357e-c0c5-4da9-ba29-be1208fd6898 tempest-VolumesListAdminTestJSON-1825396183 None] Creating volume af43ae23-a003-4067-a481-5fdeac75c68e {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:22:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-0245357e-c0c5-4da9-ba29-be1208fd6898 tempest-VolumesListAdminTestJSON-1825396183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-0245357e-c0c5-4da9-ba29-be1208fd6898 tempest-VolumesListAdminTestJSON-1825396183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:31 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-0245357e-c0c5-4da9-ba29-be1208fd6898 tempest-VolumesListAdminTestJSON-1825396183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:22:31 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-0245357e-c0c5-4da9-ba29-be1208fd6898 tempest-VolumesListAdminTestJSON-1825396183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:22:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-0245357e-c0c5-4da9-ba29-be1208fd6898 tempest-VolumesListAdminTestJSON-1825396183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:31 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-0245357e-c0c5-4da9-ba29-be1208fd6898 tempest-VolumesListAdminTestJSON-1825396183 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:22:31 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-0245357e-c0c5-4da9-ba29-be1208fd6898 tempest-VolumesListAdminTestJSON-1825396183 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:22:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-0245357e-c0c5-4da9-ba29-be1208fd6898 tempest-VolumesListAdminTestJSON-1825396183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-af43ae23-a003-4067-a481-5fdeac75c68e 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:31 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93cdbc7-821a-4f7e-8475-af395f5dec8e]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6bfe5d9c-90c4-4d4f-9e4b-30504a4658db tempest-SnapshotsActionsTest-1452323867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:31 devstack sudo[94330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-af43ae23-a003-4067-a481-5fdeac75c68e 1073741824 Nov 03 20:22:31 devstack sudo[94330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:31 devstack sudo[94331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0 Nov 03 20:22:31 devstack sudo[94331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:32 devstack sudo[94331]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6bfe5d9c-90c4-4d4f-9e4b-30504a4658db tempest-SnapshotsActionsTest-1452323867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0" returned: 0 in 0.453s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:32 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-6bfe5d9c-90c4-4d4f-9e4b-30504a4658db tempest-SnapshotsActionsTest-1452323867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:22:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6bfe5d9c-90c4-4d4f-9e4b-30504a4658db tempest-SnapshotsActionsTest-1452323867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.6ed2ace5-c5c7-4442-8f93-38ab9eb39bb5 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:32 devstack sudo[94342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.6ed2ace5-c5c7-4442-8f93-38ab9eb39bb5 Nov 03 20:22:32 devstack sudo[94342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:32 devstack sudo[94330]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-0245357e-c0c5-4da9-ba29-be1208fd6898 tempest-VolumesListAdminTestJSON-1825396183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-af43ae23-a003-4067-a481-5fdeac75c68e 1073741824" returned: 0 in 0.526s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-0245357e-c0c5-4da9-ba29-be1208fd6898 tempest-VolumesListAdminTestJSON-1825396183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-af43ae23-a003-4067-a481-5fdeac75c68e {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:32 devstack sudo[94344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-af43ae23-a003-4067-a481-5fdeac75c68e Nov 03 20:22:32 devstack sudo[94344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:32 devstack sudo[94344]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-0245357e-c0c5-4da9-ba29-be1208fd6898 tempest-VolumesListAdminTestJSON-1825396183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-af43ae23-a003-4067-a481-5fdeac75c68e" returned: 0 in 0.299s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:32 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-0245357e-c0c5-4da9-ba29-be1208fd6898 tempest-VolumesListAdminTestJSON-1825396183 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:22:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-0245357e-c0c5-4da9-ba29-be1208fd6898 tempest-VolumesListAdminTestJSON-1825396183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:32 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0245357e-c0c5-4da9-ba29-be1208fd6898 tempest-VolumesListAdminTestJSON-1825396183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81a8d6d4-7bfb-4de4-b678-3a0385345369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af43ae23-a003-4067-a481-5fdeac75c68e', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:32 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0245357e-c0c5-4da9-ba29-be1208fd6898 tempest-VolumesListAdminTestJSON-1825396183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27d0aabf-c3b8-448b-aca8-0c558c01c20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:32 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-0245357e-c0c5-4da9-ba29-be1208fd6898 tempest-VolumesListAdminTestJSON-1825396183 None] Volume volume-af43ae23-a003-4067-a481-5fdeac75c68e (af43ae23-a003-4067-a481-5fdeac75c68e): created successfully Nov 03 20:22:32 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0245357e-c0c5-4da9-ba29-be1208fd6898 tempest-VolumesListAdminTestJSON-1825396183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27d0aabf-c3b8-448b-aca8-0c558c01c20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:32 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0245357e-c0c5-4da9-ba29-be1208fd6898 tempest-VolumesListAdminTestJSON-1825396183 None] Flow 'volume_create_manager' (0392bd03-2a18-4d48-a354-09869f1e136d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:22:32 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-0245357e-c0c5-4da9-ba29-be1208fd6898 tempest-VolumesListAdminTestJSON-1825396183 None] Created volume successfully. Nov 03 20:22:32 devstack sudo[94342]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6bfe5d9c-90c4-4d4f-9e4b-30504a4658db tempest-SnapshotsActionsTest-1452323867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.6ed2ace5-c5c7-4442-8f93-38ab9eb39bb5" returned: 0 in 0.549s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6bfe5d9c-90c4-4d4f-9e4b-30504a4658db tempest-SnapshotsActionsTest-1452323867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.6ed2ace5-c5c7-4442-8f93-38ab9eb39bb5 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:32 devstack sudo[94351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.6ed2ace5-c5c7-4442-8f93-38ab9eb39bb5 Nov 03 20:22:32 devstack sudo[94351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:32 devstack sudo[94351]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6bfe5d9c-90c4-4d4f-9e4b-30504a4658db tempest-SnapshotsActionsTest-1452323867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.6ed2ace5-c5c7-4442-8f93-38ab9eb39bb5" returned: 0 in 0.308s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:33 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6bfe5d9c-90c4-4d4f-9e4b-30504a4658db tempest-SnapshotsActionsTest-1452323867 None] Lock "cinder-quobyte-6ed2ace5-c5c7-4442-8f93-38ab9eb39bb5" released by "_delete_snapshot" :: held 2.029s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:33 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6bfe5d9c-90c4-4d4f-9e4b-30504a4658db tempest-SnapshotsActionsTest-1452323867 None] Lock "cinder-quobyte-1f95c6e9-a7fc-415a-915c-f9a7b581a097" released by "delete_snapshot" :: held 2.073s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:33 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-6bfe5d9c-90c4-4d4f-9e4b-30504a4658db tempest-SnapshotsActionsTest-1452323867 None] Created reservations ['af6ae62b-6365-41e8-954d-22ffb5dfbfef', 'b571d919-8900-4337-ac78-8647ddb2d9b5', '944b5ba8-13e2-44a0-9fd9-73d6547f18d2', 'a2ba59ba-b609-4242-ac18-e895ff0c44bf'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:22:33 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-6bfe5d9c-90c4-4d4f-9e4b-30504a4658db tempest-SnapshotsActionsTest-1452323867 None] Delete snapshot completed successfully. Nov 03 20:22:33 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6bfe5d9c-90c4-4d4f-9e4b-30504a4658db tempest-SnapshotsActionsTest-1452323867 None] Lock "cinder-6ed2ace5-c5c7-4442-8f93-38ab9eb39bb5-delete_snapshot" released by "delete_snapshot" :: held 2.273s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:34 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cbeb11b-87d0-4cc1-8e1b-7ee0da44e69f tempest-VolumesListAdminTestJSON-1825396183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:22:34 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-3cbeb11b-87d0-4cc1-8e1b-7ee0da44e69f tempest-VolumesListAdminTestJSON-1825396183 None] Flow 'volume_create_manager' (6c6f3bd2-41fc-42dd-8623-481ff8cc2c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:22:34 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-3cbeb11b-87d0-4cc1-8e1b-7ee0da44e69f tempest-VolumesListAdminTestJSON-1825396183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8ca191c-ba3c-4625-ab54-da801b553187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:34 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-3cbeb11b-87d0-4cc1-8e1b-7ee0da44e69f tempest-VolumesListAdminTestJSON-1825396183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8ca191c-ba3c-4625-ab54-da801b553187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1836178058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eb960c0-ea9e-4eeb-82af-9348903ecf17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b74a681ed3d4ff6b83d2fcf74a3f0f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:22:34Z,use_quota=True,user_id='bca733f17ad446bea9ef8f99d400559a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:34 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-3cbeb11b-87d0-4cc1-8e1b-7ee0da44e69f tempest-VolumesListAdminTestJSON-1825396183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4a086e2-c6ac-4543-b9c0-8868631224cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:34 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-3cbeb11b-87d0-4cc1-8e1b-7ee0da44e69f tempest-VolumesListAdminTestJSON-1825396183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4a086e2-c6ac-4543-b9c0-8868631224cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:34 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-3cbeb11b-87d0-4cc1-8e1b-7ee0da44e69f tempest-VolumesListAdminTestJSON-1825396183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8e0a772-a6de-486e-9818-0c92e5c76474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:34 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-3cbeb11b-87d0-4cc1-8e1b-7ee0da44e69f tempest-VolumesListAdminTestJSON-1825396183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8e0a772-a6de-486e-9818-0c92e5c76474) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5eb960c0-ea9e-4eeb-82af-9348903ecf17', 'volume_name': 'volume-5eb960c0-ea9e-4eeb-82af-9348903ecf17', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:34 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-3cbeb11b-87d0-4cc1-8e1b-7ee0da44e69f tempest-VolumesListAdminTestJSON-1825396183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (190272d6-939d-48f7-8959-e3766f6c3385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:34 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-3cbeb11b-87d0-4cc1-8e1b-7ee0da44e69f tempest-VolumesListAdminTestJSON-1825396183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (190272d6-939d-48f7-8959-e3766f6c3385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:34 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-3cbeb11b-87d0-4cc1-8e1b-7ee0da44e69f tempest-VolumesListAdminTestJSON-1825396183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ebb0c54-a2d2-4aab-967a-6e6fe9011156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:34 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-3cbeb11b-87d0-4cc1-8e1b-7ee0da44e69f tempest-VolumesListAdminTestJSON-1825396183 None] Volume 5eb960c0-ea9e-4eeb-82af-9348903ecf17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5eb960c0-ea9e-4eeb-82af-9348903ecf17', 'volume_size': 1} Nov 03 20:22:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-3cbeb11b-87d0-4cc1-8e1b-7ee0da44e69f tempest-VolumesListAdminTestJSON-1825396183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-3cbeb11b-87d0-4cc1-8e1b-7ee0da44e69f tempest-VolumesListAdminTestJSON-1825396183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:34 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-3cbeb11b-87d0-4cc1-8e1b-7ee0da44e69f tempest-VolumesListAdminTestJSON-1825396183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1836178058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eb960c0-ea9e-4eeb-82af-9348903ecf17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b74a681ed3d4ff6b83d2fcf74a3f0f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:22:34Z,use_quota=True,user_id='bca733f17ad446bea9ef8f99d400559a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:22:34 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-3cbeb11b-87d0-4cc1-8e1b-7ee0da44e69f tempest-VolumesListAdminTestJSON-1825396183 None] Creating volume 5eb960c0-ea9e-4eeb-82af-9348903ecf17 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:22:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-3cbeb11b-87d0-4cc1-8e1b-7ee0da44e69f tempest-VolumesListAdminTestJSON-1825396183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-3cbeb11b-87d0-4cc1-8e1b-7ee0da44e69f tempest-VolumesListAdminTestJSON-1825396183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:34 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-3cbeb11b-87d0-4cc1-8e1b-7ee0da44e69f tempest-VolumesListAdminTestJSON-1825396183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:22:34 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-3cbeb11b-87d0-4cc1-8e1b-7ee0da44e69f tempest-VolumesListAdminTestJSON-1825396183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:22:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-3cbeb11b-87d0-4cc1-8e1b-7ee0da44e69f tempest-VolumesListAdminTestJSON-1825396183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:34 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-3cbeb11b-87d0-4cc1-8e1b-7ee0da44e69f tempest-VolumesListAdminTestJSON-1825396183 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:22:34 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-3cbeb11b-87d0-4cc1-8e1b-7ee0da44e69f tempest-VolumesListAdminTestJSON-1825396183 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:22:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3cbeb11b-87d0-4cc1-8e1b-7ee0da44e69f tempest-VolumesListAdminTestJSON-1825396183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5eb960c0-ea9e-4eeb-82af-9348903ecf17 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:34 devstack sudo[94354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5eb960c0-ea9e-4eeb-82af-9348903ecf17 1073741824 Nov 03 20:22:34 devstack sudo[94354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:35 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fa6b9553-7d4b-4024-80bf-d82aac7e9a76 tempest-SnapshotsActionsTest-781432807 None] Acquiring lock "cinder-4cb93afc-9646-496e-90ff-976ab70c2ea0-delete_snapshot" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:35 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fa6b9553-7d4b-4024-80bf-d82aac7e9a76 tempest-SnapshotsActionsTest-781432807 None] Lock "cinder-4cb93afc-9646-496e-90ff-976ab70c2ea0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:35 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fa6b9553-7d4b-4024-80bf-d82aac7e9a76 tempest-SnapshotsActionsTest-781432807 None] Acquiring lock "cinder-quobyte-1f95c6e9-a7fc-415a-915c-f9a7b581a097" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:35 devstack sudo[94354]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3cbeb11b-87d0-4cc1-8e1b-7ee0da44e69f tempest-VolumesListAdminTestJSON-1825396183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5eb960c0-ea9e-4eeb-82af-9348903ecf17 1073741824" returned: 0 in 0.613s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:35 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fa6b9553-7d4b-4024-80bf-d82aac7e9a76 tempest-SnapshotsActionsTest-781432807 None] Lock "cinder-quobyte-1f95c6e9-a7fc-415a-915c-f9a7b581a097" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:35 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fa6b9553-7d4b-4024-80bf-d82aac7e9a76 tempest-SnapshotsActionsTest-781432807 None] Acquiring lock "cinder-quobyte-4cb93afc-9646-496e-90ff-976ab70c2ea0" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:35 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fa6b9553-7d4b-4024-80bf-d82aac7e9a76 tempest-SnapshotsActionsTest-781432807 None] Lock "cinder-quobyte-4cb93afc-9646-496e-90ff-976ab70c2ea0" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:35 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-fa6b9553-7d4b-4024-80bf-d82aac7e9a76 tempest-SnapshotsActionsTest-781432807 None] Deleting offline snapshot 4cb93afc-9646-496e-90ff-976ab70c2ea0 of volume 1f95c6e9-a7fc-415a-915c-f9a7b581a097 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:22:35 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-fa6b9553-7d4b-4024-80bf-d82aac7e9a76 tempest-SnapshotsActionsTest-781432807 None] snapshot_file for this snap is: volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:22:35 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3e2381-1cdd-40a1-a943-9b0102604ae2]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fa6b9553-7d4b-4024-80bf-d82aac7e9a76 tempest-SnapshotsActionsTest-781432807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3cbeb11b-87d0-4cc1-8e1b-7ee0da44e69f tempest-VolumesListAdminTestJSON-1825396183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5eb960c0-ea9e-4eeb-82af-9348903ecf17 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:35 devstack sudo[94361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5eb960c0-ea9e-4eeb-82af-9348903ecf17 Nov 03 20:22:35 devstack sudo[94361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:35 devstack sudo[94360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0 Nov 03 20:22:35 devstack sudo[94360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:35 devstack sudo[94361]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3cbeb11b-87d0-4cc1-8e1b-7ee0da44e69f tempest-VolumesListAdminTestJSON-1825396183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5eb960c0-ea9e-4eeb-82af-9348903ecf17" returned: 0 in 0.369s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:35 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-3cbeb11b-87d0-4cc1-8e1b-7ee0da44e69f tempest-VolumesListAdminTestJSON-1825396183 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:22:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-3cbeb11b-87d0-4cc1-8e1b-7ee0da44e69f tempest-VolumesListAdminTestJSON-1825396183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:35 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-3cbeb11b-87d0-4cc1-8e1b-7ee0da44e69f tempest-VolumesListAdminTestJSON-1825396183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ebb0c54-a2d2-4aab-967a-6e6fe9011156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5eb960c0-ea9e-4eeb-82af-9348903ecf17', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:35 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-3cbeb11b-87d0-4cc1-8e1b-7ee0da44e69f tempest-VolumesListAdminTestJSON-1825396183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a677766e-dd9a-4d70-9215-1fa43d69ac5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:35 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-3cbeb11b-87d0-4cc1-8e1b-7ee0da44e69f tempest-VolumesListAdminTestJSON-1825396183 None] Volume volume-5eb960c0-ea9e-4eeb-82af-9348903ecf17 (5eb960c0-ea9e-4eeb-82af-9348903ecf17): created successfully Nov 03 20:22:35 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-3cbeb11b-87d0-4cc1-8e1b-7ee0da44e69f tempest-VolumesListAdminTestJSON-1825396183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a677766e-dd9a-4d70-9215-1fa43d69ac5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:35 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-3cbeb11b-87d0-4cc1-8e1b-7ee0da44e69f tempest-VolumesListAdminTestJSON-1825396183 None] Flow 'volume_create_manager' (6c6f3bd2-41fc-42dd-8623-481ff8cc2c05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:22:35 devstack sudo[94360]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fa6b9553-7d4b-4024-80bf-d82aac7e9a76 tempest-SnapshotsActionsTest-781432807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0" returned: 0 in 0.465s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:35 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-fa6b9553-7d4b-4024-80bf-d82aac7e9a76 tempest-SnapshotsActionsTest-781432807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:22:35 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-3cbeb11b-87d0-4cc1-8e1b-7ee0da44e69f tempest-VolumesListAdminTestJSON-1825396183 None] Created volume successfully. Nov 03 20:22:35 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[03312fc5-1856-448f-a310-6e13065ab05e]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fa6b9553-7d4b-4024-80bf-d82aac7e9a76 tempest-SnapshotsActionsTest-781432807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:35 devstack sudo[94368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097 Nov 03 20:22:35 devstack sudo[94368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:36 devstack sudo[94368]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fa6b9553-7d4b-4024-80bf-d82aac7e9a76 tempest-SnapshotsActionsTest-781432807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097" returned: 0 in 0.465s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fa6b9553-7d4b-4024-80bf-d82aac7e9a76 tempest-SnapshotsActionsTest-781432807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:36 devstack sudo[94374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0 Nov 03 20:22:36 devstack sudo[94374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:36 devstack sudo[94374]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fa6b9553-7d4b-4024-80bf-d82aac7e9a76 tempest-SnapshotsActionsTest-781432807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0" returned: 0 in 0.467s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fa6b9553-7d4b-4024-80bf-d82aac7e9a76 tempest-SnapshotsActionsTest-781432807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:36 devstack sudo[94379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0 Nov 03 20:22:36 devstack sudo[94379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:36 devstack sudo[94379]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fa6b9553-7d4b-4024-80bf-d82aac7e9a76 tempest-SnapshotsActionsTest-781432807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097.4cb93afc-9646-496e-90ff-976ab70c2ea0" returned: 0 in 0.348s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:37 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fa6b9553-7d4b-4024-80bf-d82aac7e9a76 tempest-SnapshotsActionsTest-781432807 None] Lock "cinder-quobyte-4cb93afc-9646-496e-90ff-976ab70c2ea0" released by "_delete_snapshot" :: held 1.930s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:37 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fa6b9553-7d4b-4024-80bf-d82aac7e9a76 tempest-SnapshotsActionsTest-781432807 None] Lock "cinder-quobyte-1f95c6e9-a7fc-415a-915c-f9a7b581a097" released by "delete_snapshot" :: held 1.966s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:37 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-fa6b9553-7d4b-4024-80bf-d82aac7e9a76 tempest-SnapshotsActionsTest-781432807 None] Created reservations ['29ca50c9-473c-464a-b1ba-475771279875', 'ba2a3c17-dd84-4c1e-b469-f909dee29c49', 'e677f947-a948-4bc2-b776-1dd30555e64f', '53a0baa7-0025-47a6-a481-ed1cfb084fc1'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:22:37 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-fa6b9553-7d4b-4024-80bf-d82aac7e9a76 tempest-SnapshotsActionsTest-781432807 None] Delete snapshot completed successfully. Nov 03 20:22:37 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fa6b9553-7d4b-4024-80bf-d82aac7e9a76 tempest-SnapshotsActionsTest-781432807 None] Lock "cinder-4cb93afc-9646-496e-90ff-976ab70c2ea0-delete_snapshot" released by "delete_snapshot" :: held 2.232s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:37 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-d556c7b2-3f37-42d2-8440-6269253c1d1c tempest-VolumesListAdminTestJSON-1762696699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:22:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d556c7b2-3f37-42d2-8440-6269253c1d1c tempest-VolumesListAdminTestJSON-1762696699 None] Flow 'volume_create_manager' (ab371e44-4ca8-4864-9867-de54da200d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:22:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d556c7b2-3f37-42d2-8440-6269253c1d1c tempest-VolumesListAdminTestJSON-1762696699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e1735ce-7be9-4c6f-9972-b6366ba2e56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d556c7b2-3f37-42d2-8440-6269253c1d1c tempest-VolumesListAdminTestJSON-1762696699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e1735ce-7be9-4c6f-9972-b6366ba2e56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e8bf3eb-ff09-4030-85e4-78830edbfd78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56e0d336925e4a3ab61aa01139ccb310',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:22:38Z,use_quota=True,user_id='4cac7350af264dd6936bc13bd436df8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d556c7b2-3f37-42d2-8440-6269253c1d1c tempest-VolumesListAdminTestJSON-1762696699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7f3ed2d-5b84-4321-a6d5-3d87e93a1ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d556c7b2-3f37-42d2-8440-6269253c1d1c tempest-VolumesListAdminTestJSON-1762696699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7f3ed2d-5b84-4321-a6d5-3d87e93a1ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d556c7b2-3f37-42d2-8440-6269253c1d1c tempest-VolumesListAdminTestJSON-1762696699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (909faa36-490e-4441-8483-9d1ff19d91ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d556c7b2-3f37-42d2-8440-6269253c1d1c tempest-VolumesListAdminTestJSON-1762696699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (909faa36-490e-4441-8483-9d1ff19d91ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e8bf3eb-ff09-4030-85e4-78830edbfd78', 'volume_name': 'volume-9e8bf3eb-ff09-4030-85e4-78830edbfd78', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d556c7b2-3f37-42d2-8440-6269253c1d1c tempest-VolumesListAdminTestJSON-1762696699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b696080e-21ce-474f-ac57-f4f9b6c1a77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d556c7b2-3f37-42d2-8440-6269253c1d1c tempest-VolumesListAdminTestJSON-1762696699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b696080e-21ce-474f-ac57-f4f9b6c1a77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d556c7b2-3f37-42d2-8440-6269253c1d1c tempest-VolumesListAdminTestJSON-1762696699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ab392f1-05ea-4912-9a0b-3c22a39b7dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:37 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-d556c7b2-3f37-42d2-8440-6269253c1d1c tempest-VolumesListAdminTestJSON-1762696699 None] Volume 9e8bf3eb-ff09-4030-85e4-78830edbfd78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e8bf3eb-ff09-4030-85e4-78830edbfd78', 'volume_size': 1} Nov 03 20:22:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d556c7b2-3f37-42d2-8440-6269253c1d1c tempest-VolumesListAdminTestJSON-1762696699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d556c7b2-3f37-42d2-8440-6269253c1d1c tempest-VolumesListAdminTestJSON-1762696699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:37 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-d556c7b2-3f37-42d2-8440-6269253c1d1c tempest-VolumesListAdminTestJSON-1762696699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e8bf3eb-ff09-4030-85e4-78830edbfd78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56e0d336925e4a3ab61aa01139ccb310',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:22:38Z,use_quota=True,user_id='4cac7350af264dd6936bc13bd436df8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:22:37 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-d556c7b2-3f37-42d2-8440-6269253c1d1c tempest-VolumesListAdminTestJSON-1762696699 None] Creating volume 9e8bf3eb-ff09-4030-85e4-78830edbfd78 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:22:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d556c7b2-3f37-42d2-8440-6269253c1d1c tempest-VolumesListAdminTestJSON-1762696699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d556c7b2-3f37-42d2-8440-6269253c1d1c tempest-VolumesListAdminTestJSON-1762696699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:37 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-d556c7b2-3f37-42d2-8440-6269253c1d1c tempest-VolumesListAdminTestJSON-1762696699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:22:37 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-d556c7b2-3f37-42d2-8440-6269253c1d1c tempest-VolumesListAdminTestJSON-1762696699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:22:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d556c7b2-3f37-42d2-8440-6269253c1d1c tempest-VolumesListAdminTestJSON-1762696699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:37 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-d556c7b2-3f37-42d2-8440-6269253c1d1c tempest-VolumesListAdminTestJSON-1762696699 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:22:37 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-d556c7b2-3f37-42d2-8440-6269253c1d1c tempest-VolumesListAdminTestJSON-1762696699 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:22:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d556c7b2-3f37-42d2-8440-6269253c1d1c tempest-VolumesListAdminTestJSON-1762696699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-9e8bf3eb-ff09-4030-85e4-78830edbfd78 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:37 devstack sudo[94382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-9e8bf3eb-ff09-4030-85e4-78830edbfd78 1073741824 Nov 03 20:22:37 devstack sudo[94382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:38 devstack sudo[94382]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d556c7b2-3f37-42d2-8440-6269253c1d1c tempest-VolumesListAdminTestJSON-1762696699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-9e8bf3eb-ff09-4030-85e4-78830edbfd78 1073741824" returned: 0 in 0.604s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d556c7b2-3f37-42d2-8440-6269253c1d1c tempest-VolumesListAdminTestJSON-1762696699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-9e8bf3eb-ff09-4030-85e4-78830edbfd78 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:38 devstack sudo[94388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-9e8bf3eb-ff09-4030-85e4-78830edbfd78 Nov 03 20:22:38 devstack sudo[94388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:38 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-59e369e5-8153-479e-8e97-dc375b261274 tempest-SnapshotsActionsTest-781432807 None] Acquiring lock "cinder-1f95c6e9-a7fc-415a-915c-f9a7b581a097-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:38 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-59e369e5-8153-479e-8e97-dc375b261274 tempest-SnapshotsActionsTest-781432807 None] Lock "cinder-1f95c6e9-a7fc-415a-915c-f9a7b581a097-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:38 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-59e369e5-8153-479e-8e97-dc375b261274 tempest-SnapshotsActionsTest-781432807 None] Acquiring lock "cinder-quobyte-1f95c6e9-a7fc-415a-915c-f9a7b581a097" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:38 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-59e369e5-8153-479e-8e97-dc375b261274 tempest-SnapshotsActionsTest-781432807 None] Lock "cinder-quobyte-1f95c6e9-a7fc-415a-915c-f9a7b581a097" acquired by "delete_volume" :: waited 0.026s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:38 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[75bff6af-45c4-44c4-9369-f5bac1e85d9c]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-59e369e5-8153-479e-8e97-dc375b261274 tempest-SnapshotsActionsTest-781432807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:38 devstack sudo[94388]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d556c7b2-3f37-42d2-8440-6269253c1d1c tempest-VolumesListAdminTestJSON-1762696699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-9e8bf3eb-ff09-4030-85e4-78830edbfd78" returned: 0 in 0.369s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:38 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-d556c7b2-3f37-42d2-8440-6269253c1d1c tempest-VolumesListAdminTestJSON-1762696699 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:22:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d556c7b2-3f37-42d2-8440-6269253c1d1c tempest-VolumesListAdminTestJSON-1762696699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d556c7b2-3f37-42d2-8440-6269253c1d1c tempest-VolumesListAdminTestJSON-1762696699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ab392f1-05ea-4912-9a0b-3c22a39b7dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e8bf3eb-ff09-4030-85e4-78830edbfd78', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d556c7b2-3f37-42d2-8440-6269253c1d1c tempest-VolumesListAdminTestJSON-1762696699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dac2c569-36bb-4071-a1be-b440e6b134d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:38 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-d556c7b2-3f37-42d2-8440-6269253c1d1c tempest-VolumesListAdminTestJSON-1762696699 None] Volume volume-9e8bf3eb-ff09-4030-85e4-78830edbfd78 (9e8bf3eb-ff09-4030-85e4-78830edbfd78): created successfully Nov 03 20:22:38 devstack sudo[94390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097 Nov 03 20:22:38 devstack sudo[94390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d556c7b2-3f37-42d2-8440-6269253c1d1c tempest-VolumesListAdminTestJSON-1762696699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dac2c569-36bb-4071-a1be-b440e6b134d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d556c7b2-3f37-42d2-8440-6269253c1d1c tempest-VolumesListAdminTestJSON-1762696699 None] Flow 'volume_create_manager' (ab371e44-4ca8-4864-9867-de54da200d47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:22:38 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-d556c7b2-3f37-42d2-8440-6269253c1d1c tempest-VolumesListAdminTestJSON-1762696699 None] Created volume successfully. Nov 03 20:22:39 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-567fa3e5-63e5-40cf-b1de-2c41653bdea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:22:39 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-567fa3e5-63e5-40cf-b1de-2c41653bdea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Flow 'volume_create_manager' (07cfd300-0643-4496-92fc-bf55e22ca82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:22:39 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-567fa3e5-63e5-40cf-b1de-2c41653bdea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (923daa6d-6960-4d9c-8909-0e14a0c3168c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:39 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-567fa3e5-63e5-40cf-b1de-2c41653bdea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (923daa6d-6960-4d9c-8909-0e14a0c3168c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-703946431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc70bd30-337e-4e5e-b677-3ba85c0f50b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8563598e885e4e41ab8880c717ec3260',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:22:39Z,use_quota=True,user_id='b5d48e1ef84948c996ce6872a520c737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:39 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-567fa3e5-63e5-40cf-b1de-2c41653bdea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f80abc0-c3cc-4551-9e84-4ddd58939c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:39 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-567fa3e5-63e5-40cf-b1de-2c41653bdea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f80abc0-c3cc-4551-9e84-4ddd58939c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:39 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-567fa3e5-63e5-40cf-b1de-2c41653bdea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb9c322e-f259-4a17-992e-10e7e50c2490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:39 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-567fa3e5-63e5-40cf-b1de-2c41653bdea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb9c322e-f259-4a17-992e-10e7e50c2490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc70bd30-337e-4e5e-b677-3ba85c0f50b7', 'volume_name': 'volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:39 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-567fa3e5-63e5-40cf-b1de-2c41653bdea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eced1c8a-fe1a-4255-ab77-570618b7f001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:39 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-567fa3e5-63e5-40cf-b1de-2c41653bdea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eced1c8a-fe1a-4255-ab77-570618b7f001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:39 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-567fa3e5-63e5-40cf-b1de-2c41653bdea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6138eb10-e345-4498-b302-691d17630b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:39 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-567fa3e5-63e5-40cf-b1de-2c41653bdea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Volume cc70bd30-337e-4e5e-b677-3ba85c0f50b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7', 'volume_size': 1} Nov 03 20:22:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-567fa3e5-63e5-40cf-b1de-2c41653bdea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-567fa3e5-63e5-40cf-b1de-2c41653bdea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:39 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-567fa3e5-63e5-40cf-b1de-2c41653bdea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-703946431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc70bd30-337e-4e5e-b677-3ba85c0f50b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8563598e885e4e41ab8880c717ec3260',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:22:39Z,use_quota=True,user_id='b5d48e1ef84948c996ce6872a520c737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:22:39 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-567fa3e5-63e5-40cf-b1de-2c41653bdea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Creating volume cc70bd30-337e-4e5e-b677-3ba85c0f50b7 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:22:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-567fa3e5-63e5-40cf-b1de-2c41653bdea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-567fa3e5-63e5-40cf-b1de-2c41653bdea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:39 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-567fa3e5-63e5-40cf-b1de-2c41653bdea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:22:39 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-567fa3e5-63e5-40cf-b1de-2c41653bdea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:22:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-567fa3e5-63e5-40cf-b1de-2c41653bdea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:39 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-567fa3e5-63e5-40cf-b1de-2c41653bdea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:22:39 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-567fa3e5-63e5-40cf-b1de-2c41653bdea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:22:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-567fa3e5-63e5-40cf-b1de-2c41653bdea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:39 devstack sudo[94395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7 1073741824 Nov 03 20:22:39 devstack sudo[94395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:39 devstack sudo[94390]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-59e369e5-8153-479e-8e97-dc375b261274 tempest-SnapshotsActionsTest-781432807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097" returned: 0 in 0.492s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-59e369e5-8153-479e-8e97-dc375b261274 tempest-SnapshotsActionsTest-781432807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:39 devstack sudo[94399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097 Nov 03 20:22:39 devstack sudo[94399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:39 devstack sudo[94399]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-59e369e5-8153-479e-8e97-dc375b261274 tempest-SnapshotsActionsTest-781432807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f95c6e9-a7fc-415a-915c-f9a7b581a097" returned: 0 in 0.338s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:39 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-59e369e5-8153-479e-8e97-dc375b261274 tempest-SnapshotsActionsTest-781432807 None] Lock "cinder-quobyte-1f95c6e9-a7fc-415a-915c-f9a7b581a097" released by "delete_volume" :: held 0.944s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:39 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-59e369e5-8153-479e-8e97-dc375b261274 tempest-SnapshotsActionsTest-781432807 None] Created reservations ['b6076c5d-ed35-4639-99ab-5a74834814b8', '7fc7aad0-f8cd-4d4c-82db-f3b6b39d7a97', '95e6fb91-22bb-4514-a63e-d6408cf185b6', '62a0f508-80b5-4dee-a1d4-25d5375555e8'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:22:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-59e369e5-8153-479e-8e97-dc375b261274 tempest-SnapshotsActionsTest-781432807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-59e369e5-8153-479e-8e97-dc375b261274 tempest-SnapshotsActionsTest-781432807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:39 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-59e369e5-8153-479e-8e97-dc375b261274 tempest-SnapshotsActionsTest-781432807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:22:39 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-59e369e5-8153-479e-8e97-dc375b261274 tempest-SnapshotsActionsTest-781432807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:22:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-59e369e5-8153-479e-8e97-dc375b261274 tempest-SnapshotsActionsTest-781432807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-59e369e5-8153-479e-8e97-dc375b261274 tempest-SnapshotsActionsTest-781432807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:39 devstack sudo[94395]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-567fa3e5-63e5-40cf-b1de-2c41653bdea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7 1073741824" returned: 0 in 0.672s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:39 devstack sudo[94407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:22:39 devstack sudo[94407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-567fa3e5-63e5-40cf-b1de-2c41653bdea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:39 devstack sudo[94409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7 Nov 03 20:22:39 devstack sudo[94409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:40 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-f30e4ce0-8398-4f6c-acdc-f59d0d60c6cf tempest-VolumesListAdminTestJSON-1762696699 None] Acquiring lock "cinder-9e8bf3eb-ff09-4030-85e4-78830edbfd78-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:40 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-f30e4ce0-8398-4f6c-acdc-f59d0d60c6cf tempest-VolumesListAdminTestJSON-1762696699 None] Lock "cinder-9e8bf3eb-ff09-4030-85e4-78830edbfd78-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:40 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-f30e4ce0-8398-4f6c-acdc-f59d0d60c6cf tempest-VolumesListAdminTestJSON-1762696699 None] Acquiring lock "cinder-quobyte-9e8bf3eb-ff09-4030-85e4-78830edbfd78" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:40 devstack sudo[94407]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:40 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-f30e4ce0-8398-4f6c-acdc-f59d0d60c6cf tempest-VolumesListAdminTestJSON-1762696699 None] Lock "cinder-quobyte-9e8bf3eb-ff09-4030-85e4-78830edbfd78" acquired by "delete_volume" :: waited 0.022s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-59e369e5-8153-479e-8e97-dc375b261274 tempest-SnapshotsActionsTest-781432807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.467s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:40 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-59e369e5-8153-479e-8e97-dc375b261274 tempest-SnapshotsActionsTest-781432807 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:22:40 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-59e369e5-8153-479e-8e97-dc375b261274 tempest-SnapshotsActionsTest-781432807 None] Deleted volume successfully. Nov 03 20:22:40 devstack sudo[94409]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-567fa3e5-63e5-40cf-b1de-2c41653bdea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7" returned: 0 in 0.409s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:40 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-567fa3e5-63e5-40cf-b1de-2c41653bdea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:22:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-567fa3e5-63e5-40cf-b1de-2c41653bdea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:40 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1471be-c5ee-4ea4-88d9-214a87c7ae95]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f30e4ce0-8398-4f6c-acdc-f59d0d60c6cf tempest-VolumesListAdminTestJSON-1762696699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-9e8bf3eb-ff09-4030-85e4-78830edbfd78 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:40 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-59e369e5-8153-479e-8e97-dc375b261274 tempest-SnapshotsActionsTest-781432807 None] Lock "cinder-1f95c6e9-a7fc-415a-915c-f9a7b581a097-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:40 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e46b8260-e8f1-4af6-8a25-7cc9dc5dea17 tempest-VolumesListAdminTestJSON-1825396183 None] Acquiring lock "cinder-5eb960c0-ea9e-4eeb-82af-9348903ecf17-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:40 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-567fa3e5-63e5-40cf-b1de-2c41653bdea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6138eb10-e345-4498-b302-691d17630b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:40 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-567fa3e5-63e5-40cf-b1de-2c41653bdea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5874b80d-2c50-49d7-9add-d8892d07e30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:40 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e46b8260-e8f1-4af6-8a25-7cc9dc5dea17 tempest-VolumesListAdminTestJSON-1825396183 None] Lock "cinder-5eb960c0-ea9e-4eeb-82af-9348903ecf17-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:40 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-567fa3e5-63e5-40cf-b1de-2c41653bdea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Volume volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7 (cc70bd30-337e-4e5e-b677-3ba85c0f50b7): created successfully Nov 03 20:22:40 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-567fa3e5-63e5-40cf-b1de-2c41653bdea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5874b80d-2c50-49d7-9add-d8892d07e30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:40 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-567fa3e5-63e5-40cf-b1de-2c41653bdea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Flow 'volume_create_manager' (07cfd300-0643-4496-92fc-bf55e22ca82e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:22:40 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-567fa3e5-63e5-40cf-b1de-2c41653bdea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Created volume successfully. Nov 03 20:22:40 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e46b8260-e8f1-4af6-8a25-7cc9dc5dea17 tempest-VolumesListAdminTestJSON-1825396183 None] Acquiring lock "cinder-quobyte-5eb960c0-ea9e-4eeb-82af-9348903ecf17" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:40 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e46b8260-e8f1-4af6-8a25-7cc9dc5dea17 tempest-VolumesListAdminTestJSON-1825396183 None] Lock "cinder-quobyte-5eb960c0-ea9e-4eeb-82af-9348903ecf17" acquired by "delete_volume" :: waited 0.025s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:40 devstack sudo[94413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-9e8bf3eb-ff09-4030-85e4-78830edbfd78 Nov 03 20:22:40 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[bddbefde-0450-400e-9d8d-9d284277aa67]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e46b8260-e8f1-4af6-8a25-7cc9dc5dea17 tempest-VolumesListAdminTestJSON-1825396183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5eb960c0-ea9e-4eeb-82af-9348903ecf17 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:40 devstack sudo[94413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:40 devstack sudo[94415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5eb960c0-ea9e-4eeb-82af-9348903ecf17 Nov 03 20:22:40 devstack sudo[94415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:40 devstack sudo[94413]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f30e4ce0-8398-4f6c-acdc-f59d0d60c6cf tempest-VolumesListAdminTestJSON-1762696699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-9e8bf3eb-ff09-4030-85e4-78830edbfd78" returned: 0 in 0.570s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f30e4ce0-8398-4f6c-acdc-f59d0d60c6cf tempest-VolumesListAdminTestJSON-1762696699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-9e8bf3eb-ff09-4030-85e4-78830edbfd78 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:40 devstack sudo[94421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-9e8bf3eb-ff09-4030-85e4-78830edbfd78 Nov 03 20:22:40 devstack sudo[94421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:41 devstack sudo[94415]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e46b8260-e8f1-4af6-8a25-7cc9dc5dea17 tempest-VolumesListAdminTestJSON-1825396183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5eb960c0-ea9e-4eeb-82af-9348903ecf17" returned: 0 in 0.643s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e46b8260-e8f1-4af6-8a25-7cc9dc5dea17 tempest-VolumesListAdminTestJSON-1825396183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5eb960c0-ea9e-4eeb-82af-9348903ecf17 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:41 devstack sudo[94426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5eb960c0-ea9e-4eeb-82af-9348903ecf17 Nov 03 20:22:41 devstack sudo[94426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:41 devstack sudo[94421]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f30e4ce0-8398-4f6c-acdc-f59d0d60c6cf tempest-VolumesListAdminTestJSON-1762696699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-9e8bf3eb-ff09-4030-85e4-78830edbfd78" returned: 0 in 0.516s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:41 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-f30e4ce0-8398-4f6c-acdc-f59d0d60c6cf tempest-VolumesListAdminTestJSON-1762696699 None] Lock "cinder-quobyte-9e8bf3eb-ff09-4030-85e4-78830edbfd78" released by "delete_volume" :: held 1.181s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:41 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-f30e4ce0-8398-4f6c-acdc-f59d0d60c6cf tempest-VolumesListAdminTestJSON-1762696699 None] Created reservations ['fededdd9-0324-4fbd-beaf-1128f88a66d1', 'a52475fe-e122-4837-b4fa-8afd55553af6', 'b5cf1a96-0732-40e6-bdee-5159ef5201d2', 'cc5d270a-1697-4feb-b0fd-650dc75594ab'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:22:41 devstack sudo[94426]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e46b8260-e8f1-4af6-8a25-7cc9dc5dea17 tempest-VolumesListAdminTestJSON-1825396183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5eb960c0-ea9e-4eeb-82af-9348903ecf17" returned: 0 in 0.456s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:41 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e46b8260-e8f1-4af6-8a25-7cc9dc5dea17 tempest-VolumesListAdminTestJSON-1825396183 None] Lock "cinder-quobyte-5eb960c0-ea9e-4eeb-82af-9348903ecf17" released by "delete_volume" :: held 1.201s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-29fb285f-f806-4da2-879b-0d876586de6a tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-29fb285f-f806-4da2-879b-0d876586de6a tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:41 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-29fb285f-f806-4da2-879b-0d876586de6a tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Creating offline snapshot d2d64140-1520-452e-8c08-c31098e15430 of volume cc70bd30-337e-4e5e-b677-3ba85c0f50b7 {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:22:41 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcdc4ba1-7017-4187-bc3a-730da4138333]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-29fb285f-f806-4da2-879b-0d876586de6a tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f30e4ce0-8398-4f6c-acdc-f59d0d60c6cf tempest-VolumesListAdminTestJSON-1762696699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f30e4ce0-8398-4f6c-acdc-f59d0d60c6cf tempest-VolumesListAdminTestJSON-1762696699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:41 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-f30e4ce0-8398-4f6c-acdc-f59d0d60c6cf tempest-VolumesListAdminTestJSON-1762696699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:22:41 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-f30e4ce0-8398-4f6c-acdc-f59d0d60c6cf tempest-VolumesListAdminTestJSON-1762696699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:22:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f30e4ce0-8398-4f6c-acdc-f59d0d60c6cf tempest-VolumesListAdminTestJSON-1762696699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f30e4ce0-8398-4f6c-acdc-f59d0d60c6cf tempest-VolumesListAdminTestJSON-1762696699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:41 devstack sudo[94432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:22:41 devstack sudo[94432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:41 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-e46b8260-e8f1-4af6-8a25-7cc9dc5dea17 tempest-VolumesListAdminTestJSON-1825396183 None] Created reservations ['24e544e3-a017-469e-9075-135285dd20de', 'b21b25b0-09d0-4b51-b9ac-2f8fb0d540d7', '9d73546d-622f-49e1-a593-602695df1dd8', '934ac10d-8a4b-4fe0-bf84-411af80f179b'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:22:42 devstack sudo[94431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7 Nov 03 20:22:42 devstack sudo[94431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e46b8260-e8f1-4af6-8a25-7cc9dc5dea17 tempest-VolumesListAdminTestJSON-1825396183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e46b8260-e8f1-4af6-8a25-7cc9dc5dea17 tempest-VolumesListAdminTestJSON-1825396183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:42 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e46b8260-e8f1-4af6-8a25-7cc9dc5dea17 tempest-VolumesListAdminTestJSON-1825396183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:22:42 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e46b8260-e8f1-4af6-8a25-7cc9dc5dea17 tempest-VolumesListAdminTestJSON-1825396183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:22:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e46b8260-e8f1-4af6-8a25-7cc9dc5dea17 tempest-VolumesListAdminTestJSON-1825396183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e46b8260-e8f1-4af6-8a25-7cc9dc5dea17 tempest-VolumesListAdminTestJSON-1825396183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:42 devstack sudo[94435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:22:42 devstack sudo[94435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:42 devstack sudo[94432]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f30e4ce0-8398-4f6c-acdc-f59d0d60c6cf tempest-VolumesListAdminTestJSON-1762696699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.393s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:42 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-f30e4ce0-8398-4f6c-acdc-f59d0d60c6cf tempest-VolumesListAdminTestJSON-1762696699 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:22:42 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-f30e4ce0-8398-4f6c-acdc-f59d0d60c6cf tempest-VolumesListAdminTestJSON-1762696699 None] Deleted volume successfully. Nov 03 20:22:42 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-f30e4ce0-8398-4f6c-acdc-f59d0d60c6cf tempest-VolumesListAdminTestJSON-1762696699 None] Lock "cinder-9e8bf3eb-ff09-4030-85e4-78830edbfd78-delete_volume" released by "delete_volume" :: held 2.237s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:42 devstack sudo[94431]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-29fb285f-f806-4da2-879b-0d876586de6a tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7" returned: 0 in 0.532s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-29fb285f-f806-4da2-879b-0d876586de6a tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7.d2d64140-1520-452e-8c08-c31098e15430 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:42 devstack sudo[94435]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e46b8260-e8f1-4af6-8a25-7cc9dc5dea17 tempest-VolumesListAdminTestJSON-1825396183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.333s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:42 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-e46b8260-e8f1-4af6-8a25-7cc9dc5dea17 tempest-VolumesListAdminTestJSON-1825396183 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:22:42 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-e46b8260-e8f1-4af6-8a25-7cc9dc5dea17 tempest-VolumesListAdminTestJSON-1825396183 None] Deleted volume successfully. Nov 03 20:22:42 devstack sudo[94442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7.d2d64140-1520-452e-8c08-c31098e15430 1G Nov 03 20:22:42 devstack sudo[94442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:42 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e46b8260-e8f1-4af6-8a25-7cc9dc5dea17 tempest-VolumesListAdminTestJSON-1825396183 None] Lock "cinder-5eb960c0-ea9e-4eeb-82af-9348903ecf17-delete_volume" released by "delete_volume" :: held 2.100s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:42 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-24fa2011-77e2-4b79-ac30-c7411ac27df2 tempest-VolumesListAdminTestJSON-1825396183 None] Acquiring lock "cinder-af43ae23-a003-4067-a481-5fdeac75c68e-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:42 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-24fa2011-77e2-4b79-ac30-c7411ac27df2 tempest-VolumesListAdminTestJSON-1825396183 None] Lock "cinder-af43ae23-a003-4067-a481-5fdeac75c68e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:42 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-24fa2011-77e2-4b79-ac30-c7411ac27df2 tempest-VolumesListAdminTestJSON-1825396183 None] Acquiring lock "cinder-quobyte-af43ae23-a003-4067-a481-5fdeac75c68e" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:42 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-24fa2011-77e2-4b79-ac30-c7411ac27df2 tempest-VolumesListAdminTestJSON-1825396183 None] Lock "cinder-quobyte-af43ae23-a003-4067-a481-5fdeac75c68e" acquired by "delete_volume" :: waited 0.037s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:42 devstack sudo[94442]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-29fb285f-f806-4da2-879b-0d876586de6a tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7.d2d64140-1520-452e-8c08-c31098e15430 1G" returned: 0 in 0.621s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-29fb285f-f806-4da2-879b-0d876586de6a tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7.d2d64140-1520-452e-8c08-c31098e15430 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:43 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee444233-61e1-424e-9364-a0a5ef1b6baa]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-24fa2011-77e2-4b79-ac30-c7411ac27df2 tempest-VolumesListAdminTestJSON-1825396183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-af43ae23-a003-4067-a481-5fdeac75c68e {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:43 devstack sudo[94448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7.d2d64140-1520-452e-8c08-c31098e15430 Nov 03 20:22:43 devstack sudo[94448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:43 devstack sudo[94449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-af43ae23-a003-4067-a481-5fdeac75c68e Nov 03 20:22:43 devstack sudo[94449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:43 devstack sudo[94448]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-29fb285f-f806-4da2-879b-0d876586de6a tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7.d2d64140-1520-452e-8c08-c31098e15430" returned: 0 in 0.436s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:43 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-29fb285f-f806-4da2-879b-0d876586de6a tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7.d2d64140-1520-452e-8c08-c31098e15430 is being set with open permissions: ugo+rw Nov 03 20:22:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-29fb285f-f806-4da2-879b-0d876586de6a tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7.d2d64140-1520-452e-8c08-c31098e15430 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:43 devstack sudo[94457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7.d2d64140-1520-452e-8c08-c31098e15430 Nov 03 20:22:43 devstack sudo[94457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:43 devstack sudo[94449]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-24fa2011-77e2-4b79-ac30-c7411ac27df2 tempest-VolumesListAdminTestJSON-1825396183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-af43ae23-a003-4067-a481-5fdeac75c68e" returned: 0 in 0.520s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-24fa2011-77e2-4b79-ac30-c7411ac27df2 tempest-VolumesListAdminTestJSON-1825396183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-af43ae23-a003-4067-a481-5fdeac75c68e {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:43 devstack sudo[94460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-af43ae23-a003-4067-a481-5fdeac75c68e Nov 03 20:22:43 devstack sudo[94460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:43 devstack sudo[94457]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-29fb285f-f806-4da2-879b-0d876586de6a tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7.d2d64140-1520-452e-8c08-c31098e15430" returned: 0 in 0.322s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-29fb285f-f806-4da2-879b-0d876586de6a tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:43 devstack sudo[94463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7.info Nov 03 20:22:43 devstack sudo[94463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:43 devstack sudo[94460]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-24fa2011-77e2-4b79-ac30-c7411ac27df2 tempest-VolumesListAdminTestJSON-1825396183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-af43ae23-a003-4067-a481-5fdeac75c68e" returned: 0 in 0.364s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:43 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-24fa2011-77e2-4b79-ac30-c7411ac27df2 tempest-VolumesListAdminTestJSON-1825396183 None] Lock "cinder-quobyte-af43ae23-a003-4067-a481-5fdeac75c68e" released by "delete_volume" :: held 0.987s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:44 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-24fa2011-77e2-4b79-ac30-c7411ac27df2 tempest-VolumesListAdminTestJSON-1825396183 None] Created reservations ['79439ed1-8ace-4e49-b30b-2f9c405b0e4b', '5ea507eb-2d3d-4ae5-8d1e-f92f7480e125', '57ad3807-19c2-4d5a-ba54-855a4b536ebe', 'f4bf145c-0c1b-4357-a48e-09c74e849333'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:22:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-24fa2011-77e2-4b79-ac30-c7411ac27df2 tempest-VolumesListAdminTestJSON-1825396183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-24fa2011-77e2-4b79-ac30-c7411ac27df2 tempest-VolumesListAdminTestJSON-1825396183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:44 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-24fa2011-77e2-4b79-ac30-c7411ac27df2 tempest-VolumesListAdminTestJSON-1825396183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:22:44 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-24fa2011-77e2-4b79-ac30-c7411ac27df2 tempest-VolumesListAdminTestJSON-1825396183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:22:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-24fa2011-77e2-4b79-ac30-c7411ac27df2 tempest-VolumesListAdminTestJSON-1825396183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-24fa2011-77e2-4b79-ac30-c7411ac27df2 tempest-VolumesListAdminTestJSON-1825396183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:44 devstack sudo[94466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:22:44 devstack sudo[94466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:44 devstack sudo[94463]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-29fb285f-f806-4da2-879b-0d876586de6a tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7.info" returned: 0 in 0.592s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:44 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-29fb285f-f806-4da2-879b-0d876586de6a tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7.info is being set with open permissions: ugo+rw Nov 03 20:22:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-29fb285f-f806-4da2-879b-0d876586de6a tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:44 devstack sudo[94469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7.info Nov 03 20:22:44 devstack sudo[94469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:44 devstack sudo[94466]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-24fa2011-77e2-4b79-ac30-c7411ac27df2 tempest-VolumesListAdminTestJSON-1825396183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.350s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:44 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-24fa2011-77e2-4b79-ac30-c7411ac27df2 tempest-VolumesListAdminTestJSON-1825396183 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:22:44 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-24fa2011-77e2-4b79-ac30-c7411ac27df2 tempest-VolumesListAdminTestJSON-1825396183 None] Deleted volume successfully. Nov 03 20:22:44 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-24fa2011-77e2-4b79-ac30-c7411ac27df2 tempest-VolumesListAdminTestJSON-1825396183 None] Lock "cinder-af43ae23-a003-4067-a481-5fdeac75c68e-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:44 devstack sudo[94469]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-29fb285f-f806-4da2-879b-0d876586de6a tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7.info" returned: 0 in 0.350s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-29fb285f-f806-4da2-879b-0d876586de6a tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.995s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:44 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-29fb285f-f806-4da2-879b-0d876586de6a tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Create snapshot completed successfully Nov 03 20:22:45 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2fb8e5fd-4e43-4537-8f6c-3b40d726bc1a tempest-VolumesListAdminTestJSON-1825396183 None] Acquiring lock "cinder-4e50eaf9-2927-4967-8272-686b5122d7ac-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:45 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2fb8e5fd-4e43-4537-8f6c-3b40d726bc1a tempest-VolumesListAdminTestJSON-1825396183 None] Lock "cinder-4e50eaf9-2927-4967-8272-686b5122d7ac-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:45 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2fb8e5fd-4e43-4537-8f6c-3b40d726bc1a tempest-VolumesListAdminTestJSON-1825396183 None] Acquiring lock "cinder-quobyte-4e50eaf9-2927-4967-8272-686b5122d7ac" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:45 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2fb8e5fd-4e43-4537-8f6c-3b40d726bc1a tempest-VolumesListAdminTestJSON-1825396183 None] Lock "cinder-quobyte-4e50eaf9-2927-4967-8272-686b5122d7ac" acquired by "delete_volume" :: waited 0.021s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:45 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[de05eb2b-8a08-4464-9743-72ebc6c554ed]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2fb8e5fd-4e43-4537-8f6c-3b40d726bc1a tempest-VolumesListAdminTestJSON-1825396183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4e50eaf9-2927-4967-8272-686b5122d7ac {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:45 devstack sudo[94473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4e50eaf9-2927-4967-8272-686b5122d7ac Nov 03 20:22:45 devstack sudo[94473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:45 devstack sudo[94473]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2fb8e5fd-4e43-4537-8f6c-3b40d726bc1a tempest-VolumesListAdminTestJSON-1825396183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4e50eaf9-2927-4967-8272-686b5122d7ac" returned: 0 in 0.478s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2fb8e5fd-4e43-4537-8f6c-3b40d726bc1a tempest-VolumesListAdminTestJSON-1825396183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4e50eaf9-2927-4967-8272-686b5122d7ac {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:46 devstack sudo[94479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4e50eaf9-2927-4967-8272-686b5122d7ac Nov 03 20:22:46 devstack sudo[94479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:46 devstack sudo[94479]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2fb8e5fd-4e43-4537-8f6c-3b40d726bc1a tempest-VolumesListAdminTestJSON-1825396183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4e50eaf9-2927-4967-8272-686b5122d7ac" returned: 0 in 0.284s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:46 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2fb8e5fd-4e43-4537-8f6c-3b40d726bc1a tempest-VolumesListAdminTestJSON-1825396183 None] Lock "cinder-quobyte-4e50eaf9-2927-4967-8272-686b5122d7ac" released by "delete_volume" :: held 0.835s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:46 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-2fb8e5fd-4e43-4537-8f6c-3b40d726bc1a tempest-VolumesListAdminTestJSON-1825396183 None] Created reservations ['eb60d3e6-7686-42b1-862b-43b59de179db', 'eb1284f5-1310-4f0f-acea-a835a3d4a0a3', 'e2495358-de38-49c8-b4e3-2d7f557c5997', '7d8816d0-3fd8-49a4-be7a-57a6463dd6f1'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:22:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2fb8e5fd-4e43-4537-8f6c-3b40d726bc1a tempest-VolumesListAdminTestJSON-1825396183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2fb8e5fd-4e43-4537-8f6c-3b40d726bc1a tempest-VolumesListAdminTestJSON-1825396183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:46 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2fb8e5fd-4e43-4537-8f6c-3b40d726bc1a tempest-VolumesListAdminTestJSON-1825396183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:22:46 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2fb8e5fd-4e43-4537-8f6c-3b40d726bc1a tempest-VolumesListAdminTestJSON-1825396183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:22:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2fb8e5fd-4e43-4537-8f6c-3b40d726bc1a tempest-VolumesListAdminTestJSON-1825396183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2fb8e5fd-4e43-4537-8f6c-3b40d726bc1a tempest-VolumesListAdminTestJSON-1825396183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:46 devstack sudo[94482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:22:46 devstack sudo[94482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:46 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8c6e7720-a8f9-4c12-af63-f7e25090ff0a tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Acquiring lock "cinder-d2d64140-1520-452e-8c08-c31098e15430-delete_snapshot" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:46 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8c6e7720-a8f9-4c12-af63-f7e25090ff0a tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Lock "cinder-d2d64140-1520-452e-8c08-c31098e15430-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:46 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8c6e7720-a8f9-4c12-af63-f7e25090ff0a tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Acquiring lock "cinder-quobyte-cc70bd30-337e-4e5e-b677-3ba85c0f50b7" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:46 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8c6e7720-a8f9-4c12-af63-f7e25090ff0a tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Lock "cinder-quobyte-cc70bd30-337e-4e5e-b677-3ba85c0f50b7" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:46 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8c6e7720-a8f9-4c12-af63-f7e25090ff0a tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Acquiring lock "cinder-quobyte-d2d64140-1520-452e-8c08-c31098e15430" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:46 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8c6e7720-a8f9-4c12-af63-f7e25090ff0a tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Lock "cinder-quobyte-d2d64140-1520-452e-8c08-c31098e15430" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:46 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-8c6e7720-a8f9-4c12-af63-f7e25090ff0a tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Deleting offline snapshot d2d64140-1520-452e-8c08-c31098e15430 of volume cc70bd30-337e-4e5e-b677-3ba85c0f50b7 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:22:46 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-8c6e7720-a8f9-4c12-af63-f7e25090ff0a tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] snapshot_file for this snap is: volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7.d2d64140-1520-452e-8c08-c31098e15430 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:22:46 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff32f587-8f2b-4f3e-ac21-13e724fc6e0c]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8c6e7720-a8f9-4c12-af63-f7e25090ff0a tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7.d2d64140-1520-452e-8c08-c31098e15430 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:46 devstack sudo[94484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7.d2d64140-1520-452e-8c08-c31098e15430 Nov 03 20:22:46 devstack sudo[94484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:46 devstack sudo[94482]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2fb8e5fd-4e43-4537-8f6c-3b40d726bc1a tempest-VolumesListAdminTestJSON-1825396183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.407s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:46 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-2fb8e5fd-4e43-4537-8f6c-3b40d726bc1a tempest-VolumesListAdminTestJSON-1825396183 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:22:46 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-2fb8e5fd-4e43-4537-8f6c-3b40d726bc1a tempest-VolumesListAdminTestJSON-1825396183 None] Deleted volume successfully. Nov 03 20:22:46 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2fb8e5fd-4e43-4537-8f6c-3b40d726bc1a tempest-VolumesListAdminTestJSON-1825396183 None] Lock "cinder-4e50eaf9-2927-4967-8272-686b5122d7ac-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:47 devstack sudo[94484]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8c6e7720-a8f9-4c12-af63-f7e25090ff0a tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7.d2d64140-1520-452e-8c08-c31098e15430" returned: 0 in 0.553s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:47 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-8c6e7720-a8f9-4c12-af63-f7e25090ff0a tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:22:47 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[1646d7cd-9f08-421e-b623-7cfbafe9df7b]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8c6e7720-a8f9-4c12-af63-f7e25090ff0a tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:47 devstack sudo[94492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7 Nov 03 20:22:47 devstack sudo[94492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:47 devstack sudo[94492]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8c6e7720-a8f9-4c12-af63-f7e25090ff0a tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7" returned: 0 in 0.432s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8c6e7720-a8f9-4c12-af63-f7e25090ff0a tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7.d2d64140-1520-452e-8c08-c31098e15430 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:47 devstack sudo[94497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7.d2d64140-1520-452e-8c08-c31098e15430 Nov 03 20:22:47 devstack sudo[94497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:48 devstack sudo[94497]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8c6e7720-a8f9-4c12-af63-f7e25090ff0a tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7.d2d64140-1520-452e-8c08-c31098e15430" returned: 0 in 0.426s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8c6e7720-a8f9-4c12-af63-f7e25090ff0a tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7.d2d64140-1520-452e-8c08-c31098e15430 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:48 devstack sudo[94503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7.d2d64140-1520-452e-8c08-c31098e15430 Nov 03 20:22:48 devstack sudo[94503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:48 devstack sudo[94503]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8c6e7720-a8f9-4c12-af63-f7e25090ff0a tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7.d2d64140-1520-452e-8c08-c31098e15430" returned: 0 in 0.408s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:48 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8c6e7720-a8f9-4c12-af63-f7e25090ff0a tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Lock "cinder-quobyte-d2d64140-1520-452e-8c08-c31098e15430" released by "_delete_snapshot" :: held 2.004s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:48 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8c6e7720-a8f9-4c12-af63-f7e25090ff0a tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Lock "cinder-quobyte-cc70bd30-337e-4e5e-b677-3ba85c0f50b7" released by "delete_snapshot" :: held 2.042s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:48 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-8c6e7720-a8f9-4c12-af63-f7e25090ff0a tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Created reservations ['c6674d52-9075-4420-a4c9-528e376c3605', 'bd4ff3ad-87bd-40e8-95de-424736a72bce', '291a2441-9119-4310-9370-78a2e542ba89', 'd19fd60a-310d-4149-877b-6125100e4959'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:22:48 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-8c6e7720-a8f9-4c12-af63-f7e25090ff0a tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Delete snapshot completed successfully. Nov 03 20:22:48 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8c6e7720-a8f9-4c12-af63-f7e25090ff0a tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Lock "cinder-d2d64140-1520-452e-8c08-c31098e15430-delete_snapshot" released by "delete_snapshot" :: held 2.264s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:49 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-3ba6f762-1715-4c1f-99dd-f7bc7990070b tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Acquiring lock "cinder-cc70bd30-337e-4e5e-b677-3ba85c0f50b7-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:49 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-3ba6f762-1715-4c1f-99dd-f7bc7990070b tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Lock "cinder-cc70bd30-337e-4e5e-b677-3ba85c0f50b7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:49 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-3ba6f762-1715-4c1f-99dd-f7bc7990070b tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Acquiring lock "cinder-quobyte-cc70bd30-337e-4e5e-b677-3ba85c0f50b7" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:50 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-3ba6f762-1715-4c1f-99dd-f7bc7990070b tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Lock "cinder-quobyte-cc70bd30-337e-4e5e-b677-3ba85c0f50b7" acquired by "delete_volume" :: waited 0.022s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:50 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[075f7b14-b42e-4244-86da-159767c92738]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3ba6f762-1715-4c1f-99dd-f7bc7990070b tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:50 devstack sudo[94509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7 Nov 03 20:22:50 devstack sudo[94509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:50 devstack sudo[94509]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3ba6f762-1715-4c1f-99dd-f7bc7990070b tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7" returned: 0 in 0.452s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3ba6f762-1715-4c1f-99dd-f7bc7990070b tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:50 devstack sudo[94515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7 Nov 03 20:22:50 devstack sudo[94515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:50 devstack sudo[94515]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3ba6f762-1715-4c1f-99dd-f7bc7990070b tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cc70bd30-337e-4e5e-b677-3ba85c0f50b7" returned: 0 in 0.385s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:50 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-3ba6f762-1715-4c1f-99dd-f7bc7990070b tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Lock "cinder-quobyte-cc70bd30-337e-4e5e-b677-3ba85c0f50b7" released by "delete_volume" :: held 0.925s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:50 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-e201c0da-f8ce-4213-9267-2f558338a4e8 tempest-VolumeQuotasAdminTestJSON-1498104510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:22:51 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e201c0da-f8ce-4213-9267-2f558338a4e8 tempest-VolumeQuotasAdminTestJSON-1498104510 None] Flow 'volume_create_manager' (61d5879a-27cc-4fa6-bd63-a1508cb38c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:22:51 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e201c0da-f8ce-4213-9267-2f558338a4e8 tempest-VolumeQuotasAdminTestJSON-1498104510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ad13267-9f99-43f4-908f-2cb4a685aabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:51 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e201c0da-f8ce-4213-9267-2f558338a4e8 tempest-VolumeQuotasAdminTestJSON-1498104510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ad13267-9f99-43f4-908f-2cb4a685aabd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1588317337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45e25227-f74e-4323-9a49-129ba2ec2f54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2afd2eb070434ab4bc01243eb79e19f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:22:51Z,use_quota=True,user_id='7bc39e7816d145b1b240a235f20d7d7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:51 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e201c0da-f8ce-4213-9267-2f558338a4e8 tempest-VolumeQuotasAdminTestJSON-1498104510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4901609a-45f4-49b9-bc65-cb038e68faa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:51 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e201c0da-f8ce-4213-9267-2f558338a4e8 tempest-VolumeQuotasAdminTestJSON-1498104510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4901609a-45f4-49b9-bc65-cb038e68faa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:51 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e201c0da-f8ce-4213-9267-2f558338a4e8 tempest-VolumeQuotasAdminTestJSON-1498104510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (601f8acc-7c18-4d58-b426-397f8f3a312b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:51 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e201c0da-f8ce-4213-9267-2f558338a4e8 tempest-VolumeQuotasAdminTestJSON-1498104510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (601f8acc-7c18-4d58-b426-397f8f3a312b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45e25227-f74e-4323-9a49-129ba2ec2f54', 'volume_name': 'volume-45e25227-f74e-4323-9a49-129ba2ec2f54', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:51 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e201c0da-f8ce-4213-9267-2f558338a4e8 tempest-VolumeQuotasAdminTestJSON-1498104510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4181e0b9-3616-46a8-8a9d-78690eba4ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:51 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e201c0da-f8ce-4213-9267-2f558338a4e8 tempest-VolumeQuotasAdminTestJSON-1498104510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4181e0b9-3616-46a8-8a9d-78690eba4ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:51 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e201c0da-f8ce-4213-9267-2f558338a4e8 tempest-VolumeQuotasAdminTestJSON-1498104510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f480dbe1-807b-43ee-84de-da8b42e4e26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:51 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-e201c0da-f8ce-4213-9267-2f558338a4e8 tempest-VolumeQuotasAdminTestJSON-1498104510 None] Volume 45e25227-f74e-4323-9a49-129ba2ec2f54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45e25227-f74e-4323-9a49-129ba2ec2f54', 'volume_size': 1} Nov 03 20:22:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e201c0da-f8ce-4213-9267-2f558338a4e8 tempest-VolumeQuotasAdminTestJSON-1498104510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e201c0da-f8ce-4213-9267-2f558338a4e8 tempest-VolumeQuotasAdminTestJSON-1498104510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:51 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e201c0da-f8ce-4213-9267-2f558338a4e8 tempest-VolumeQuotasAdminTestJSON-1498104510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1588317337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45e25227-f74e-4323-9a49-129ba2ec2f54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2afd2eb070434ab4bc01243eb79e19f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:22:51Z,use_quota=True,user_id='7bc39e7816d145b1b240a235f20d7d7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:22:51 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-e201c0da-f8ce-4213-9267-2f558338a4e8 tempest-VolumeQuotasAdminTestJSON-1498104510 None] Creating volume 45e25227-f74e-4323-9a49-129ba2ec2f54 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:22:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e201c0da-f8ce-4213-9267-2f558338a4e8 tempest-VolumeQuotasAdminTestJSON-1498104510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e201c0da-f8ce-4213-9267-2f558338a4e8 tempest-VolumeQuotasAdminTestJSON-1498104510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:51 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e201c0da-f8ce-4213-9267-2f558338a4e8 tempest-VolumeQuotasAdminTestJSON-1498104510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:22:51 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e201c0da-f8ce-4213-9267-2f558338a4e8 tempest-VolumeQuotasAdminTestJSON-1498104510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:22:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e201c0da-f8ce-4213-9267-2f558338a4e8 tempest-VolumeQuotasAdminTestJSON-1498104510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:51 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e201c0da-f8ce-4213-9267-2f558338a4e8 tempest-VolumeQuotasAdminTestJSON-1498104510 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:22:51 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-e201c0da-f8ce-4213-9267-2f558338a4e8 tempest-VolumeQuotasAdminTestJSON-1498104510 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:22:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e201c0da-f8ce-4213-9267-2f558338a4e8 tempest-VolumeQuotasAdminTestJSON-1498104510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-45e25227-f74e-4323-9a49-129ba2ec2f54 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:51 devstack sudo[94519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-45e25227-f74e-4323-9a49-129ba2ec2f54 1073741824 Nov 03 20:22:51 devstack sudo[94519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:51 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-3ba6f762-1715-4c1f-99dd-f7bc7990070b tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Created reservations ['db78834e-5eb1-4803-bc0a-35e3d7e8b132', '4b8d48dc-1061-4097-af78-3d04c0715836', '86a75a03-38b6-4af7-aae8-4e31e069a24f', '5e1579bd-159d-4e58-82d7-2457727687d2'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:22:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-3ba6f762-1715-4c1f-99dd-f7bc7990070b tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-3ba6f762-1715-4c1f-99dd-f7bc7990070b tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:51 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-3ba6f762-1715-4c1f-99dd-f7bc7990070b tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:22:51 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-3ba6f762-1715-4c1f-99dd-f7bc7990070b tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:22:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-3ba6f762-1715-4c1f-99dd-f7bc7990070b tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3ba6f762-1715-4c1f-99dd-f7bc7990070b tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:51 devstack sudo[94521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:22:51 devstack sudo[94521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:51 devstack sudo[94521]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3ba6f762-1715-4c1f-99dd-f7bc7990070b tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.339s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:51 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-3ba6f762-1715-4c1f-99dd-f7bc7990070b tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:22:51 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-3ba6f762-1715-4c1f-99dd-f7bc7990070b tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Deleted volume successfully. Nov 03 20:22:51 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-3ba6f762-1715-4c1f-99dd-f7bc7990070b tempest-VolumeSnapshotQuotasNegativeTestJSON-932864575 None] Lock "cinder-cc70bd30-337e-4e5e-b677-3ba85c0f50b7-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:51 devstack sudo[94519]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e201c0da-f8ce-4213-9267-2f558338a4e8 tempest-VolumeQuotasAdminTestJSON-1498104510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-45e25227-f74e-4323-9a49-129ba2ec2f54 1073741824" returned: 0 in 0.756s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e201c0da-f8ce-4213-9267-2f558338a4e8 tempest-VolumeQuotasAdminTestJSON-1498104510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-45e25227-f74e-4323-9a49-129ba2ec2f54 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:52 devstack sudo[94530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-45e25227-f74e-4323-9a49-129ba2ec2f54 Nov 03 20:22:52 devstack sudo[94530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:52 devstack sudo[94530]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e201c0da-f8ce-4213-9267-2f558338a4e8 tempest-VolumeQuotasAdminTestJSON-1498104510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-45e25227-f74e-4323-9a49-129ba2ec2f54" returned: 0 in 0.362s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:52 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e201c0da-f8ce-4213-9267-2f558338a4e8 tempest-VolumeQuotasAdminTestJSON-1498104510 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:22:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e201c0da-f8ce-4213-9267-2f558338a4e8 tempest-VolumeQuotasAdminTestJSON-1498104510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:52 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e201c0da-f8ce-4213-9267-2f558338a4e8 tempest-VolumeQuotasAdminTestJSON-1498104510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f480dbe1-807b-43ee-84de-da8b42e4e26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45e25227-f74e-4323-9a49-129ba2ec2f54', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:52 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e201c0da-f8ce-4213-9267-2f558338a4e8 tempest-VolumeQuotasAdminTestJSON-1498104510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c405c806-2159-4d5a-96e5-46a7ee9fa398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:52 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-e201c0da-f8ce-4213-9267-2f558338a4e8 tempest-VolumeQuotasAdminTestJSON-1498104510 None] Volume volume-45e25227-f74e-4323-9a49-129ba2ec2f54 (45e25227-f74e-4323-9a49-129ba2ec2f54): created successfully Nov 03 20:22:52 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e201c0da-f8ce-4213-9267-2f558338a4e8 tempest-VolumeQuotasAdminTestJSON-1498104510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c405c806-2159-4d5a-96e5-46a7ee9fa398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:52 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e201c0da-f8ce-4213-9267-2f558338a4e8 tempest-VolumeQuotasAdminTestJSON-1498104510 None] Flow 'volume_create_manager' (61d5879a-27cc-4fa6-bd63-a1508cb38c66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:22:52 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-e201c0da-f8ce-4213-9267-2f558338a4e8 tempest-VolumeQuotasAdminTestJSON-1498104510 None] Created volume successfully. Nov 03 20:22:53 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c2c1beac-dd4f-41cd-aa95-889c5f9885c2 tempest-VolumeQuotasAdminTestJSON-1498104510 None] Acquiring lock "cinder-45e25227-f74e-4323-9a49-129ba2ec2f54-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:53 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c2c1beac-dd4f-41cd-aa95-889c5f9885c2 tempest-VolumeQuotasAdminTestJSON-1498104510 None] Lock "cinder-45e25227-f74e-4323-9a49-129ba2ec2f54-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:53 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c2c1beac-dd4f-41cd-aa95-889c5f9885c2 tempest-VolumeQuotasAdminTestJSON-1498104510 None] Acquiring lock "cinder-quobyte-45e25227-f74e-4323-9a49-129ba2ec2f54" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:22:53 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c2c1beac-dd4f-41cd-aa95-889c5f9885c2 tempest-VolumeQuotasAdminTestJSON-1498104510 None] Lock "cinder-quobyte-45e25227-f74e-4323-9a49-129ba2ec2f54" acquired by "delete_volume" :: waited 0.022s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:22:53 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b98dea9-0fb3-4b2b-89c3-57fda68b250c]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c2c1beac-dd4f-41cd-aa95-889c5f9885c2 tempest-VolumeQuotasAdminTestJSON-1498104510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-45e25227-f74e-4323-9a49-129ba2ec2f54 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:53 devstack sudo[94552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-45e25227-f74e-4323-9a49-129ba2ec2f54 Nov 03 20:22:53 devstack sudo[94552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:53 devstack sudo[94552]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c2c1beac-dd4f-41cd-aa95-889c5f9885c2 tempest-VolumeQuotasAdminTestJSON-1498104510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-45e25227-f74e-4323-9a49-129ba2ec2f54" returned: 0 in 0.460s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c2c1beac-dd4f-41cd-aa95-889c5f9885c2 tempest-VolumeQuotasAdminTestJSON-1498104510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-45e25227-f74e-4323-9a49-129ba2ec2f54 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:53 devstack sudo[94557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-45e25227-f74e-4323-9a49-129ba2ec2f54 Nov 03 20:22:53 devstack sudo[94557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:54 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e3c558c-ca81-45c6-b29c-c5f2ab49fe5e tempest-SnapshotMetadataTestJSON-41514233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:22:54 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7e3c558c-ca81-45c6-b29c-c5f2ab49fe5e tempest-SnapshotMetadataTestJSON-41514233 None] Flow 'volume_create_manager' (6f80a8a1-ff6f-44bf-859a-b7e8354d72a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:22:54 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7e3c558c-ca81-45c6-b29c-c5f2ab49fe5e tempest-SnapshotMetadataTestJSON-41514233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (005932a3-41c2-4c51-ae55-716f721c8ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:54 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7e3c558c-ca81-45c6-b29c-c5f2ab49fe5e tempest-SnapshotMetadataTestJSON-41514233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (005932a3-41c2-4c51-ae55-716f721c8ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1982251150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c7884eb-6d91-4195-8ccc-01ab9e11c0ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5956e0766a2d450bbb4968ce7c22fab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:22:54Z,use_quota=True,user_id='da0e38db78704f3285fb50d11625eaf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:54 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7e3c558c-ca81-45c6-b29c-c5f2ab49fe5e tempest-SnapshotMetadataTestJSON-41514233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bea97423-ca28-48a0-a7d0-9a37515deb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:54 devstack sudo[94557]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:54 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7e3c558c-ca81-45c6-b29c-c5f2ab49fe5e tempest-SnapshotMetadataTestJSON-41514233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bea97423-ca28-48a0-a7d0-9a37515deb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:54 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7e3c558c-ca81-45c6-b29c-c5f2ab49fe5e tempest-SnapshotMetadataTestJSON-41514233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03fe014d-c8a6-499b-beef-acfd37bb6f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:54 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7e3c558c-ca81-45c6-b29c-c5f2ab49fe5e tempest-SnapshotMetadataTestJSON-41514233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03fe014d-c8a6-499b-beef-acfd37bb6f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c7884eb-6d91-4195-8ccc-01ab9e11c0ba', 'volume_name': 'volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:54 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7e3c558c-ca81-45c6-b29c-c5f2ab49fe5e tempest-SnapshotMetadataTestJSON-41514233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbfbafb2-44c5-4bc5-ab03-e2198cdc8ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:54 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7e3c558c-ca81-45c6-b29c-c5f2ab49fe5e tempest-SnapshotMetadataTestJSON-41514233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbfbafb2-44c5-4bc5-ab03-e2198cdc8ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:54 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7e3c558c-ca81-45c6-b29c-c5f2ab49fe5e tempest-SnapshotMetadataTestJSON-41514233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d75872d6-392a-4da7-816b-982ed6044b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:54 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-7e3c558c-ca81-45c6-b29c-c5f2ab49fe5e tempest-SnapshotMetadataTestJSON-41514233 None] Volume 1c7884eb-6d91-4195-8ccc-01ab9e11c0ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba', 'volume_size': 1} Nov 03 20:22:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7e3c558c-ca81-45c6-b29c-c5f2ab49fe5e tempest-SnapshotMetadataTestJSON-41514233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7e3c558c-ca81-45c6-b29c-c5f2ab49fe5e tempest-SnapshotMetadataTestJSON-41514233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:54 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-7e3c558c-ca81-45c6-b29c-c5f2ab49fe5e tempest-SnapshotMetadataTestJSON-41514233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1982251150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c7884eb-6d91-4195-8ccc-01ab9e11c0ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5956e0766a2d450bbb4968ce7c22fab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:22:54Z,use_quota=True,user_id='da0e38db78704f3285fb50d11625eaf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:22:54 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-7e3c558c-ca81-45c6-b29c-c5f2ab49fe5e tempest-SnapshotMetadataTestJSON-41514233 None] Creating volume 1c7884eb-6d91-4195-8ccc-01ab9e11c0ba {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:22:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7e3c558c-ca81-45c6-b29c-c5f2ab49fe5e tempest-SnapshotMetadataTestJSON-41514233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7e3c558c-ca81-45c6-b29c-c5f2ab49fe5e tempest-SnapshotMetadataTestJSON-41514233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:54 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-7e3c558c-ca81-45c6-b29c-c5f2ab49fe5e tempest-SnapshotMetadataTestJSON-41514233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:22:54 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-7e3c558c-ca81-45c6-b29c-c5f2ab49fe5e tempest-SnapshotMetadataTestJSON-41514233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:22:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7e3c558c-ca81-45c6-b29c-c5f2ab49fe5e tempest-SnapshotMetadataTestJSON-41514233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:54 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-7e3c558c-ca81-45c6-b29c-c5f2ab49fe5e tempest-SnapshotMetadataTestJSON-41514233 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:22:54 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-7e3c558c-ca81-45c6-b29c-c5f2ab49fe5e tempest-SnapshotMetadataTestJSON-41514233 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:22:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7e3c558c-ca81-45c6-b29c-c5f2ab49fe5e tempest-SnapshotMetadataTestJSON-41514233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c2c1beac-dd4f-41cd-aa95-889c5f9885c2 tempest-VolumeQuotasAdminTestJSON-1498104510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-45e25227-f74e-4323-9a49-129ba2ec2f54" returned: 0 in 0.421s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:54 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c2c1beac-dd4f-41cd-aa95-889c5f9885c2 tempest-VolumeQuotasAdminTestJSON-1498104510 None] Lock "cinder-quobyte-45e25227-f74e-4323-9a49-129ba2ec2f54" released by "delete_volume" :: held 0.946s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:54 devstack sudo[94560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba 1073741824 Nov 03 20:22:54 devstack sudo[94560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:54 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-c2c1beac-dd4f-41cd-aa95-889c5f9885c2 tempest-VolumeQuotasAdminTestJSON-1498104510 None] Created reservations ['3148b943-ddc4-4fc3-98f3-08271f774586', 'f7fe5cc0-a986-4f18-9c41-16c479cc6c87', '202e446b-cced-4831-bd06-cde0b78f9e6b', 'c3a5976a-40b8-44a5-bf34-5d29dbf826b0'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:22:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c2c1beac-dd4f-41cd-aa95-889c5f9885c2 tempest-VolumeQuotasAdminTestJSON-1498104510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c2c1beac-dd4f-41cd-aa95-889c5f9885c2 tempest-VolumeQuotasAdminTestJSON-1498104510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:54 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c2c1beac-dd4f-41cd-aa95-889c5f9885c2 tempest-VolumeQuotasAdminTestJSON-1498104510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:22:54 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c2c1beac-dd4f-41cd-aa95-889c5f9885c2 tempest-VolumeQuotasAdminTestJSON-1498104510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:22:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c2c1beac-dd4f-41cd-aa95-889c5f9885c2 tempest-VolumeQuotasAdminTestJSON-1498104510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c2c1beac-dd4f-41cd-aa95-889c5f9885c2 tempest-VolumeQuotasAdminTestJSON-1498104510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:54 devstack sudo[94562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:22:54 devstack sudo[94562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:54 devstack sudo[94562]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c2c1beac-dd4f-41cd-aa95-889c5f9885c2 tempest-VolumeQuotasAdminTestJSON-1498104510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.311s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:54 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-c2c1beac-dd4f-41cd-aa95-889c5f9885c2 tempest-VolumeQuotasAdminTestJSON-1498104510 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:22:54 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-c2c1beac-dd4f-41cd-aa95-889c5f9885c2 tempest-VolumeQuotasAdminTestJSON-1498104510 None] Deleted volume successfully. Nov 03 20:22:54 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c2c1beac-dd4f-41cd-aa95-889c5f9885c2 tempest-VolumeQuotasAdminTestJSON-1498104510 None] Lock "cinder-45e25227-f74e-4323-9a49-129ba2ec2f54-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:22:54 devstack sudo[94560]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7e3c558c-ca81-45c6-b29c-c5f2ab49fe5e tempest-SnapshotMetadataTestJSON-41514233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba 1073741824" returned: 0 in 0.632s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7e3c558c-ca81-45c6-b29c-c5f2ab49fe5e tempest-SnapshotMetadataTestJSON-41514233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:54 devstack sudo[94571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba Nov 03 20:22:54 devstack sudo[94571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:55 devstack sudo[94571]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7e3c558c-ca81-45c6-b29c-c5f2ab49fe5e tempest-SnapshotMetadataTestJSON-41514233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba" returned: 0 in 0.395s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:55 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-7e3c558c-ca81-45c6-b29c-c5f2ab49fe5e tempest-SnapshotMetadataTestJSON-41514233 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:22:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7e3c558c-ca81-45c6-b29c-c5f2ab49fe5e tempest-SnapshotMetadataTestJSON-41514233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:55 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7e3c558c-ca81-45c6-b29c-c5f2ab49fe5e tempest-SnapshotMetadataTestJSON-41514233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d75872d6-392a-4da7-816b-982ed6044b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:55 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7e3c558c-ca81-45c6-b29c-c5f2ab49fe5e tempest-SnapshotMetadataTestJSON-41514233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cef7d439-b5f3-436d-b0e9-f2c3bbb89374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:55 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-7e3c558c-ca81-45c6-b29c-c5f2ab49fe5e tempest-SnapshotMetadataTestJSON-41514233 None] Volume volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba (1c7884eb-6d91-4195-8ccc-01ab9e11c0ba): created successfully Nov 03 20:22:55 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7e3c558c-ca81-45c6-b29c-c5f2ab49fe5e tempest-SnapshotMetadataTestJSON-41514233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cef7d439-b5f3-436d-b0e9-f2c3bbb89374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:55 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7e3c558c-ca81-45c6-b29c-c5f2ab49fe5e tempest-SnapshotMetadataTestJSON-41514233 None] Flow 'volume_create_manager' (6f80a8a1-ff6f-44bf-859a-b7e8354d72a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:22:55 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-7e3c558c-ca81-45c6-b29c-c5f2ab49fe5e tempest-SnapshotMetadataTestJSON-41514233 None] Created volume successfully. Nov 03 20:22:56 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8bea882-a392-40a1-8149-15ff71b9db9c tempest-VolumeQuotasAdminTestJSON-1498104510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:22:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c8bea882-a392-40a1-8149-15ff71b9db9c tempest-VolumeQuotasAdminTestJSON-1498104510 None] Flow 'volume_create_manager' (9d8e55b4-8410-4546-b558-ea56646cf732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:22:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c8bea882-a392-40a1-8149-15ff71b9db9c tempest-VolumeQuotasAdminTestJSON-1498104510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ade657ec-e1a7-4de2-872f-717c6fcd5940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c8bea882-a392-40a1-8149-15ff71b9db9c tempest-VolumeQuotasAdminTestJSON-1498104510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ade657ec-e1a7-4de2-872f-717c6fcd5940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1000640485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dcd42d5-f52a-46b0-b8b6-8d7d425dc208,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2afd2eb070434ab4bc01243eb79e19f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:22:56Z,use_quota=True,user_id='7bc39e7816d145b1b240a235f20d7d7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c8bea882-a392-40a1-8149-15ff71b9db9c tempest-VolumeQuotasAdminTestJSON-1498104510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb12925d-0e8b-4037-a7ce-c39cd464934e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c8bea882-a392-40a1-8149-15ff71b9db9c tempest-VolumeQuotasAdminTestJSON-1498104510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb12925d-0e8b-4037-a7ce-c39cd464934e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c8bea882-a392-40a1-8149-15ff71b9db9c tempest-VolumeQuotasAdminTestJSON-1498104510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87215f6e-3ba9-4fbf-8c20-4efbbd00ef1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c8bea882-a392-40a1-8149-15ff71b9db9c tempest-VolumeQuotasAdminTestJSON-1498104510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87215f6e-3ba9-4fbf-8c20-4efbbd00ef1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dcd42d5-f52a-46b0-b8b6-8d7d425dc208', 'volume_name': 'volume-6dcd42d5-f52a-46b0-b8b6-8d7d425dc208', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c8bea882-a392-40a1-8149-15ff71b9db9c tempest-VolumeQuotasAdminTestJSON-1498104510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c87bb6e-5203-4cd2-8d07-7ebc4852b667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c8bea882-a392-40a1-8149-15ff71b9db9c tempest-VolumeQuotasAdminTestJSON-1498104510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c87bb6e-5203-4cd2-8d07-7ebc4852b667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c8bea882-a392-40a1-8149-15ff71b9db9c tempest-VolumeQuotasAdminTestJSON-1498104510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (597bf0b0-5c4b-4120-bf68-81f89e002cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:56 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-c8bea882-a392-40a1-8149-15ff71b9db9c tempest-VolumeQuotasAdminTestJSON-1498104510 None] Volume 6dcd42d5-f52a-46b0-b8b6-8d7d425dc208: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dcd42d5-f52a-46b0-b8b6-8d7d425dc208', 'volume_size': 1} Nov 03 20:22:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c8bea882-a392-40a1-8149-15ff71b9db9c tempest-VolumeQuotasAdminTestJSON-1498104510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c8bea882-a392-40a1-8149-15ff71b9db9c tempest-VolumeQuotasAdminTestJSON-1498104510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:56 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c8bea882-a392-40a1-8149-15ff71b9db9c tempest-VolumeQuotasAdminTestJSON-1498104510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1000640485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dcd42d5-f52a-46b0-b8b6-8d7d425dc208,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2afd2eb070434ab4bc01243eb79e19f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:22:56Z,use_quota=True,user_id='7bc39e7816d145b1b240a235f20d7d7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:22:56 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-c8bea882-a392-40a1-8149-15ff71b9db9c tempest-VolumeQuotasAdminTestJSON-1498104510 None] Creating volume 6dcd42d5-f52a-46b0-b8b6-8d7d425dc208 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:22:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c8bea882-a392-40a1-8149-15ff71b9db9c tempest-VolumeQuotasAdminTestJSON-1498104510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c8bea882-a392-40a1-8149-15ff71b9db9c tempest-VolumeQuotasAdminTestJSON-1498104510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:56 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c8bea882-a392-40a1-8149-15ff71b9db9c tempest-VolumeQuotasAdminTestJSON-1498104510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:22:56 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c8bea882-a392-40a1-8149-15ff71b9db9c tempest-VolumeQuotasAdminTestJSON-1498104510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:22:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c8bea882-a392-40a1-8149-15ff71b9db9c tempest-VolumeQuotasAdminTestJSON-1498104510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:56 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c8bea882-a392-40a1-8149-15ff71b9db9c tempest-VolumeQuotasAdminTestJSON-1498104510 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:22:56 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-c8bea882-a392-40a1-8149-15ff71b9db9c tempest-VolumeQuotasAdminTestJSON-1498104510 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:22:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c8bea882-a392-40a1-8149-15ff71b9db9c tempest-VolumeQuotasAdminTestJSON-1498104510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dcd42d5-f52a-46b0-b8b6-8d7d425dc208 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:56 devstack sudo[94623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dcd42d5-f52a-46b0-b8b6-8d7d425dc208 1073741824 Nov 03 20:22:56 devstack sudo[94623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a62521b3-b74d-4511-beb1-480b9dfb350f tempest-SnapshotMetadataTestJSON-41514233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:22:57 devstack sudo[94623]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c8bea882-a392-40a1-8149-15ff71b9db9c tempest-VolumeQuotasAdminTestJSON-1498104510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dcd42d5-f52a-46b0-b8b6-8d7d425dc208 1073741824" returned: 0 in 0.967s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c8bea882-a392-40a1-8149-15ff71b9db9c tempest-VolumeQuotasAdminTestJSON-1498104510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dcd42d5-f52a-46b0-b8b6-8d7d425dc208 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:57 devstack sudo[94646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dcd42d5-f52a-46b0-b8b6-8d7d425dc208 Nov 03 20:22:57 devstack sudo[94646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:57 devstack sudo[94646]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c8bea882-a392-40a1-8149-15ff71b9db9c tempest-VolumeQuotasAdminTestJSON-1498104510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dcd42d5-f52a-46b0-b8b6-8d7d425dc208" returned: 0 in 0.432s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:57 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c8bea882-a392-40a1-8149-15ff71b9db9c tempest-VolumeQuotasAdminTestJSON-1498104510 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:22:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c8bea882-a392-40a1-8149-15ff71b9db9c tempest-VolumeQuotasAdminTestJSON-1498104510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.484s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:22:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a62521b3-b74d-4511-beb1-480b9dfb350f tempest-SnapshotMetadataTestJSON-41514233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.154s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:22:57 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-a62521b3-b74d-4511-beb1-480b9dfb350f tempest-SnapshotMetadataTestJSON-41514233 None] Creating offline snapshot 4c98d547-f923-4649-b418-2eaa79f74347 of volume 1c7884eb-6d91-4195-8ccc-01ab9e11c0ba {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:22:57 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c8bea882-a392-40a1-8149-15ff71b9db9c tempest-VolumeQuotasAdminTestJSON-1498104510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (597bf0b0-5c4b-4120-bf68-81f89e002cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dcd42d5-f52a-46b0-b8b6-8d7d425dc208', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:57 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c8bea882-a392-40a1-8149-15ff71b9db9c tempest-VolumeQuotasAdminTestJSON-1498104510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fd8b659-604b-4e2e-915a-b084d86ced9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:22:57 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[76fa76d2-252d-4abb-96b8-84bbea565ccd]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:22:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a62521b3-b74d-4511-beb1-480b9dfb350f tempest-SnapshotMetadataTestJSON-41514233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:58 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-c8bea882-a392-40a1-8149-15ff71b9db9c tempest-VolumeQuotasAdminTestJSON-1498104510 None] Volume volume-6dcd42d5-f52a-46b0-b8b6-8d7d425dc208 (6dcd42d5-f52a-46b0-b8b6-8d7d425dc208): created successfully Nov 03 20:22:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c8bea882-a392-40a1-8149-15ff71b9db9c tempest-VolumeQuotasAdminTestJSON-1498104510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fd8b659-604b-4e2e-915a-b084d86ced9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:22:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c8bea882-a392-40a1-8149-15ff71b9db9c tempest-VolumeQuotasAdminTestJSON-1498104510 None] Flow 'volume_create_manager' (9d8e55b4-8410-4546-b558-ea56646cf732) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:22:58 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-c8bea882-a392-40a1-8149-15ff71b9db9c tempest-VolumeQuotasAdminTestJSON-1498104510 None] Created volume successfully. Nov 03 20:22:58 devstack sudo[94652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba Nov 03 20:22:58 devstack sudo[94652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:58 devstack sudo[94652]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a62521b3-b74d-4511-beb1-480b9dfb350f tempest-SnapshotMetadataTestJSON-41514233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba" returned: 0 in 0.631s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a62521b3-b74d-4511-beb1-480b9dfb350f tempest-SnapshotMetadataTestJSON-41514233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba.4c98d547-f923-4649-b418-2eaa79f74347 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:58 devstack sudo[94657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba.4c98d547-f923-4649-b418-2eaa79f74347 1G Nov 03 20:22:58 devstack sudo[94657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:59 devstack sudo[94657]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a62521b3-b74d-4511-beb1-480b9dfb350f tempest-SnapshotMetadataTestJSON-41514233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba.4c98d547-f923-4649-b418-2eaa79f74347 1G" returned: 0 in 0.557s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a62521b3-b74d-4511-beb1-480b9dfb350f tempest-SnapshotMetadataTestJSON-41514233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba.4c98d547-f923-4649-b418-2eaa79f74347 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:59 devstack sudo[94662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba.4c98d547-f923-4649-b418-2eaa79f74347 Nov 03 20:22:59 devstack sudo[94662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:22:59 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:SELECT=149,cinder:UPDATE=180,cinder:DELETE=17,cinder:INSERT=39 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:22:59 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-d8d01947-8820-4bf4-ac44-0cf5b6657210 tempest-VolumeQuotasAdminTestJSON-31835014 None] Transfer volume completed successfully. Nov 03 20:22:59 devstack sudo[94662]: pam_unix(sudo:session): session closed for user root Nov 03 20:22:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a62521b3-b74d-4511-beb1-480b9dfb350f tempest-SnapshotMetadataTestJSON-41514233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba.4c98d547-f923-4649-b418-2eaa79f74347" returned: 0 in 0.487s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:22:59 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-a62521b3-b74d-4511-beb1-480b9dfb350f tempest-SnapshotMetadataTestJSON-41514233 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba.4c98d547-f923-4649-b418-2eaa79f74347 is being set with open permissions: ugo+rw Nov 03 20:22:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a62521b3-b74d-4511-beb1-480b9dfb350f tempest-SnapshotMetadataTestJSON-41514233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba.4c98d547-f923-4649-b418-2eaa79f74347 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:22:59 devstack sudo[94667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba.4c98d547-f923-4649-b418-2eaa79f74347 Nov 03 20:22:59 devstack sudo[94667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:00 devstack sudo[94667]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a62521b3-b74d-4511-beb1-480b9dfb350f tempest-SnapshotMetadataTestJSON-41514233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba.4c98d547-f923-4649-b418-2eaa79f74347" returned: 0 in 0.516s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:00 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:UPDATE=171,cinder:SELECT=134,cinder:INSERT=47,cinder:DELETE=8 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:23:00 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-4fff0a1a-ca9d-4d89-8d94-465c9aaa1d16 tempest-VolumeQuotasAdminTestJSON-819026721 None] Acquiring lock "cinder-6dcd42d5-f52a-46b0-b8b6-8d7d425dc208-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:23:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a62521b3-b74d-4511-beb1-480b9dfb350f tempest-SnapshotMetadataTestJSON-41514233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:00 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-4fff0a1a-ca9d-4d89-8d94-465c9aaa1d16 tempest-VolumeQuotasAdminTestJSON-819026721 None] Lock "cinder-6dcd42d5-f52a-46b0-b8b6-8d7d425dc208-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:23:00 devstack sudo[94704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba.info Nov 03 20:23:00 devstack sudo[94704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:00 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-4fff0a1a-ca9d-4d89-8d94-465c9aaa1d16 tempest-VolumeQuotasAdminTestJSON-819026721 None] Acquiring lock "cinder-quobyte-6dcd42d5-f52a-46b0-b8b6-8d7d425dc208" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:23:00 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-4fff0a1a-ca9d-4d89-8d94-465c9aaa1d16 tempest-VolumeQuotasAdminTestJSON-819026721 None] Lock "cinder-quobyte-6dcd42d5-f52a-46b0-b8b6-8d7d425dc208" acquired by "delete_volume" :: waited 0.024s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:23:00 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3b972c-7f2b-4268-9918-fd247194e841]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:23:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4fff0a1a-ca9d-4d89-8d94-465c9aaa1d16 tempest-VolumeQuotasAdminTestJSON-819026721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dcd42d5-f52a-46b0-b8b6-8d7d425dc208 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:00 devstack sudo[94706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dcd42d5-f52a-46b0-b8b6-8d7d425dc208 Nov 03 20:23:00 devstack sudo[94706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:00 devstack sudo[94704]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a62521b3-b74d-4511-beb1-480b9dfb350f tempest-SnapshotMetadataTestJSON-41514233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba.info" returned: 0 in 0.538s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:00 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-a62521b3-b74d-4511-beb1-480b9dfb350f tempest-SnapshotMetadataTestJSON-41514233 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba.info is being set with open permissions: ugo+rw Nov 03 20:23:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a62521b3-b74d-4511-beb1-480b9dfb350f tempest-SnapshotMetadataTestJSON-41514233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:00 devstack sudo[94709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba.info Nov 03 20:23:00 devstack sudo[94709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:01 devstack sudo[94709]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a62521b3-b74d-4511-beb1-480b9dfb350f tempest-SnapshotMetadataTestJSON-41514233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba.info" returned: 0 in 0.383s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a62521b3-b74d-4511-beb1-480b9dfb350f tempest-SnapshotMetadataTestJSON-41514233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.374s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:23:01 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-a62521b3-b74d-4511-beb1-480b9dfb350f tempest-SnapshotMetadataTestJSON-41514233 None] Create snapshot completed successfully Nov 03 20:23:01 devstack sudo[94706]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4fff0a1a-ca9d-4d89-8d94-465c9aaa1d16 tempest-VolumeQuotasAdminTestJSON-819026721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dcd42d5-f52a-46b0-b8b6-8d7d425dc208" returned: 0 in 0.856s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4fff0a1a-ca9d-4d89-8d94-465c9aaa1d16 tempest-VolumeQuotasAdminTestJSON-819026721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dcd42d5-f52a-46b0-b8b6-8d7d425dc208 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:01 devstack sudo[94720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dcd42d5-f52a-46b0-b8b6-8d7d425dc208 Nov 03 20:23:01 devstack sudo[94720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:01 devstack sudo[94720]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4fff0a1a-ca9d-4d89-8d94-465c9aaa1d16 tempest-VolumeQuotasAdminTestJSON-819026721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dcd42d5-f52a-46b0-b8b6-8d7d425dc208" returned: 0 in 0.481s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:01 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-4fff0a1a-ca9d-4d89-8d94-465c9aaa1d16 tempest-VolumeQuotasAdminTestJSON-819026721 None] Lock "cinder-quobyte-6dcd42d5-f52a-46b0-b8b6-8d7d425dc208" released by "delete_volume" :: held 1.432s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:23:01 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-4fff0a1a-ca9d-4d89-8d94-465c9aaa1d16 tempest-VolumeQuotasAdminTestJSON-819026721 None] Created reservations ['fc1d2171-7cec-485b-ae86-d063a1e9e08c', 'c4b23e79-626a-4a20-b8d0-e8745f88ddca', 'eb6ae901-e4d9-47ed-a6a9-0286911cd4c8', 'e646371d-3fa2-44a5-a298-ee9a7670f2f4'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:23:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4fff0a1a-ca9d-4d89-8d94-465c9aaa1d16 tempest-VolumeQuotasAdminTestJSON-819026721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:23:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4fff0a1a-ca9d-4d89-8d94-465c9aaa1d16 tempest-VolumeQuotasAdminTestJSON-819026721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:23:02 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-4fff0a1a-ca9d-4d89-8d94-465c9aaa1d16 tempest-VolumeQuotasAdminTestJSON-819026721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:23:02 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-4fff0a1a-ca9d-4d89-8d94-465c9aaa1d16 tempest-VolumeQuotasAdminTestJSON-819026721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:23:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4fff0a1a-ca9d-4d89-8d94-465c9aaa1d16 tempest-VolumeQuotasAdminTestJSON-819026721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:23:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4fff0a1a-ca9d-4d89-8d94-465c9aaa1d16 tempest-VolumeQuotasAdminTestJSON-819026721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:02 devstack sudo[94728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:23:02 devstack sudo[94728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:02 devstack sudo[94728]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4fff0a1a-ca9d-4d89-8d94-465c9aaa1d16 tempest-VolumeQuotasAdminTestJSON-819026721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.518s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:02 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-4fff0a1a-ca9d-4d89-8d94-465c9aaa1d16 tempest-VolumeQuotasAdminTestJSON-819026721 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:23:02 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-4fff0a1a-ca9d-4d89-8d94-465c9aaa1d16 tempest-VolumeQuotasAdminTestJSON-819026721 None] Deleted volume successfully. Nov 03 20:23:02 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-4fff0a1a-ca9d-4d89-8d94-465c9aaa1d16 tempest-VolumeQuotasAdminTestJSON-819026721 None] Lock "cinder-6dcd42d5-f52a-46b0-b8b6-8d7d425dc208-delete_volume" released by "delete_volume" :: held 2.338s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:23:03 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-88c5ca47-e5c1-431e-bae4-c17b46ebd23b tempest-SnapshotMetadataTestJSON-41514233 None] Acquiring lock "cinder-4c98d547-f923-4649-b418-2eaa79f74347-delete_snapshot" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:23:03 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-88c5ca47-e5c1-431e-bae4-c17b46ebd23b tempest-SnapshotMetadataTestJSON-41514233 None] Lock "cinder-4c98d547-f923-4649-b418-2eaa79f74347-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:23:03 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-88c5ca47-e5c1-431e-bae4-c17b46ebd23b tempest-SnapshotMetadataTestJSON-41514233 None] Acquiring lock "cinder-quobyte-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:23:03 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-88c5ca47-e5c1-431e-bae4-c17b46ebd23b tempest-SnapshotMetadataTestJSON-41514233 None] Lock "cinder-quobyte-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:23:03 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-88c5ca47-e5c1-431e-bae4-c17b46ebd23b tempest-SnapshotMetadataTestJSON-41514233 None] Acquiring lock "cinder-quobyte-4c98d547-f923-4649-b418-2eaa79f74347" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:23:03 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-88c5ca47-e5c1-431e-bae4-c17b46ebd23b tempest-SnapshotMetadataTestJSON-41514233 None] Lock "cinder-quobyte-4c98d547-f923-4649-b418-2eaa79f74347" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:23:03 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-88c5ca47-e5c1-431e-bae4-c17b46ebd23b tempest-SnapshotMetadataTestJSON-41514233 None] Deleting offline snapshot 4c98d547-f923-4649-b418-2eaa79f74347 of volume 1c7884eb-6d91-4195-8ccc-01ab9e11c0ba {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:23:03 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-88c5ca47-e5c1-431e-bae4-c17b46ebd23b tempest-SnapshotMetadataTestJSON-41514233 None] snapshot_file for this snap is: volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba.4c98d547-f923-4649-b418-2eaa79f74347 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:23:03 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[d518e88a-8b47-4ba4-877c-2a76062a3dca]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:23:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-88c5ca47-e5c1-431e-bae4-c17b46ebd23b tempest-SnapshotMetadataTestJSON-41514233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba.4c98d547-f923-4649-b418-2eaa79f74347 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:03 devstack sudo[94732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba.4c98d547-f923-4649-b418-2eaa79f74347 Nov 03 20:23:03 devstack sudo[94732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:04 devstack sudo[94732]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-88c5ca47-e5c1-431e-bae4-c17b46ebd23b tempest-SnapshotMetadataTestJSON-41514233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba.4c98d547-f923-4649-b418-2eaa79f74347" returned: 0 in 0.443s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:04 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-88c5ca47-e5c1-431e-bae4-c17b46ebd23b tempest-SnapshotMetadataTestJSON-41514233 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:23:04 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c9bf88-feb8-4cf1-8abd-0072be71a591]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:23:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-88c5ca47-e5c1-431e-bae4-c17b46ebd23b tempest-SnapshotMetadataTestJSON-41514233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:04 devstack sudo[94737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba Nov 03 20:23:04 devstack sudo[94737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:04 devstack sudo[94737]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-88c5ca47-e5c1-431e-bae4-c17b46ebd23b tempest-SnapshotMetadataTestJSON-41514233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba" returned: 0 in 0.493s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-88c5ca47-e5c1-431e-bae4-c17b46ebd23b tempest-SnapshotMetadataTestJSON-41514233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba.4c98d547-f923-4649-b418-2eaa79f74347 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:04 devstack sudo[94743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba.4c98d547-f923-4649-b418-2eaa79f74347 Nov 03 20:23:04 devstack sudo[94743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:05 devstack sudo[94743]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-88c5ca47-e5c1-431e-bae4-c17b46ebd23b tempest-SnapshotMetadataTestJSON-41514233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba.4c98d547-f923-4649-b418-2eaa79f74347" returned: 0 in 0.425s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-88c5ca47-e5c1-431e-bae4-c17b46ebd23b tempest-SnapshotMetadataTestJSON-41514233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba.4c98d547-f923-4649-b418-2eaa79f74347 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:05 devstack sudo[94749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba.4c98d547-f923-4649-b418-2eaa79f74347 Nov 03 20:23:05 devstack sudo[94749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:05 devstack sudo[94749]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-88c5ca47-e5c1-431e-bae4-c17b46ebd23b tempest-SnapshotMetadataTestJSON-41514233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba.4c98d547-f923-4649-b418-2eaa79f74347" returned: 0 in 0.391s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:05 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-88c5ca47-e5c1-431e-bae4-c17b46ebd23b tempest-SnapshotMetadataTestJSON-41514233 None] Lock "cinder-quobyte-4c98d547-f923-4649-b418-2eaa79f74347" released by "_delete_snapshot" :: held 1.918s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:23:05 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-88c5ca47-e5c1-431e-bae4-c17b46ebd23b tempest-SnapshotMetadataTestJSON-41514233 None] Lock "cinder-quobyte-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba" released by "delete_snapshot" :: held 1.966s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:23:05 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-88c5ca47-e5c1-431e-bae4-c17b46ebd23b tempest-SnapshotMetadataTestJSON-41514233 None] Created reservations ['4afb35af-1489-4e65-bd01-4d9ac6a5cce0', 'a25e6532-c4d9-48c5-b136-2a48b04fdeea', '29db8a09-24df-4aa0-a590-a75a803d7a40', 'b21080de-8514-43e9-95a1-981c4f4bd877'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:23:05 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-88c5ca47-e5c1-431e-bae4-c17b46ebd23b tempest-SnapshotMetadataTestJSON-41514233 None] Delete snapshot completed successfully. Nov 03 20:23:05 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-88c5ca47-e5c1-431e-bae4-c17b46ebd23b tempest-SnapshotMetadataTestJSON-41514233 None] Lock "cinder-4c98d547-f923-4649-b418-2eaa79f74347-delete_snapshot" released by "delete_snapshot" :: held 2.158s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:23:05 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-37d0f3eb-7bde-465e-a81f-56caa346c34a tempest-SnapshotMetadataTestJSON-41514233 None] Acquiring lock "cinder-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:23:05 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-37d0f3eb-7bde-465e-a81f-56caa346c34a tempest-SnapshotMetadataTestJSON-41514233 None] Lock "cinder-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:23:06 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-37d0f3eb-7bde-465e-a81f-56caa346c34a tempest-SnapshotMetadataTestJSON-41514233 None] Acquiring lock "cinder-quobyte-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:23:06 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-37d0f3eb-7bde-465e-a81f-56caa346c34a tempest-SnapshotMetadataTestJSON-41514233 None] Lock "cinder-quobyte-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba" acquired by "delete_volume" :: waited 0.031s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:23:06 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee577ff3-0c4e-4994-b708-9bae88d49e22]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:23:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-37d0f3eb-7bde-465e-a81f-56caa346c34a tempest-SnapshotMetadataTestJSON-41514233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:06 devstack sudo[94752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba Nov 03 20:23:06 devstack sudo[94752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:06 devstack sudo[94752]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-37d0f3eb-7bde-465e-a81f-56caa346c34a tempest-SnapshotMetadataTestJSON-41514233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba" returned: 0 in 0.544s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-37d0f3eb-7bde-465e-a81f-56caa346c34a tempest-SnapshotMetadataTestJSON-41514233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:06 devstack sudo[94757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba Nov 03 20:23:06 devstack sudo[94757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:07 devstack sudo[94757]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-37d0f3eb-7bde-465e-a81f-56caa346c34a tempest-SnapshotMetadataTestJSON-41514233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba" returned: 0 in 0.414s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:07 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-37d0f3eb-7bde-465e-a81f-56caa346c34a tempest-SnapshotMetadataTestJSON-41514233 None] Lock "cinder-quobyte-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba" released by "delete_volume" :: held 1.060s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:23:07 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-37d0f3eb-7bde-465e-a81f-56caa346c34a tempest-SnapshotMetadataTestJSON-41514233 None] Created reservations ['6cc6e6a4-fff3-43e5-bb4c-08233e532ce7', '637a0fe4-f9ac-496d-950b-41f1067b11be', '07257353-ba9b-471c-af3d-5c40250d4c78', '3add0c4c-741f-422e-9128-42cc025e9200'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:23:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-37d0f3eb-7bde-465e-a81f-56caa346c34a tempest-SnapshotMetadataTestJSON-41514233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:23:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-37d0f3eb-7bde-465e-a81f-56caa346c34a tempest-SnapshotMetadataTestJSON-41514233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:23:07 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-37d0f3eb-7bde-465e-a81f-56caa346c34a tempest-SnapshotMetadataTestJSON-41514233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:23:07 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-37d0f3eb-7bde-465e-a81f-56caa346c34a tempest-SnapshotMetadataTestJSON-41514233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:23:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-37d0f3eb-7bde-465e-a81f-56caa346c34a tempest-SnapshotMetadataTestJSON-41514233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:23:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-37d0f3eb-7bde-465e-a81f-56caa346c34a tempest-SnapshotMetadataTestJSON-41514233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:07 devstack sudo[94760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:23:07 devstack sudo[94760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:07 devstack sudo[94760]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-37d0f3eb-7bde-465e-a81f-56caa346c34a tempest-SnapshotMetadataTestJSON-41514233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.329s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:07 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-37d0f3eb-7bde-465e-a81f-56caa346c34a tempest-SnapshotMetadataTestJSON-41514233 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:23:07 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-37d0f3eb-7bde-465e-a81f-56caa346c34a tempest-SnapshotMetadataTestJSON-41514233 None] Deleted volume successfully. Nov 03 20:23:07 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-37d0f3eb-7bde-465e-a81f-56caa346c34a tempest-SnapshotMetadataTestJSON-41514233 None] Lock "cinder-1c7884eb-6d91-4195-8ccc-01ab9e11c0ba-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:23:13 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bd0eb17-292d-4ef5-95d3-b0bec6c0ddbe tempest-VolumesServicesTestJSON-972063505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:23:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-3bd0eb17-292d-4ef5-95d3-b0bec6c0ddbe tempest-VolumesServicesTestJSON-972063505 None] Flow 'volume_create_manager' (fd636130-c634-44a1-a886-4d8549e78ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:23:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-3bd0eb17-292d-4ef5-95d3-b0bec6c0ddbe tempest-VolumesServicesTestJSON-972063505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (731d78b3-9ba5-441f-820e-bd2c9a4659c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-3bd0eb17-292d-4ef5-95d3-b0bec6c0ddbe tempest-VolumesServicesTestJSON-972063505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (731d78b3-9ba5-441f-820e-bd2c9a4659c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-288184950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3f86fea-739f-468c-a86c-ed62b1bbff53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='007a8026c46f4361aedfe8af7b20e7a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:23:14Z,use_quota=True,user_id='b9376779169b493a826b54109f09e943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-3bd0eb17-292d-4ef5-95d3-b0bec6c0ddbe tempest-VolumesServicesTestJSON-972063505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31645da8-8e57-45f5-88a9-83f91adef270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-3bd0eb17-292d-4ef5-95d3-b0bec6c0ddbe tempest-VolumesServicesTestJSON-972063505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31645da8-8e57-45f5-88a9-83f91adef270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-3bd0eb17-292d-4ef5-95d3-b0bec6c0ddbe tempest-VolumesServicesTestJSON-972063505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f78237f-cb87-4859-b044-5b0ef2e724ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-3bd0eb17-292d-4ef5-95d3-b0bec6c0ddbe tempest-VolumesServicesTestJSON-972063505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f78237f-cb87-4859-b044-5b0ef2e724ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3f86fea-739f-468c-a86c-ed62b1bbff53', 'volume_name': 'volume-d3f86fea-739f-468c-a86c-ed62b1bbff53', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-3bd0eb17-292d-4ef5-95d3-b0bec6c0ddbe tempest-VolumesServicesTestJSON-972063505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (760b20b6-1857-441a-b097-fa84ee5e133d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-3bd0eb17-292d-4ef5-95d3-b0bec6c0ddbe tempest-VolumesServicesTestJSON-972063505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (760b20b6-1857-441a-b097-fa84ee5e133d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-3bd0eb17-292d-4ef5-95d3-b0bec6c0ddbe tempest-VolumesServicesTestJSON-972063505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da45c2c7-32fd-489c-81f9-0af609d2cb76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:13 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-3bd0eb17-292d-4ef5-95d3-b0bec6c0ddbe tempest-VolumesServicesTestJSON-972063505 None] Volume d3f86fea-739f-468c-a86c-ed62b1bbff53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3f86fea-739f-468c-a86c-ed62b1bbff53', 'volume_size': 1} Nov 03 20:23:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-3bd0eb17-292d-4ef5-95d3-b0bec6c0ddbe tempest-VolumesServicesTestJSON-972063505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:23:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-3bd0eb17-292d-4ef5-95d3-b0bec6c0ddbe tempest-VolumesServicesTestJSON-972063505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:23:13 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-3bd0eb17-292d-4ef5-95d3-b0bec6c0ddbe tempest-VolumesServicesTestJSON-972063505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-288184950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3f86fea-739f-468c-a86c-ed62b1bbff53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='007a8026c46f4361aedfe8af7b20e7a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:23:14Z,use_quota=True,user_id='b9376779169b493a826b54109f09e943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:23:13 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-3bd0eb17-292d-4ef5-95d3-b0bec6c0ddbe tempest-VolumesServicesTestJSON-972063505 None] Creating volume d3f86fea-739f-468c-a86c-ed62b1bbff53 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:23:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-3bd0eb17-292d-4ef5-95d3-b0bec6c0ddbe tempest-VolumesServicesTestJSON-972063505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:23:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-3bd0eb17-292d-4ef5-95d3-b0bec6c0ddbe tempest-VolumesServicesTestJSON-972063505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:23:13 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-3bd0eb17-292d-4ef5-95d3-b0bec6c0ddbe tempest-VolumesServicesTestJSON-972063505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:23:13 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-3bd0eb17-292d-4ef5-95d3-b0bec6c0ddbe tempest-VolumesServicesTestJSON-972063505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:23:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-3bd0eb17-292d-4ef5-95d3-b0bec6c0ddbe tempest-VolumesServicesTestJSON-972063505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:23:13 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-3bd0eb17-292d-4ef5-95d3-b0bec6c0ddbe tempest-VolumesServicesTestJSON-972063505 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:23:13 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-3bd0eb17-292d-4ef5-95d3-b0bec6c0ddbe tempest-VolumesServicesTestJSON-972063505 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:23:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3bd0eb17-292d-4ef5-95d3-b0bec6c0ddbe tempest-VolumesServicesTestJSON-972063505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d3f86fea-739f-468c-a86c-ed62b1bbff53 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:13 devstack sudo[94782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d3f86fea-739f-468c-a86c-ed62b1bbff53 1073741824 Nov 03 20:23:13 devstack sudo[94782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:14 devstack sudo[94782]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3bd0eb17-292d-4ef5-95d3-b0bec6c0ddbe tempest-VolumesServicesTestJSON-972063505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d3f86fea-739f-468c-a86c-ed62b1bbff53 1073741824" returned: 0 in 0.581s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3bd0eb17-292d-4ef5-95d3-b0bec6c0ddbe tempest-VolumesServicesTestJSON-972063505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d3f86fea-739f-468c-a86c-ed62b1bbff53 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:14 devstack sudo[94788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d3f86fea-739f-468c-a86c-ed62b1bbff53 Nov 03 20:23:14 devstack sudo[94788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:14 devstack sudo[94788]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3bd0eb17-292d-4ef5-95d3-b0bec6c0ddbe tempest-VolumesServicesTestJSON-972063505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d3f86fea-739f-468c-a86c-ed62b1bbff53" returned: 0 in 0.296s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:14 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-3bd0eb17-292d-4ef5-95d3-b0bec6c0ddbe tempest-VolumesServicesTestJSON-972063505 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:23:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-3bd0eb17-292d-4ef5-95d3-b0bec6c0ddbe tempest-VolumesServicesTestJSON-972063505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:23:14 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-3bd0eb17-292d-4ef5-95d3-b0bec6c0ddbe tempest-VolumesServicesTestJSON-972063505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da45c2c7-32fd-489c-81f9-0af609d2cb76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3f86fea-739f-468c-a86c-ed62b1bbff53', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:14 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-3bd0eb17-292d-4ef5-95d3-b0bec6c0ddbe tempest-VolumesServicesTestJSON-972063505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d93a3c6-c241-4920-be4e-8b1786897507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:14 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-3bd0eb17-292d-4ef5-95d3-b0bec6c0ddbe tempest-VolumesServicesTestJSON-972063505 None] Volume volume-d3f86fea-739f-468c-a86c-ed62b1bbff53 (d3f86fea-739f-468c-a86c-ed62b1bbff53): created successfully Nov 03 20:23:14 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-3bd0eb17-292d-4ef5-95d3-b0bec6c0ddbe tempest-VolumesServicesTestJSON-972063505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d93a3c6-c241-4920-be4e-8b1786897507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:14 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-3bd0eb17-292d-4ef5-95d3-b0bec6c0ddbe tempest-VolumesServicesTestJSON-972063505 None] Flow 'volume_create_manager' (fd636130-c634-44a1-a886-4d8549e78ae1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:23:14 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-3bd0eb17-292d-4ef5-95d3-b0bec6c0ddbe tempest-VolumesServicesTestJSON-972063505 None] Created volume successfully. Nov 03 20:23:16 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fcf3c942-cb9c-4c08-8ce5-0c0338f61c7a tempest-VolumesServicesTestJSON-972063505 None] Acquiring lock "cinder-d3f86fea-739f-468c-a86c-ed62b1bbff53-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:23:16 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fcf3c942-cb9c-4c08-8ce5-0c0338f61c7a tempest-VolumesServicesTestJSON-972063505 None] Lock "cinder-d3f86fea-739f-468c-a86c-ed62b1bbff53-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:23:16 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fcf3c942-cb9c-4c08-8ce5-0c0338f61c7a tempest-VolumesServicesTestJSON-972063505 None] Acquiring lock "cinder-quobyte-d3f86fea-739f-468c-a86c-ed62b1bbff53" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:23:16 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fcf3c942-cb9c-4c08-8ce5-0c0338f61c7a tempest-VolumesServicesTestJSON-972063505 None] Lock "cinder-quobyte-d3f86fea-739f-468c-a86c-ed62b1bbff53" acquired by "delete_volume" :: waited 0.029s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:23:16 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed5f816-7807-4c26-ac30-c445983b84ad]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:23:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fcf3c942-cb9c-4c08-8ce5-0c0338f61c7a tempest-VolumesServicesTestJSON-972063505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d3f86fea-739f-468c-a86c-ed62b1bbff53 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:16 devstack sudo[94793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d3f86fea-739f-468c-a86c-ed62b1bbff53 Nov 03 20:23:16 devstack sudo[94793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:16 devstack sudo[94793]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fcf3c942-cb9c-4c08-8ce5-0c0338f61c7a tempest-VolumesServicesTestJSON-972063505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d3f86fea-739f-468c-a86c-ed62b1bbff53" returned: 0 in 0.392s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fcf3c942-cb9c-4c08-8ce5-0c0338f61c7a tempest-VolumesServicesTestJSON-972063505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d3f86fea-739f-468c-a86c-ed62b1bbff53 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:16 devstack sudo[94798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d3f86fea-739f-468c-a86c-ed62b1bbff53 Nov 03 20:23:16 devstack sudo[94798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:16 devstack sudo[94798]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fcf3c942-cb9c-4c08-8ce5-0c0338f61c7a tempest-VolumesServicesTestJSON-972063505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d3f86fea-739f-468c-a86c-ed62b1bbff53" returned: 0 in 0.267s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:16 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fcf3c942-cb9c-4c08-8ce5-0c0338f61c7a tempest-VolumesServicesTestJSON-972063505 None] Lock "cinder-quobyte-d3f86fea-739f-468c-a86c-ed62b1bbff53" released by "delete_volume" :: held 0.734s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:23:16 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-fcf3c942-cb9c-4c08-8ce5-0c0338f61c7a tempest-VolumesServicesTestJSON-972063505 None] Created reservations ['fa6d6a49-f3b8-4c83-9c90-90b87ec5b5e7', '987eca3c-012a-41ba-b3f8-6aa60ba9acf3', '6d8d82a7-f1cb-41e9-9161-9fc774c31bab', '2947ce6e-7dc8-4c7e-8509-9a6d6ba8d0d7'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:23:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-fcf3c942-cb9c-4c08-8ce5-0c0338f61c7a tempest-VolumesServicesTestJSON-972063505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:23:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-fcf3c942-cb9c-4c08-8ce5-0c0338f61c7a tempest-VolumesServicesTestJSON-972063505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:23:17 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-fcf3c942-cb9c-4c08-8ce5-0c0338f61c7a tempest-VolumesServicesTestJSON-972063505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:23:17 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-fcf3c942-cb9c-4c08-8ce5-0c0338f61c7a tempest-VolumesServicesTestJSON-972063505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:23:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-fcf3c942-cb9c-4c08-8ce5-0c0338f61c7a tempest-VolumesServicesTestJSON-972063505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:23:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fcf3c942-cb9c-4c08-8ce5-0c0338f61c7a tempest-VolumesServicesTestJSON-972063505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:17 devstack sudo[94801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:23:17 devstack sudo[94801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:17 devstack sudo[94801]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fcf3c942-cb9c-4c08-8ce5-0c0338f61c7a tempest-VolumesServicesTestJSON-972063505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.299s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:17 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-fcf3c942-cb9c-4c08-8ce5-0c0338f61c7a tempest-VolumesServicesTestJSON-972063505 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:23:17 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-fcf3c942-cb9c-4c08-8ce5-0c0338f61c7a tempest-VolumesServicesTestJSON-972063505 None] Deleted volume successfully. Nov 03 20:23:17 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fcf3c942-cb9c-4c08-8ce5-0c0338f61c7a tempest-VolumesServicesTestJSON-972063505 None] Lock "cinder-d3f86fea-739f-468c-a86c-ed62b1bbff53-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:23:17 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-4768f4e2-04ca-464d-8c20-21363265c3ed tempest-VolumesDeleteCascade-1846270469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:23:17 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4768f4e2-04ca-464d-8c20-21363265c3ed tempest-VolumesDeleteCascade-1846270469 None] Flow 'volume_create_manager' (f5c2ae7e-8d27-4c02-a683-7d61b3e179cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:23:17 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4768f4e2-04ca-464d-8c20-21363265c3ed tempest-VolumesDeleteCascade-1846270469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9329ebc-a329-4103-833b-0c59ffe8b1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:17 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4768f4e2-04ca-464d-8c20-21363265c3ed tempest-VolumesDeleteCascade-1846270469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9329ebc-a329-4103-833b-0c59ffe8b1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1062837414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9f7254f-e25a-442c-a3f8-d065de1fd454,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c70d20370854f8d96076bad361bdb3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:23:18Z,use_quota=True,user_id='e21473b2165f4b2fada873aca7739004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:17 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4768f4e2-04ca-464d-8c20-21363265c3ed tempest-VolumesDeleteCascade-1846270469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c2e8d81-67b8-40b3-80ce-154059ae90d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:17 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4768f4e2-04ca-464d-8c20-21363265c3ed tempest-VolumesDeleteCascade-1846270469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c2e8d81-67b8-40b3-80ce-154059ae90d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:17 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4768f4e2-04ca-464d-8c20-21363265c3ed tempest-VolumesDeleteCascade-1846270469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11454106-5855-43f5-a63c-aeff4e2bd943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:17 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4768f4e2-04ca-464d-8c20-21363265c3ed tempest-VolumesDeleteCascade-1846270469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11454106-5855-43f5-a63c-aeff4e2bd943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9f7254f-e25a-442c-a3f8-d065de1fd454', 'volume_name': 'volume-d9f7254f-e25a-442c-a3f8-d065de1fd454', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:17 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4768f4e2-04ca-464d-8c20-21363265c3ed tempest-VolumesDeleteCascade-1846270469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8225beb1-9a0a-4c0f-85d0-1eb159c11885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:17 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4768f4e2-04ca-464d-8c20-21363265c3ed tempest-VolumesDeleteCascade-1846270469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8225beb1-9a0a-4c0f-85d0-1eb159c11885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:17 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4768f4e2-04ca-464d-8c20-21363265c3ed tempest-VolumesDeleteCascade-1846270469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8ca281e-688b-4867-99c4-29d29a9602f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:17 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-4768f4e2-04ca-464d-8c20-21363265c3ed tempest-VolumesDeleteCascade-1846270469 None] Volume d9f7254f-e25a-442c-a3f8-d065de1fd454: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9f7254f-e25a-442c-a3f8-d065de1fd454', 'volume_size': 1} Nov 03 20:23:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4768f4e2-04ca-464d-8c20-21363265c3ed tempest-VolumesDeleteCascade-1846270469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:23:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4768f4e2-04ca-464d-8c20-21363265c3ed tempest-VolumesDeleteCascade-1846270469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:23:17 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-4768f4e2-04ca-464d-8c20-21363265c3ed tempest-VolumesDeleteCascade-1846270469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1062837414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9f7254f-e25a-442c-a3f8-d065de1fd454,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c70d20370854f8d96076bad361bdb3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:23:18Z,use_quota=True,user_id='e21473b2165f4b2fada873aca7739004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:23:17 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-4768f4e2-04ca-464d-8c20-21363265c3ed tempest-VolumesDeleteCascade-1846270469 None] Creating volume d9f7254f-e25a-442c-a3f8-d065de1fd454 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:23:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4768f4e2-04ca-464d-8c20-21363265c3ed tempest-VolumesDeleteCascade-1846270469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:23:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4768f4e2-04ca-464d-8c20-21363265c3ed tempest-VolumesDeleteCascade-1846270469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:23:17 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-4768f4e2-04ca-464d-8c20-21363265c3ed tempest-VolumesDeleteCascade-1846270469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:23:17 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-4768f4e2-04ca-464d-8c20-21363265c3ed tempest-VolumesDeleteCascade-1846270469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:23:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4768f4e2-04ca-464d-8c20-21363265c3ed tempest-VolumesDeleteCascade-1846270469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:23:17 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-4768f4e2-04ca-464d-8c20-21363265c3ed tempest-VolumesDeleteCascade-1846270469 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:23:17 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-4768f4e2-04ca-464d-8c20-21363265c3ed tempest-VolumesDeleteCascade-1846270469 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:23:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4768f4e2-04ca-464d-8c20-21363265c3ed tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:17 devstack sudo[94804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454 1073741824 Nov 03 20:23:17 devstack sudo[94804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:18 devstack sudo[94804]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4768f4e2-04ca-464d-8c20-21363265c3ed tempest-VolumesDeleteCascade-1846270469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454 1073741824" returned: 0 in 0.712s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4768f4e2-04ca-464d-8c20-21363265c3ed tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:18 devstack sudo[94815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454 Nov 03 20:23:18 devstack sudo[94815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:18 devstack sudo[94815]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4768f4e2-04ca-464d-8c20-21363265c3ed tempest-VolumesDeleteCascade-1846270469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454" returned: 0 in 0.464s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:18 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-4768f4e2-04ca-464d-8c20-21363265c3ed tempest-VolumesDeleteCascade-1846270469 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:23:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4768f4e2-04ca-464d-8c20-21363265c3ed tempest-VolumesDeleteCascade-1846270469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:23:18 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4768f4e2-04ca-464d-8c20-21363265c3ed tempest-VolumesDeleteCascade-1846270469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8ca281e-688b-4867-99c4-29d29a9602f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9f7254f-e25a-442c-a3f8-d065de1fd454', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:18 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4768f4e2-04ca-464d-8c20-21363265c3ed tempest-VolumesDeleteCascade-1846270469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2ddc33b-45e8-427a-af48-e1835c671f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:19 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-4768f4e2-04ca-464d-8c20-21363265c3ed tempest-VolumesDeleteCascade-1846270469 None] Volume volume-d9f7254f-e25a-442c-a3f8-d065de1fd454 (d9f7254f-e25a-442c-a3f8-d065de1fd454): created successfully Nov 03 20:23:19 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4768f4e2-04ca-464d-8c20-21363265c3ed tempest-VolumesDeleteCascade-1846270469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2ddc33b-45e8-427a-af48-e1835c671f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:19 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4768f4e2-04ca-464d-8c20-21363265c3ed tempest-VolumesDeleteCascade-1846270469 None] Flow 'volume_create_manager' (f5c2ae7e-8d27-4c02-a683-7d61b3e179cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:23:19 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-4768f4e2-04ca-464d-8c20-21363265c3ed tempest-VolumesDeleteCascade-1846270469 None] Created volume successfully. Nov 03 20:23:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4d4ccd5b-af04-456d-b92d-e4328ccb1c4d tempest-VolumesDeleteCascade-1846270469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:23:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4d4ccd5b-af04-456d-b92d-e4328ccb1c4d tempest-VolumesDeleteCascade-1846270469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:23:20 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-4d4ccd5b-af04-456d-b92d-e4328ccb1c4d tempest-VolumesDeleteCascade-1846270469 None] Creating offline snapshot 9592b556-be81-4fb8-9c3c-e891a7140c6f of volume d9f7254f-e25a-442c-a3f8-d065de1fd454 {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:23:20 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[90bca0fa-147c-42c0-adab-b694f0fabc15]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:23:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4d4ccd5b-af04-456d-b92d-e4328ccb1c4d tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:20 devstack sudo[94822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454 Nov 03 20:23:20 devstack sudo[94822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:20 devstack sudo[94822]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4d4ccd5b-af04-456d-b92d-e4328ccb1c4d tempest-VolumesDeleteCascade-1846270469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454" returned: 0 in 0.472s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4d4ccd5b-af04-456d-b92d-e4328ccb1c4d tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.9592b556-be81-4fb8-9c3c-e891a7140c6f 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:20 devstack sudo[94827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.9592b556-be81-4fb8-9c3c-e891a7140c6f 1G Nov 03 20:23:20 devstack sudo[94827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:21 devstack sudo[94827]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4d4ccd5b-af04-456d-b92d-e4328ccb1c4d tempest-VolumesDeleteCascade-1846270469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.9592b556-be81-4fb8-9c3c-e891a7140c6f 1G" returned: 0 in 0.477s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4d4ccd5b-af04-456d-b92d-e4328ccb1c4d tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9f7254f-e25a-442c-a3f8-d065de1fd454 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.9592b556-be81-4fb8-9c3c-e891a7140c6f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:21 devstack sudo[94833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9f7254f-e25a-442c-a3f8-d065de1fd454 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.9592b556-be81-4fb8-9c3c-e891a7140c6f Nov 03 20:23:21 devstack sudo[94833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:21 devstack sudo[94833]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4d4ccd5b-af04-456d-b92d-e4328ccb1c4d tempest-VolumesDeleteCascade-1846270469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9f7254f-e25a-442c-a3f8-d065de1fd454 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.9592b556-be81-4fb8-9c3c-e891a7140c6f" returned: 0 in 0.350s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:21 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-4d4ccd5b-af04-456d-b92d-e4328ccb1c4d tempest-VolumesDeleteCascade-1846270469 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.9592b556-be81-4fb8-9c3c-e891a7140c6f is being set with open permissions: ugo+rw Nov 03 20:23:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4d4ccd5b-af04-456d-b92d-e4328ccb1c4d tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.9592b556-be81-4fb8-9c3c-e891a7140c6f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:21 devstack sudo[94838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.9592b556-be81-4fb8-9c3c-e891a7140c6f Nov 03 20:23:21 devstack sudo[94838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:21 devstack sudo[94838]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4d4ccd5b-af04-456d-b92d-e4328ccb1c4d tempest-VolumesDeleteCascade-1846270469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.9592b556-be81-4fb8-9c3c-e891a7140c6f" returned: 0 in 0.298s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4d4ccd5b-af04-456d-b92d-e4328ccb1c4d tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:21 devstack sudo[94846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.info Nov 03 20:23:21 devstack sudo[94846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:22 devstack sudo[94846]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4d4ccd5b-af04-456d-b92d-e4328ccb1c4d tempest-VolumesDeleteCascade-1846270469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.info" returned: 0 in 0.344s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:22 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-4d4ccd5b-af04-456d-b92d-e4328ccb1c4d tempest-VolumesDeleteCascade-1846270469 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.info is being set with open permissions: ugo+rw Nov 03 20:23:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4d4ccd5b-af04-456d-b92d-e4328ccb1c4d tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:22 devstack sudo[94851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.info Nov 03 20:23:22 devstack sudo[94851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:22 devstack sudo[94851]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4d4ccd5b-af04-456d-b92d-e4328ccb1c4d tempest-VolumesDeleteCascade-1846270469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.info" returned: 0 in 0.436s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4d4ccd5b-af04-456d-b92d-e4328ccb1c4d tempest-VolumesDeleteCascade-1846270469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.513s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:23:22 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-4d4ccd5b-af04-456d-b92d-e4328ccb1c4d tempest-VolumesDeleteCascade-1846270469 None] Create snapshot completed successfully Nov 03 20:23:22 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9718850-b4e4-4171-a779-6e18c5d5008a tempest-AttachVolumeTestJSON-1951495544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:23:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e9718850-b4e4-4171-a779-6e18c5d5008a tempest-AttachVolumeTestJSON-1951495544 None] Flow 'volume_create_manager' (644e1527-c23a-455a-94f8-b15dc872c4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:23:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e9718850-b4e4-4171-a779-6e18c5d5008a tempest-AttachVolumeTestJSON-1951495544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bace5bf2-436d-495b-98a7-1da8d92da2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e9718850-b4e4-4171-a779-6e18c5d5008a tempest-AttachVolumeTestJSON-1951495544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bace5bf2-436d-495b-98a7-1da8d92da2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-61246689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e48f714-0749-4cfc-9c06-c173ab5a97e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='079eb8d6ee6d4ce2afd949bf58276a24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:23:23Z,use_quota=True,user_id='47bae0c200dd4f588e92d432b5755d05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e9718850-b4e4-4171-a779-6e18c5d5008a tempest-AttachVolumeTestJSON-1951495544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dde84231-b43c-4908-9e3c-eb358bc5194f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e9718850-b4e4-4171-a779-6e18c5d5008a tempest-AttachVolumeTestJSON-1951495544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dde84231-b43c-4908-9e3c-eb358bc5194f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e9718850-b4e4-4171-a779-6e18c5d5008a tempest-AttachVolumeTestJSON-1951495544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb6feeaf-dc5e-4a21-aea2-6b6858136f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e9718850-b4e4-4171-a779-6e18c5d5008a tempest-AttachVolumeTestJSON-1951495544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb6feeaf-dc5e-4a21-aea2-6b6858136f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e48f714-0749-4cfc-9c06-c173ab5a97e3', 'volume_name': 'volume-2e48f714-0749-4cfc-9c06-c173ab5a97e3', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e9718850-b4e4-4171-a779-6e18c5d5008a tempest-AttachVolumeTestJSON-1951495544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3865cb5e-a39e-4976-829f-58f2427aaece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e9718850-b4e4-4171-a779-6e18c5d5008a tempest-AttachVolumeTestJSON-1951495544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3865cb5e-a39e-4976-829f-58f2427aaece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e9718850-b4e4-4171-a779-6e18c5d5008a tempest-AttachVolumeTestJSON-1951495544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66900d0a-1181-448f-9e90-8227fb476c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:22 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-e9718850-b4e4-4171-a779-6e18c5d5008a tempest-AttachVolumeTestJSON-1951495544 None] Volume 2e48f714-0749-4cfc-9c06-c173ab5a97e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e48f714-0749-4cfc-9c06-c173ab5a97e3', 'volume_size': 1} Nov 03 20:23:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e9718850-b4e4-4171-a779-6e18c5d5008a tempest-AttachVolumeTestJSON-1951495544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:23:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e9718850-b4e4-4171-a779-6e18c5d5008a tempest-AttachVolumeTestJSON-1951495544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:23:22 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e9718850-b4e4-4171-a779-6e18c5d5008a tempest-AttachVolumeTestJSON-1951495544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-61246689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e48f714-0749-4cfc-9c06-c173ab5a97e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='079eb8d6ee6d4ce2afd949bf58276a24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:23:23Z,use_quota=True,user_id='47bae0c200dd4f588e92d432b5755d05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:23:22 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-e9718850-b4e4-4171-a779-6e18c5d5008a tempest-AttachVolumeTestJSON-1951495544 None] Creating volume 2e48f714-0749-4cfc-9c06-c173ab5a97e3 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:23:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e9718850-b4e4-4171-a779-6e18c5d5008a tempest-AttachVolumeTestJSON-1951495544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:23:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e9718850-b4e4-4171-a779-6e18c5d5008a tempest-AttachVolumeTestJSON-1951495544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:23:22 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e9718850-b4e4-4171-a779-6e18c5d5008a tempest-AttachVolumeTestJSON-1951495544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:23:22 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e9718850-b4e4-4171-a779-6e18c5d5008a tempest-AttachVolumeTestJSON-1951495544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:23:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e9718850-b4e4-4171-a779-6e18c5d5008a tempest-AttachVolumeTestJSON-1951495544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:23:22 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e9718850-b4e4-4171-a779-6e18c5d5008a tempest-AttachVolumeTestJSON-1951495544 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:23:22 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-e9718850-b4e4-4171-a779-6e18c5d5008a tempest-AttachVolumeTestJSON-1951495544 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:23:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e9718850-b4e4-4171-a779-6e18c5d5008a tempest-AttachVolumeTestJSON-1951495544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2e48f714-0749-4cfc-9c06-c173ab5a97e3 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:22 devstack sudo[94854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2e48f714-0749-4cfc-9c06-c173ab5a97e3 1073741824 Nov 03 20:23:22 devstack sudo[94854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:23 devstack sudo[94854]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e9718850-b4e4-4171-a779-6e18c5d5008a tempest-AttachVolumeTestJSON-1951495544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2e48f714-0749-4cfc-9c06-c173ab5a97e3 1073741824" returned: 0 in 0.504s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e9718850-b4e4-4171-a779-6e18c5d5008a tempest-AttachVolumeTestJSON-1951495544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2e48f714-0749-4cfc-9c06-c173ab5a97e3 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:23 devstack sudo[94860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2e48f714-0749-4cfc-9c06-c173ab5a97e3 Nov 03 20:23:23 devstack sudo[94860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-127c0ca8-999c-4d91-94ad-1a7d60202ce0 tempest-VolumesDeleteCascade-1846270469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:23:23 devstack sudo[94860]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e9718850-b4e4-4171-a779-6e18c5d5008a tempest-AttachVolumeTestJSON-1951495544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2e48f714-0749-4cfc-9c06-c173ab5a97e3" returned: 0 in 0.341s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:23 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e9718850-b4e4-4171-a779-6e18c5d5008a tempest-AttachVolumeTestJSON-1951495544 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:23:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e9718850-b4e4-4171-a779-6e18c5d5008a tempest-AttachVolumeTestJSON-1951495544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:23:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-127c0ca8-999c-4d91-94ad-1a7d60202ce0 tempest-VolumesDeleteCascade-1846270469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.152s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:23:23 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-127c0ca8-999c-4d91-94ad-1a7d60202ce0 tempest-VolumesDeleteCascade-1846270469 None] Creating offline snapshot efa6484f-e78c-4292-ae57-f04a14454f94 of volume d9f7254f-e25a-442c-a3f8-d065de1fd454 {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:23:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e9718850-b4e4-4171-a779-6e18c5d5008a tempest-AttachVolumeTestJSON-1951495544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66900d0a-1181-448f-9e90-8227fb476c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e48f714-0749-4cfc-9c06-c173ab5a97e3', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e9718850-b4e4-4171-a779-6e18c5d5008a tempest-AttachVolumeTestJSON-1951495544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da87efb1-8ac2-4439-80a8-039c7e5f04f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:23 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee0a66d-fe9c-4762-a530-5c8347bc057b]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:23:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-127c0ca8-999c-4d91-94ad-1a7d60202ce0 tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.9592b556-be81-4fb8-9c3c-e891a7140c6f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:23 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-e9718850-b4e4-4171-a779-6e18c5d5008a tempest-AttachVolumeTestJSON-1951495544 None] Volume volume-2e48f714-0749-4cfc-9c06-c173ab5a97e3 (2e48f714-0749-4cfc-9c06-c173ab5a97e3): created successfully Nov 03 20:23:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e9718850-b4e4-4171-a779-6e18c5d5008a tempest-AttachVolumeTestJSON-1951495544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da87efb1-8ac2-4439-80a8-039c7e5f04f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e9718850-b4e4-4171-a779-6e18c5d5008a tempest-AttachVolumeTestJSON-1951495544 None] Flow 'volume_create_manager' (644e1527-c23a-455a-94f8-b15dc872c4d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:23:23 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-e9718850-b4e4-4171-a779-6e18c5d5008a tempest-AttachVolumeTestJSON-1951495544 None] Created volume successfully. Nov 03 20:23:24 devstack sudo[94863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.9592b556-be81-4fb8-9c3c-e891a7140c6f Nov 03 20:23:24 devstack sudo[94863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:24 devstack sudo[94863]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-127c0ca8-999c-4d91-94ad-1a7d60202ce0 tempest-VolumesDeleteCascade-1846270469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.9592b556-be81-4fb8-9c3c-e891a7140c6f" returned: 0 in 0.551s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:24 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-127c0ca8-999c-4d91-94ad-1a7d60202ce0 tempest-VolumesDeleteCascade-1846270469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9f7254f-e25a-442c-a3f8-d065de1fd454(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:23:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-127c0ca8-999c-4d91-94ad-1a7d60202ce0 tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.9592b556-be81-4fb8-9c3c-e891a7140c6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.efa6484f-e78c-4292-ae57-f04a14454f94 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:24 devstack sudo[94868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.9592b556-be81-4fb8-9c3c-e891a7140c6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.efa6484f-e78c-4292-ae57-f04a14454f94 1G Nov 03 20:23:24 devstack sudo[94868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:24 devstack sudo[94868]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-127c0ca8-999c-4d91-94ad-1a7d60202ce0 tempest-VolumesDeleteCascade-1846270469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.9592b556-be81-4fb8-9c3c-e891a7140c6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.efa6484f-e78c-4292-ae57-f04a14454f94 1G" returned: 0 in 0.582s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-127c0ca8-999c-4d91-94ad-1a7d60202ce0 tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.9592b556-be81-4fb8-9c3c-e891a7140c6f -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.efa6484f-e78c-4292-ae57-f04a14454f94 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:24 devstack sudo[94878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.9592b556-be81-4fb8-9c3c-e891a7140c6f -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.efa6484f-e78c-4292-ae57-f04a14454f94 Nov 03 20:23:24 devstack sudo[94878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:25 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bd9e8d2-69f7-4c17-8c85-9ebfe6e9bc97 tempest-VolumeTypesAccessTest-848455447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:23:25 devstack sudo[94878]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8bd9e8d2-69f7-4c17-8c85-9ebfe6e9bc97 tempest-VolumeTypesAccessTest-848455447 None] Flow 'volume_create_manager' (e54eac7f-012e-4d87-ab2e-b67b7b10c4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:23:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8bd9e8d2-69f7-4c17-8c85-9ebfe6e9bc97 tempest-VolumeTypesAccessTest-848455447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c02c88ca-cdde-44d6-9112-88de44d08816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-127c0ca8-999c-4d91-94ad-1a7d60202ce0 tempest-VolumesDeleteCascade-1846270469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.9592b556-be81-4fb8-9c3c-e891a7140c6f -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.efa6484f-e78c-4292-ae57-f04a14454f94" returned: 0 in 0.552s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:25 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-127c0ca8-999c-4d91-94ad-1a7d60202ce0 tempest-VolumesDeleteCascade-1846270469 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.efa6484f-e78c-4292-ae57-f04a14454f94 is being set with open permissions: ugo+rw Nov 03 20:23:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-127c0ca8-999c-4d91-94ad-1a7d60202ce0 tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.efa6484f-e78c-4292-ae57-f04a14454f94 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8bd9e8d2-69f7-4c17-8c85-9ebfe6e9bc97 tempest-VolumeTypesAccessTest-848455447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c02c88ca-cdde-44d6-9112-88de44d08816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-663893132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f8853d0-b2a5-49c2-8e8a-aab8b8095fee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fe22ede9afd45508625b85e79c819ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:23:25Z,use_quota=True,user_id='1a865e914ba34b0bba8829952ae85292',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6ba200b-28c7-4e19-80ef-4ae443776bf0),volume_type_id=e6ba200b-28c7-4e19-80ef-4ae443776bf0)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8bd9e8d2-69f7-4c17-8c85-9ebfe6e9bc97 tempest-VolumeTypesAccessTest-848455447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (135a3c42-9b80-4033-92fb-f216f153b69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:25 devstack sudo[94884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.efa6484f-e78c-4292-ae57-f04a14454f94 Nov 03 20:23:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8bd9e8d2-69f7-4c17-8c85-9ebfe6e9bc97 tempest-VolumeTypesAccessTest-848455447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (135a3c42-9b80-4033-92fb-f216f153b69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:25 devstack sudo[94884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8bd9e8d2-69f7-4c17-8c85-9ebfe6e9bc97 tempest-VolumeTypesAccessTest-848455447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (118260b5-3bd3-4719-bc76-955c78ae9c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8bd9e8d2-69f7-4c17-8c85-9ebfe6e9bc97 tempest-VolumeTypesAccessTest-848455447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (118260b5-3bd3-4719-bc76-955c78ae9c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f8853d0-b2a5-49c2-8e8a-aab8b8095fee', 'volume_name': 'volume-3f8853d0-b2a5-49c2-8e8a-aab8b8095fee', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8bd9e8d2-69f7-4c17-8c85-9ebfe6e9bc97 tempest-VolumeTypesAccessTest-848455447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18df6495-f80b-48a9-b76e-459a24e5661b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8bd9e8d2-69f7-4c17-8c85-9ebfe6e9bc97 tempest-VolumeTypesAccessTest-848455447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18df6495-f80b-48a9-b76e-459a24e5661b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8bd9e8d2-69f7-4c17-8c85-9ebfe6e9bc97 tempest-VolumeTypesAccessTest-848455447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (175af8f8-c44e-4c97-a439-7361a269ffc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:25 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-8bd9e8d2-69f7-4c17-8c85-9ebfe6e9bc97 tempest-VolumeTypesAccessTest-848455447 None] Volume 3f8853d0-b2a5-49c2-8e8a-aab8b8095fee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f8853d0-b2a5-49c2-8e8a-aab8b8095fee', 'volume_size': 1} Nov 03 20:23:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8bd9e8d2-69f7-4c17-8c85-9ebfe6e9bc97 tempest-VolumeTypesAccessTest-848455447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:23:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-1cf24be4-6b6f-4dc6-8732-f8a7de2c6346 req-a6fdecee-7d24-4a70-bb53-c92057256d2a tempest-AttachVolumeTestJSON-1951495544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:23:25 devstack sudo[94884]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-127c0ca8-999c-4d91-94ad-1a7d60202ce0 tempest-VolumesDeleteCascade-1846270469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.efa6484f-e78c-4292-ae57-f04a14454f94" returned: 0 in 0.290s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-127c0ca8-999c-4d91-94ad-1a7d60202ce0 tempest-VolumesDeleteCascade-1846270469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.134s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:23:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8bd9e8d2-69f7-4c17-8c85-9ebfe6e9bc97 tempest-VolumeTypesAccessTest-848455447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.257s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:23:25 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8bd9e8d2-69f7-4c17-8c85-9ebfe6e9bc97 tempest-VolumeTypesAccessTest-848455447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-663893132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f8853d0-b2a5-49c2-8e8a-aab8b8095fee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fe22ede9afd45508625b85e79c819ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:23:25Z,use_quota=True,user_id='1a865e914ba34b0bba8829952ae85292',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6ba200b-28c7-4e19-80ef-4ae443776bf0),volume_type_id=e6ba200b-28c7-4e19-80ef-4ae443776bf0)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:23:25 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-8bd9e8d2-69f7-4c17-8c85-9ebfe6e9bc97 tempest-VolumeTypesAccessTest-848455447 None] Creating volume 3f8853d0-b2a5-49c2-8e8a-aab8b8095fee {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:23:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8bd9e8d2-69f7-4c17-8c85-9ebfe6e9bc97 tempest-VolumeTypesAccessTest-848455447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:23:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8bd9e8d2-69f7-4c17-8c85-9ebfe6e9bc97 tempest-VolumeTypesAccessTest-848455447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:23:25 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8bd9e8d2-69f7-4c17-8c85-9ebfe6e9bc97 tempest-VolumeTypesAccessTest-848455447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:23:25 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8bd9e8d2-69f7-4c17-8c85-9ebfe6e9bc97 tempest-VolumeTypesAccessTest-848455447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:23:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8bd9e8d2-69f7-4c17-8c85-9ebfe6e9bc97 tempest-VolumeTypesAccessTest-848455447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:23:25 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8bd9e8d2-69f7-4c17-8c85-9ebfe6e9bc97 tempest-VolumeTypesAccessTest-848455447 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:23:25 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-8bd9e8d2-69f7-4c17-8c85-9ebfe6e9bc97 tempest-VolumeTypesAccessTest-848455447 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:23:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8bd9e8d2-69f7-4c17-8c85-9ebfe6e9bc97 tempest-VolumeTypesAccessTest-848455447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3f8853d0-b2a5-49c2-8e8a-aab8b8095fee 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:25 devstack sudo[94895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3f8853d0-b2a5-49c2-8e8a-aab8b8095fee 1073741824 Nov 03 20:23:25 devstack sudo[94895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:25 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-127c0ca8-999c-4d91-94ad-1a7d60202ce0 tempest-VolumesDeleteCascade-1846270469 None] Create snapshot completed successfully Nov 03 20:23:26 devstack sudo[94895]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8bd9e8d2-69f7-4c17-8c85-9ebfe6e9bc97 tempest-VolumeTypesAccessTest-848455447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3f8853d0-b2a5-49c2-8e8a-aab8b8095fee 1073741824" returned: 0 in 0.472s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8bd9e8d2-69f7-4c17-8c85-9ebfe6e9bc97 tempest-VolumeTypesAccessTest-848455447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3f8853d0-b2a5-49c2-8e8a-aab8b8095fee {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:26 devstack sudo[94901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3f8853d0-b2a5-49c2-8e8a-aab8b8095fee Nov 03 20:23:26 devstack sudo[94901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:26 devstack sudo[94901]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8bd9e8d2-69f7-4c17-8c85-9ebfe6e9bc97 tempest-VolumeTypesAccessTest-848455447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3f8853d0-b2a5-49c2-8e8a-aab8b8095fee" returned: 0 in 0.276s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:26 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8bd9e8d2-69f7-4c17-8c85-9ebfe6e9bc97 tempest-VolumeTypesAccessTest-848455447 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:23:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8bd9e8d2-69f7-4c17-8c85-9ebfe6e9bc97 tempest-VolumeTypesAccessTest-848455447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:23:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-1cf24be4-6b6f-4dc6-8732-f8a7de2c6346 req-a6fdecee-7d24-4a70-bb53-c92057256d2a tempest-AttachVolumeTestJSON-1951495544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.863s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:23:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-1cf24be4-6b6f-4dc6-8732-f8a7de2c6346 req-a6fdecee-7d24-4a70-bb53-c92057256d2a tempest-AttachVolumeTestJSON-1951495544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:23:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8bd9e8d2-69f7-4c17-8c85-9ebfe6e9bc97 tempest-VolumeTypesAccessTest-848455447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (175af8f8-c44e-4c97-a439-7361a269ffc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f8853d0-b2a5-49c2-8e8a-aab8b8095fee', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8bd9e8d2-69f7-4c17-8c85-9ebfe6e9bc97 tempest-VolumeTypesAccessTest-848455447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba0de0fb-7a62-4bd9-8b54-f69b56746c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:26 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-8bd9e8d2-69f7-4c17-8c85-9ebfe6e9bc97 tempest-VolumeTypesAccessTest-848455447 None] Volume volume-3f8853d0-b2a5-49c2-8e8a-aab8b8095fee (3f8853d0-b2a5-49c2-8e8a-aab8b8095fee): created successfully Nov 03 20:23:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8bd9e8d2-69f7-4c17-8c85-9ebfe6e9bc97 tempest-VolumeTypesAccessTest-848455447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba0de0fb-7a62-4bd9-8b54-f69b56746c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8bd9e8d2-69f7-4c17-8c85-9ebfe6e9bc97 tempest-VolumeTypesAccessTest-848455447 None] Flow 'volume_create_manager' (e54eac7f-012e-4d87-ab2e-b67b7b10c4ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:23:26 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-8bd9e8d2-69f7-4c17-8c85-9ebfe6e9bc97 tempest-VolumeTypesAccessTest-848455447 None] Created volume successfully. Nov 03 20:23:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-1cf24be4-6b6f-4dc6-8732-f8a7de2c6346 req-a6fdecee-7d24-4a70-bb53-c92057256d2a tempest-AttachVolumeTestJSON-1951495544 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8', 'name': 'volume-2e48f714-0749-4cfc-9c06-c173ab5a97e3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8d4f79ee-805c-440f-a944-36552b9cdc31', 'enforce_multipath': True} {{(pid=87248) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 20:23:26 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Acquiring lock "cinder-d9f7254f-e25a-442c-a3f8-d065de1fd454-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:23:26 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-1cf24be4-6b6f-4dc6-8732-f8a7de2c6346 req-a6fdecee-7d24-4a70-bb53-c92057256d2a tempest-AttachVolumeTestJSON-1951495544 None] attachment_update completed successfully. Nov 03 20:23:26 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Lock "cinder-d9f7254f-e25a-442c-a3f8-d065de1fd454-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:23:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Performing cascade delete. {{(pid=87248) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 03 20:23:26 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Acquiring lock "cinder-9592b556-be81-4fb8-9c3c-e891a7140c6f-delete_snapshot" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:23:26 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Lock "cinder-9592b556-be81-4fb8-9c3c-e891a7140c6f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:23:26 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Acquiring lock "cinder-quobyte-d9f7254f-e25a-442c-a3f8-d065de1fd454" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:23:26 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Lock "cinder-quobyte-d9f7254f-e25a-442c-a3f8-d065de1fd454" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:23:26 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Acquiring lock "cinder-quobyte-9592b556-be81-4fb8-9c3c-e891a7140c6f" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:23:26 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Lock "cinder-quobyte-9592b556-be81-4fb8-9c3c-e891a7140c6f" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:23:26 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Deleting offline snapshot 9592b556-be81-4fb8-9c3c-e891a7140c6f of volume d9f7254f-e25a-442c-a3f8-d065de1fd454 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:23:26 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] snapshot_file for this snap is: volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.9592b556-be81-4fb8-9c3c-e891a7140c6f {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:23:27 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b10fe8-d01d-4bea-929f-f22814a9b498]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:23:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.9592b556-be81-4fb8-9c3c-e891a7140c6f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:27 devstack sudo[94945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.9592b556-be81-4fb8-9c3c-e891a7140c6f Nov 03 20:23:27 devstack sudo[94945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:27 devstack sudo[94945]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.9592b556-be81-4fb8-9c3c-e891a7140c6f" returned: 0 in 0.477s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:27 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9f7254f-e25a-442c-a3f8-d065de1fd454(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:23:27 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-dde90724-3881-4d77-bd11-82803f99f39f tempest-VolumeTypesAccessTest-848455447 None] Acquiring lock "cinder-3f8853d0-b2a5-49c2-8e8a-aab8b8095fee-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:23:27 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[83132115-5922-43fb-9ada-bd3aa57c101f]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:23:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:27 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-dde90724-3881-4d77-bd11-82803f99f39f tempest-VolumeTypesAccessTest-848455447 None] Lock "cinder-3f8853d0-b2a5-49c2-8e8a-aab8b8095fee-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:23:27 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-dde90724-3881-4d77-bd11-82803f99f39f tempest-VolumeTypesAccessTest-848455447 None] Acquiring lock "cinder-quobyte-3f8853d0-b2a5-49c2-8e8a-aab8b8095fee" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:23:27 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-dde90724-3881-4d77-bd11-82803f99f39f tempest-VolumeTypesAccessTest-848455447 None] Lock "cinder-quobyte-3f8853d0-b2a5-49c2-8e8a-aab8b8095fee" acquired by "delete_volume" :: waited 0.017s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:23:27 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdef8d6-69aa-4050-b42d-40276c3159f3]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:23:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-dde90724-3881-4d77-bd11-82803f99f39f tempest-VolumeTypesAccessTest-848455447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3f8853d0-b2a5-49c2-8e8a-aab8b8095fee {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:27 devstack sudo[95325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454 Nov 03 20:23:27 devstack sudo[95325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:27 devstack sudo[95326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3f8853d0-b2a5-49c2-8e8a-aab8b8095fee Nov 03 20:23:27 devstack sudo[95326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:28 devstack sudo[95325]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454" returned: 0 in 0.537s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:28 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[254deea3-bd2c-43fe-942e-d07c95b74e56]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:23:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.efa6484f-e78c-4292-ae57-f04a14454f94 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:28 devstack sudo[95326]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-dde90724-3881-4d77-bd11-82803f99f39f tempest-VolumeTypesAccessTest-848455447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3f8853d0-b2a5-49c2-8e8a-aab8b8095fee" returned: 0 in 0.462s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-dde90724-3881-4d77-bd11-82803f99f39f tempest-VolumeTypesAccessTest-848455447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3f8853d0-b2a5-49c2-8e8a-aab8b8095fee {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:28 devstack sudo[95336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3f8853d0-b2a5-49c2-8e8a-aab8b8095fee Nov 03 20:23:28 devstack sudo[95336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:28 devstack sudo[95335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.efa6484f-e78c-4292-ae57-f04a14454f94 Nov 03 20:23:28 devstack sudo[95335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:28 devstack sudo[95336]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-dde90724-3881-4d77-bd11-82803f99f39f tempest-VolumeTypesAccessTest-848455447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3f8853d0-b2a5-49c2-8e8a-aab8b8095fee" returned: 0 in 0.286s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:28 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-dde90724-3881-4d77-bd11-82803f99f39f tempest-VolumeTypesAccessTest-848455447 None] Lock "cinder-quobyte-3f8853d0-b2a5-49c2-8e8a-aab8b8095fee" released by "delete_volume" :: held 0.829s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:23:28 devstack cinder-volume[87248]: WARNING cinder.quota [None req-dde90724-3881-4d77-bd11-82803f99f39f tempest-VolumeTypesAccessTest-848455447 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1149651931 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1149651931, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:23:28 devstack cinder-volume[87248]: WARNING cinder.quota [None req-dde90724-3881-4d77-bd11-82803f99f39f tempest-VolumeTypesAccessTest-848455447 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1149651931 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1149651931, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:23:28 devstack sudo[95335]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:28 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-dde90724-3881-4d77-bd11-82803f99f39f tempest-VolumeTypesAccessTest-848455447 None] Created reservations ['ab725bf3-769f-479f-82b5-0315447a8c17', 'd9d5036e-7a49-4118-940b-488b79ee3832', 'dac60b00-50d7-4d40-aebd-4513a44447ad', '52be8857-9724-457a-9ad3-16a7d27b2f8b'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:23:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.efa6484f-e78c-4292-ae57-f04a14454f94" returned: 0 in 0.411s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9f7254f-e25a-442c-a3f8-d065de1fd454(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:23:28 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc51186a-7e5f-45be-b991-b688ace41217]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:23:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.9592b556-be81-4fb8-9c3c-e891a7140c6f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-dde90724-3881-4d77-bd11-82803f99f39f tempest-VolumeTypesAccessTest-848455447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:23:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-dde90724-3881-4d77-bd11-82803f99f39f tempest-VolumeTypesAccessTest-848455447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:23:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-dde90724-3881-4d77-bd11-82803f99f39f tempest-VolumeTypesAccessTest-848455447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:23:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-dde90724-3881-4d77-bd11-82803f99f39f tempest-VolumeTypesAccessTest-848455447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:23:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-dde90724-3881-4d77-bd11-82803f99f39f tempest-VolumeTypesAccessTest-848455447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:23:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-dde90724-3881-4d77-bd11-82803f99f39f tempest-VolumeTypesAccessTest-848455447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:28 devstack sudo[95344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:23:28 devstack sudo[95344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:28 devstack sudo[95343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.9592b556-be81-4fb8-9c3c-e891a7140c6f Nov 03 20:23:28 devstack sudo[95343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:28 devstack cinder-volume[87248]: DEBUG oslo_service.periodic_task [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:23:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:23:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:23:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:23:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:23:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:23:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:28 devstack sudo[95347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:23:28 devstack sudo[95347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:29 devstack sudo[95343]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.9592b556-be81-4fb8-9c3c-e891a7140c6f" returned: 0 in 0.621s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:29 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9f7254f-e25a-442c-a3f8-d065de1fd454(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:23:29 devstack sudo[95344]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-dde90724-3881-4d77-bd11-82803f99f39f tempest-VolumeTypesAccessTest-848455447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.567s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:29 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-dde90724-3881-4d77-bd11-82803f99f39f tempest-VolumeTypesAccessTest-848455447 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:23:29 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be4af40-366c-4d03-84f3-fefbbfc80128]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:23:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:29 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-dde90724-3881-4d77-bd11-82803f99f39f tempest-VolumeTypesAccessTest-848455447 None] Deleted volume successfully. Nov 03 20:23:29 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-dde90724-3881-4d77-bd11-82803f99f39f tempest-VolumeTypesAccessTest-848455447 None] Lock "cinder-3f8853d0-b2a5-49c2-8e8a-aab8b8095fee-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:23:29 devstack sudo[95347]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.646s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:29 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:23:29 devstack cinder-volume[87248]: DEBUG oslo_service.periodic_task [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running periodic task VolumeManager._thread_info {{(pid=87248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:23:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] thread count: 28 {{(pid=87248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:23:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] thread info: [<_MainThread(MainThread, started 124862067372160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:23:29 devstack sudo[95354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454 Nov 03 20:23:29 devstack sudo[95354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:29 devstack sudo[95354]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454" returned: 0 in 0.621s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.9592b556-be81-4fb8-9c3c-e891a7140c6f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:29 devstack sudo[95371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.9592b556-be81-4fb8-9c3c-e891a7140c6f Nov 03 20:23:29 devstack sudo[95371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:30 devstack sudo[95371]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.9592b556-be81-4fb8-9c3c-e891a7140c6f" returned: 0 in 0.570s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.9592b556-be81-4fb8-9c3c-e891a7140c6f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:30 devstack sudo[95377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.9592b556-be81-4fb8-9c3c-e891a7140c6f Nov 03 20:23:30 devstack sudo[95377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:30 devstack sudo[95377]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.9592b556-be81-4fb8-9c3c-e891a7140c6f" returned: 0 in 0.373s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9f7254f-e25a-442c-a3f8-d065de1fd454 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.efa6484f-e78c-4292-ae57-f04a14454f94 -F qcow2 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:30 devstack sudo[95380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9f7254f-e25a-442c-a3f8-d065de1fd454 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.efa6484f-e78c-4292-ae57-f04a14454f94 -F qcow2 Nov 03 20:23:30 devstack sudo[95380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:31 devstack sudo[95380]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9f7254f-e25a-442c-a3f8-d065de1fd454 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.efa6484f-e78c-4292-ae57-f04a14454f94 -F qcow2" returned: 0 in 0.380s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:31 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Lock "cinder-quobyte-9592b556-be81-4fb8-9c3c-e891a7140c6f" released by "_delete_snapshot" :: held 4.314s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:23:31 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Lock "cinder-quobyte-d9f7254f-e25a-442c-a3f8-d065de1fd454" released by "delete_snapshot" :: held 4.358s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:23:31 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Created reservations ['d53f4b67-670b-4341-9f36-e4f06d90477f', 'f4424d7e-b2a3-40a2-9ef3-5ea4f6fe73a8', 'b807610f-0775-49df-acab-50701222ae72', 'd967ef23-3b3a-49bc-a321-a4f86bea015e'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:23:31 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Delete snapshot completed successfully. Nov 03 20:23:31 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Lock "cinder-9592b556-be81-4fb8-9c3c-e891a7140c6f-delete_snapshot" released by "delete_snapshot" :: held 4.600s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:23:31 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Acquiring lock "cinder-efa6484f-e78c-4292-ae57-f04a14454f94-delete_snapshot" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:23:31 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Lock "cinder-efa6484f-e78c-4292-ae57-f04a14454f94-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:23:31 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Acquiring lock "cinder-quobyte-d9f7254f-e25a-442c-a3f8-d065de1fd454" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:23:31 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Lock "cinder-quobyte-d9f7254f-e25a-442c-a3f8-d065de1fd454" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:23:31 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Acquiring lock "cinder-quobyte-efa6484f-e78c-4292-ae57-f04a14454f94" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:23:31 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Lock "cinder-quobyte-efa6484f-e78c-4292-ae57-f04a14454f94" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:23:31 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Deleting offline snapshot efa6484f-e78c-4292-ae57-f04a14454f94 of volume d9f7254f-e25a-442c-a3f8-d065de1fd454 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:23:31 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] snapshot_file for this snap is: volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.efa6484f-e78c-4292-ae57-f04a14454f94 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:23:31 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed5ef99-8d77-44dd-8576-5742af8d79f6]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:23:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.efa6484f-e78c-4292-ae57-f04a14454f94 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:31 devstack sudo[95388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.efa6484f-e78c-4292-ae57-f04a14454f94 Nov 03 20:23:31 devstack sudo[95388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:32 devstack sudo[95388]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.efa6484f-e78c-4292-ae57-f04a14454f94" returned: 0 in 0.561s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:32 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9f7254f-e25a-442c-a3f8-d065de1fd454(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:23:32 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c06ac3-fd22-4685-bd36-3fc6ceaff512]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:23:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:32 devstack sudo[95393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454 Nov 03 20:23:32 devstack sudo[95393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:32 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-a23f83af-2e20-4122-ba12-c1e1d0c407e1 tempest-VolumesActionsTest-1174355871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:23:32 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a23f83af-2e20-4122-ba12-c1e1d0c407e1 tempest-VolumesActionsTest-1174355871 None] Flow 'volume_create_manager' (0ef435d6-e8a0-4fad-a483-8b4d20118979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:23:32 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a23f83af-2e20-4122-ba12-c1e1d0c407e1 tempest-VolumesActionsTest-1174355871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a80186-8759-41fa-bd15-e2cbf5264e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:32 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a23f83af-2e20-4122-ba12-c1e1d0c407e1 tempest-VolumesActionsTest-1174355871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a80186-8759-41fa-bd15-e2cbf5264e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1244309142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9d8b4ae-0951-4c93-90ec-3b2675940d6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a98a231f754f0999e09ad7cff8b100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:23:33Z,use_quota=True,user_id='e82461df036341fc897b5ed45e614093',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:32 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a23f83af-2e20-4122-ba12-c1e1d0c407e1 tempest-VolumesActionsTest-1174355871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86216caf-abe1-4037-837c-074ae8438682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:32 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a23f83af-2e20-4122-ba12-c1e1d0c407e1 tempest-VolumesActionsTest-1174355871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86216caf-abe1-4037-837c-074ae8438682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:32 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a23f83af-2e20-4122-ba12-c1e1d0c407e1 tempest-VolumesActionsTest-1174355871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5769e2d4-82ff-4d17-bcf8-88069eb68caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:32 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a23f83af-2e20-4122-ba12-c1e1d0c407e1 tempest-VolumesActionsTest-1174355871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5769e2d4-82ff-4d17-bcf8-88069eb68caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9d8b4ae-0951-4c93-90ec-3b2675940d6a', 'volume_name': 'volume-e9d8b4ae-0951-4c93-90ec-3b2675940d6a', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:32 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a23f83af-2e20-4122-ba12-c1e1d0c407e1 tempest-VolumesActionsTest-1174355871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be237ea5-56cc-4230-85bf-8034c0d17e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:32 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a23f83af-2e20-4122-ba12-c1e1d0c407e1 tempest-VolumesActionsTest-1174355871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be237ea5-56cc-4230-85bf-8034c0d17e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:32 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a23f83af-2e20-4122-ba12-c1e1d0c407e1 tempest-VolumesActionsTest-1174355871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c2b0a6a-f41f-4de9-ab22-afac5e35e5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:32 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-a23f83af-2e20-4122-ba12-c1e1d0c407e1 tempest-VolumesActionsTest-1174355871 None] Volume e9d8b4ae-0951-4c93-90ec-3b2675940d6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9d8b4ae-0951-4c93-90ec-3b2675940d6a', 'volume_size': 1} Nov 03 20:23:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a23f83af-2e20-4122-ba12-c1e1d0c407e1 tempest-VolumesActionsTest-1174355871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:23:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a23f83af-2e20-4122-ba12-c1e1d0c407e1 tempest-VolumesActionsTest-1174355871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:23:32 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a23f83af-2e20-4122-ba12-c1e1d0c407e1 tempest-VolumesActionsTest-1174355871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1244309142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9d8b4ae-0951-4c93-90ec-3b2675940d6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a98a231f754f0999e09ad7cff8b100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:23:33Z,use_quota=True,user_id='e82461df036341fc897b5ed45e614093',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:23:32 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-a23f83af-2e20-4122-ba12-c1e1d0c407e1 tempest-VolumesActionsTest-1174355871 None] Creating volume e9d8b4ae-0951-4c93-90ec-3b2675940d6a {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:23:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a23f83af-2e20-4122-ba12-c1e1d0c407e1 tempest-VolumesActionsTest-1174355871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:23:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a23f83af-2e20-4122-ba12-c1e1d0c407e1 tempest-VolumesActionsTest-1174355871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:23:32 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a23f83af-2e20-4122-ba12-c1e1d0c407e1 tempest-VolumesActionsTest-1174355871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:23:32 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a23f83af-2e20-4122-ba12-c1e1d0c407e1 tempest-VolumesActionsTest-1174355871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:23:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a23f83af-2e20-4122-ba12-c1e1d0c407e1 tempest-VolumesActionsTest-1174355871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:23:32 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a23f83af-2e20-4122-ba12-c1e1d0c407e1 tempest-VolumesActionsTest-1174355871 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:23:32 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-a23f83af-2e20-4122-ba12-c1e1d0c407e1 tempest-VolumesActionsTest-1174355871 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:23:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a23f83af-2e20-4122-ba12-c1e1d0c407e1 tempest-VolumesActionsTest-1174355871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e9d8b4ae-0951-4c93-90ec-3b2675940d6a 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:32 devstack sudo[95406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e9d8b4ae-0951-4c93-90ec-3b2675940d6a 1073741824 Nov 03 20:23:32 devstack sudo[95406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:32 devstack sudo[95393]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454" returned: 0 in 0.723s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.efa6484f-e78c-4292-ae57-f04a14454f94 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:33 devstack sudo[95438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.efa6484f-e78c-4292-ae57-f04a14454f94 Nov 03 20:23:33 devstack sudo[95438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:33 devstack sudo[95438]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.efa6484f-e78c-4292-ae57-f04a14454f94" returned: 0 in 0.549s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.efa6484f-e78c-4292-ae57-f04a14454f94 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:33 devstack sudo[95550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.efa6484f-e78c-4292-ae57-f04a14454f94 Nov 03 20:23:33 devstack sudo[95550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:33 devstack sudo[95406]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a23f83af-2e20-4122-ba12-c1e1d0c407e1 tempest-VolumesActionsTest-1174355871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e9d8b4ae-0951-4c93-90ec-3b2675940d6a 1073741824" returned: 0 in 0.839s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a23f83af-2e20-4122-ba12-c1e1d0c407e1 tempest-VolumesActionsTest-1174355871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e9d8b4ae-0951-4c93-90ec-3b2675940d6a {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:33 devstack sudo[95553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e9d8b4ae-0951-4c93-90ec-3b2675940d6a Nov 03 20:23:33 devstack sudo[95553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:33 devstack sudo[95550]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454.efa6484f-e78c-4292-ae57-f04a14454f94" returned: 0 in 0.381s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:33 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Lock "cinder-quobyte-efa6484f-e78c-4292-ae57-f04a14454f94" released by "_delete_snapshot" :: held 2.381s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:23:33 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Lock "cinder-quobyte-d9f7254f-e25a-442c-a3f8-d065de1fd454" released by "delete_snapshot" :: held 2.416s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:23:34 devstack sudo[95553]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a23f83af-2e20-4122-ba12-c1e1d0c407e1 tempest-VolumesActionsTest-1174355871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e9d8b4ae-0951-4c93-90ec-3b2675940d6a" returned: 0 in 0.326s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:34 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a23f83af-2e20-4122-ba12-c1e1d0c407e1 tempest-VolumesActionsTest-1174355871 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:23:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a23f83af-2e20-4122-ba12-c1e1d0c407e1 tempest-VolumesActionsTest-1174355871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:23:34 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a23f83af-2e20-4122-ba12-c1e1d0c407e1 tempest-VolumesActionsTest-1174355871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c2b0a6a-f41f-4de9-ab22-afac5e35e5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9d8b4ae-0951-4c93-90ec-3b2675940d6a', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:34 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a23f83af-2e20-4122-ba12-c1e1d0c407e1 tempest-VolumesActionsTest-1174355871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45013cef-877a-4e9c-921c-ecde6ca8bae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:34 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Created reservations ['1d69a41f-1b53-4279-bf25-55897c999195', 'd821eb18-873f-48cb-a55b-533b9ccff212', 'c928274f-2d2d-4286-944b-4d016ff842e9', 'c242295a-25f2-4729-94ed-2ce8b0aaddc7'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:23:34 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-a23f83af-2e20-4122-ba12-c1e1d0c407e1 tempest-VolumesActionsTest-1174355871 None] Volume volume-e9d8b4ae-0951-4c93-90ec-3b2675940d6a (e9d8b4ae-0951-4c93-90ec-3b2675940d6a): created successfully Nov 03 20:23:34 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a23f83af-2e20-4122-ba12-c1e1d0c407e1 tempest-VolumesActionsTest-1174355871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45013cef-877a-4e9c-921c-ecde6ca8bae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:34 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a23f83af-2e20-4122-ba12-c1e1d0c407e1 tempest-VolumesActionsTest-1174355871 None] Flow 'volume_create_manager' (0ef435d6-e8a0-4fad-a483-8b4d20118979) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:23:34 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-a23f83af-2e20-4122-ba12-c1e1d0c407e1 tempest-VolumesActionsTest-1174355871 None] Created volume successfully. Nov 03 20:23:34 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Delete snapshot completed successfully. Nov 03 20:23:34 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Lock "cinder-efa6484f-e78c-4292-ae57-f04a14454f94-delete_snapshot" released by "delete_snapshot" :: held 2.653s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:23:34 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Snapshots deleted, issuing volume delete {{(pid=87248) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 03 20:23:34 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Acquiring lock "cinder-quobyte-d9f7254f-e25a-442c-a3f8-d065de1fd454" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:23:34 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Lock "cinder-quobyte-d9f7254f-e25a-442c-a3f8-d065de1fd454" acquired by "delete_volume" :: waited 0.013s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:23:34 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5f5213-18bf-40e6-bc3f-64fa379124f0]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:23:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:34 devstack sudo[95568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454 Nov 03 20:23:34 devstack sudo[95568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:34 devstack sudo[95568]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454" returned: 0 in 0.603s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:34 devstack sudo[95924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454 Nov 03 20:23:34 devstack sudo[95924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:35 devstack sudo[95924]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d9f7254f-e25a-442c-a3f8-d065de1fd454" returned: 0 in 0.518s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:35 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Lock "cinder-quobyte-d9f7254f-e25a-442c-a3f8-d065de1fd454" released by "delete_volume" :: held 1.225s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:23:35 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Created reservations ['74b8c6a7-2285-4453-9fe7-5b2decd261ff', '12c510bc-a638-410e-b78e-9e036d387641', 'b35fccd4-62f6-485f-b37e-e648f9ee62c8', 'a10ba6dd-cd83-47a5-9bb6-588de6b4c670'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:23:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:23:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:23:35 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:23:35 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:23:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:23:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:35 devstack sudo[95954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:23:35 devstack sudo[95954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:36 devstack sudo[95954]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.404s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:36 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:23:36 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Deleted volume successfully. Nov 03 20:23:36 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b6d4fa6d-7297-445b-9a39-f07e55290b38 tempest-VolumesDeleteCascade-1846270469 None] Lock "cinder-d9f7254f-e25a-442c-a3f8-d065de1fd454-delete_volume" released by "delete_volume" :: held 9.350s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:23:37 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e6f1886-8322-4efb-847f-6569599603ee tempest-VolumesDeleteCascade-1846270469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:23:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8e6f1886-8322-4efb-847f-6569599603ee tempest-VolumesDeleteCascade-1846270469 None] Flow 'volume_create_manager' (1dc4136d-398f-4c19-bcae-9493d5fe6fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:23:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8e6f1886-8322-4efb-847f-6569599603ee tempest-VolumesDeleteCascade-1846270469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5b5385b-4f6e-46dd-b6cf-1f85ae5e71a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8e6f1886-8322-4efb-847f-6569599603ee tempest-VolumesDeleteCascade-1846270469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5b5385b-4f6e-46dd-b6cf-1f85ae5e71a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1249244222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c70d20370854f8d96076bad361bdb3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:23:37Z,use_quota=True,user_id='e21473b2165f4b2fada873aca7739004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8e6f1886-8322-4efb-847f-6569599603ee tempest-VolumesDeleteCascade-1846270469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a93df8bb-7646-463d-a775-a43db9097a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8e6f1886-8322-4efb-847f-6569599603ee tempest-VolumesDeleteCascade-1846270469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a93df8bb-7646-463d-a775-a43db9097a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8e6f1886-8322-4efb-847f-6569599603ee tempest-VolumesDeleteCascade-1846270469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26d862d2-7bca-42c4-9cbb-c7b1bfc96a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8e6f1886-8322-4efb-847f-6569599603ee tempest-VolumesDeleteCascade-1846270469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26d862d2-7bca-42c4-9cbb-c7b1bfc96a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8', 'volume_name': 'volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8e6f1886-8322-4efb-847f-6569599603ee tempest-VolumesDeleteCascade-1846270469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0d79806-9d1e-4443-aa68-2c07556bc6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8e6f1886-8322-4efb-847f-6569599603ee tempest-VolumesDeleteCascade-1846270469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0d79806-9d1e-4443-aa68-2c07556bc6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8e6f1886-8322-4efb-847f-6569599603ee tempest-VolumesDeleteCascade-1846270469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1206e44-d4be-4c9c-963b-acef2d720d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:37 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-8e6f1886-8322-4efb-847f-6569599603ee tempest-VolumesDeleteCascade-1846270469 None] Volume e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8', 'volume_size': 1} Nov 03 20:23:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8e6f1886-8322-4efb-847f-6569599603ee tempest-VolumesDeleteCascade-1846270469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:23:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8e6f1886-8322-4efb-847f-6569599603ee tempest-VolumesDeleteCascade-1846270469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:23:37 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8e6f1886-8322-4efb-847f-6569599603ee tempest-VolumesDeleteCascade-1846270469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1249244222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c70d20370854f8d96076bad361bdb3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:23:37Z,use_quota=True,user_id='e21473b2165f4b2fada873aca7739004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:23:37 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-8e6f1886-8322-4efb-847f-6569599603ee tempest-VolumesDeleteCascade-1846270469 None] Creating volume e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:23:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8e6f1886-8322-4efb-847f-6569599603ee tempest-VolumesDeleteCascade-1846270469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:23:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8e6f1886-8322-4efb-847f-6569599603ee tempest-VolumesDeleteCascade-1846270469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:23:37 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8e6f1886-8322-4efb-847f-6569599603ee tempest-VolumesDeleteCascade-1846270469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:23:37 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8e6f1886-8322-4efb-847f-6569599603ee tempest-VolumesDeleteCascade-1846270469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:23:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8e6f1886-8322-4efb-847f-6569599603ee tempest-VolumesDeleteCascade-1846270469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:23:37 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8e6f1886-8322-4efb-847f-6569599603ee tempest-VolumesDeleteCascade-1846270469 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:23:37 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-8e6f1886-8322-4efb-847f-6569599603ee tempest-VolumesDeleteCascade-1846270469 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:23:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8e6f1886-8322-4efb-847f-6569599603ee tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:37 devstack sudo[95967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8 1073741824 Nov 03 20:23:37 devstack sudo[95967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:38 devstack sudo[95967]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8e6f1886-8322-4efb-847f-6569599603ee tempest-VolumesDeleteCascade-1846270469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8 1073741824" returned: 0 in 0.899s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8e6f1886-8322-4efb-847f-6569599603ee tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:38 devstack sudo[95973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8 Nov 03 20:23:38 devstack sudo[95973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:39 devstack sudo[95973]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8e6f1886-8322-4efb-847f-6569599603ee tempest-VolumesDeleteCascade-1846270469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8" returned: 0 in 0.468s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:39 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8e6f1886-8322-4efb-847f-6569599603ee tempest-VolumesDeleteCascade-1846270469 None] <== create_volume: return (1442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:23:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8e6f1886-8322-4efb-847f-6569599603ee tempest-VolumesDeleteCascade-1846270469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.449s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:23:39 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8e6f1886-8322-4efb-847f-6569599603ee tempest-VolumesDeleteCascade-1846270469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1206e44-d4be-4c9c-963b-acef2d720d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:39 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8e6f1886-8322-4efb-847f-6569599603ee tempest-VolumesDeleteCascade-1846270469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ac0baec-4309-42d6-b7d8-5f84bc6b4b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:39 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-8e6f1886-8322-4efb-847f-6569599603ee tempest-VolumesDeleteCascade-1846270469 None] Volume volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8 (e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8): created successfully Nov 03 20:23:39 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8e6f1886-8322-4efb-847f-6569599603ee tempest-VolumesDeleteCascade-1846270469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ac0baec-4309-42d6-b7d8-5f84bc6b4b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:39 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8e6f1886-8322-4efb-847f-6569599603ee tempest-VolumesDeleteCascade-1846270469 None] Flow 'volume_create_manager' (1dc4136d-398f-4c19-bcae-9493d5fe6fab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:23:39 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-8e6f1886-8322-4efb-847f-6569599603ee tempest-VolumesDeleteCascade-1846270469 None] Created volume successfully. Nov 03 20:23:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-3a435a81-5555-4bd4-b51c-e897228d7c4a tempest-VolumesDeleteCascade-1846270469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:23:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-3a435a81-5555-4bd4-b51c-e897228d7c4a tempest-VolumesDeleteCascade-1846270469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:23:39 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-3a435a81-5555-4bd4-b51c-e897228d7c4a tempest-VolumesDeleteCascade-1846270469 None] Creating offline snapshot 79eb434b-f7ca-4e16-9f46-bf0f889b819f of volume e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8 {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:23:39 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[140ed282-bc02-450a-ab7a-87677b8f32df]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:23:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3a435a81-5555-4bd4-b51c-e897228d7c4a tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:40 devstack sudo[95989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8 Nov 03 20:23:40 devstack sudo[95989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:40 devstack sudo[95989]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3a435a81-5555-4bd4-b51c-e897228d7c4a tempest-VolumesDeleteCascade-1846270469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8" returned: 0 in 0.530s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3a435a81-5555-4bd4-b51c-e897228d7c4a tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8.79eb434b-f7ca-4e16-9f46-bf0f889b819f 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:40 devstack sudo[95997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8.79eb434b-f7ca-4e16-9f46-bf0f889b819f 1G Nov 03 20:23:40 devstack sudo[95997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:41 devstack sudo[95997]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3a435a81-5555-4bd4-b51c-e897228d7c4a tempest-VolumesDeleteCascade-1846270469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8.79eb434b-f7ca-4e16-9f46-bf0f889b819f 1G" returned: 0 in 0.581s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3a435a81-5555-4bd4-b51c-e897228d7c4a tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8.79eb434b-f7ca-4e16-9f46-bf0f889b819f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:41 devstack sudo[96005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8.79eb434b-f7ca-4e16-9f46-bf0f889b819f Nov 03 20:23:41 devstack sudo[96005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:41 devstack sudo[96005]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3a435a81-5555-4bd4-b51c-e897228d7c4a tempest-VolumesDeleteCascade-1846270469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8.79eb434b-f7ca-4e16-9f46-bf0f889b819f" returned: 0 in 0.364s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:41 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-3a435a81-5555-4bd4-b51c-e897228d7c4a tempest-VolumesDeleteCascade-1846270469 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8.79eb434b-f7ca-4e16-9f46-bf0f889b819f is being set with open permissions: ugo+rw Nov 03 20:23:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3a435a81-5555-4bd4-b51c-e897228d7c4a tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8.79eb434b-f7ca-4e16-9f46-bf0f889b819f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:41 devstack sudo[96010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8.79eb434b-f7ca-4e16-9f46-bf0f889b819f Nov 03 20:23:41 devstack sudo[96010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:41 devstack sudo[96010]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3a435a81-5555-4bd4-b51c-e897228d7c4a tempest-VolumesDeleteCascade-1846270469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8.79eb434b-f7ca-4e16-9f46-bf0f889b819f" returned: 0 in 0.367s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3a435a81-5555-4bd4-b51c-e897228d7c4a tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:41 devstack sudo[96015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8.info Nov 03 20:23:41 devstack sudo[96015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:42 devstack sudo[96015]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3a435a81-5555-4bd4-b51c-e897228d7c4a tempest-VolumesDeleteCascade-1846270469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8.info" returned: 0 in 0.341s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:42 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-3a435a81-5555-4bd4-b51c-e897228d7c4a tempest-VolumesDeleteCascade-1846270469 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8.info is being set with open permissions: ugo+rw Nov 03 20:23:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3a435a81-5555-4bd4-b51c-e897228d7c4a tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:42 devstack sudo[96018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8.info Nov 03 20:23:42 devstack sudo[96018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:42 devstack sudo[96018]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3a435a81-5555-4bd4-b51c-e897228d7c4a tempest-VolumesDeleteCascade-1846270469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8.info" returned: 0 in 0.327s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-3a435a81-5555-4bd4-b51c-e897228d7c4a tempest-VolumesDeleteCascade-1846270469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.758s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:23:42 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-3a435a81-5555-4bd4-b51c-e897228d7c4a tempest-VolumesDeleteCascade-1846270469 None] Create snapshot completed successfully Nov 03 20:23:44 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:23:44 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] Flow 'volume_create_manager' (9125d159-6160-4f30-86ae-f65669ea8b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:23:44 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (905aef28-6360-4c43-8b5f-236826e24516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:44 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (905aef28-6360-4c43-8b5f-236826e24516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:23:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-533304033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aac23b2-660e-414b-a754-2615d89bb958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c70d20370854f8d96076bad361bdb3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=79eb434b-f7ca-4e16-9f46-bf0f889b819f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:23:45Z,use_quota=True,user_id='e21473b2165f4b2fada873aca7739004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:44 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ba854de-046d-4336-9e2e-23e3d534472b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:44 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ba854de-046d-4336-9e2e-23e3d534472b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:44 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b380194-f1db-46b1-898e-168a2a4d7976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:44 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b380194-f1db-46b1-898e-168a2a4d7976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3aac23b2-660e-414b-a754-2615d89bb958', 'volume_name': 'volume-3aac23b2-660e-414b-a754-2615d89bb958', 'volume_size': 1, 'snapshot_id': '79eb434b-f7ca-4e16-9f46-bf0f889b819f'}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:44 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a4873a2-d558-4a32-9783-a0c69eb05754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:44 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a4873a2-d558-4a32-9783-a0c69eb05754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:44 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a303d290-ec5b-4e67-935e-7712bd0e8a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:44 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] Volume 3aac23b2-660e-414b-a754-2615d89bb958: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3aac23b2-660e-414b-a754-2615d89bb958', 'volume_size': 1, 'snapshot_id': '79eb434b-f7ca-4e16-9f46-bf0f889b819f'} Nov 03 20:23:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:23:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:23:45 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] Acquiring lock "cinder-quobyte-79eb434b-f7ca-4e16-9f46-bf0f889b819f-3aac23b2-660e-414b-a754-2615d89bb958" by "_create_volume_from_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:23:45 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] Lock "cinder-quobyte-79eb434b-f7ca-4e16-9f46-bf0f889b819f-3aac23b2-660e-414b-a754-2615d89bb958" acquired by "_create_volume_from_snapshot" :: waited 0.048s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:23:45 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] Creating volume 3aac23b2-660e-414b-a754-2615d89bb958 from snapshot 79eb434b-f7ca-4e16-9f46-bf0f889b819f {{(pid=87248) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 20:23:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:23:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:23:45 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:23:45 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:23:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:23:45 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:23:45 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] Acquiring lock "cinder-quobyte-3aac23b2-660e-414b-a754-2615d89bb958" by "_copy_volume_from_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:23:45 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] Lock "cinder-quobyte-3aac23b2-660e-414b-a754-2615d89bb958" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:23:45 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] snapshot: 79eb434b-f7ca-4e16-9f46-bf0f889b819f, volume: 3aac23b2-660e-414b-a754-2615d89bb958, {{(pid=87248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 20:23:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:23:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:23:45 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:23:45 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:23:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:23:45 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da32e11-b491-4902-8ce9-a1069e799e2e]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:23:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8.79eb434b-f7ca-4e16-9f46-bf0f889b819f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:45 devstack sudo[96090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8.79eb434b-f7ca-4e16-9f46-bf0f889b819f Nov 03 20:23:45 devstack sudo[96090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:46 devstack sudo[96090]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8.79eb434b-f7ca-4e16-9f46-bf0f889b819f" returned: 0 in 0.897s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:46 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:23:46 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e20c7c-1c95-41e0-a87b-1bb2a5edef51]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:23:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:46 devstack sudo[96095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8 Nov 03 20:23:46 devstack sudo[96095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:46 devstack sudo[96095]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8" returned: 0 in 0.621s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:46 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8 {{(pid=87248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 20:23:46 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] Creating direct copy from snapshot {{(pid=87248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 20:23:46 devstack cinder-volume[87248]: DEBUG cinder.utils [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] Path /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3aac23b2-660e-414b-a754-2615d89bb958 not found in is_blk_device check {{(pid=87248) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 20:23:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3aac23b2-660e-414b-a754-2615d89bb958 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:46 devstack sudo[96100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3aac23b2-660e-414b-a754-2615d89bb958 Nov 03 20:23:46 devstack sudo[96100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:47 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-57a4f099-4358-4235-8062-64b1160daabf tempest-VolumesActionsTest-1174355871 None] Acquiring lock "cinder-e9d8b4ae-0951-4c93-90ec-3b2675940d6a" by "attach_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:23:47 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-57a4f099-4358-4235-8062-64b1160daabf tempest-VolumesActionsTest-1174355871 None] Lock "cinder-e9d8b4ae-0951-4c93-90ec-3b2675940d6a" acquired by "attach_volume" :: waited 0.026s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:23:47 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-57a4f099-4358-4235-8062-64b1160daabf tempest-VolumesActionsTest-1174355871 None] Attaching volume e9d8b4ae-0951-4c93-90ec-3b2675940d6a to instance df043bf2-bca4-4ae6-8978-fb02dc2a707d at mountpoint /dev/vdb on host None. Nov 03 20:23:47 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-57a4f099-4358-4235-8062-64b1160daabf tempest-VolumesActionsTest-1174355871 None] Attach volume completed successfully. Nov 03 20:23:47 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-57a4f099-4358-4235-8062-64b1160daabf tempest-VolumesActionsTest-1174355871 None] Lock "cinder-e9d8b4ae-0951-4c93-90ec-3b2675940d6a" released by "attach_volume" :: held 0.157s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:23:47 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d32823d9-0b6d-400f-8412-2d49de584ae3 tempest-VolumesActionsTest-1174355871 None] Acquiring lock "cinder-e9d8b4ae-0951-4c93-90ec-3b2675940d6a-detach_volume" by "detach_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:23:47 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d32823d9-0b6d-400f-8412-2d49de584ae3 tempest-VolumesActionsTest-1174355871 None] Lock "cinder-e9d8b4ae-0951-4c93-90ec-3b2675940d6a-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:23:47 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-d32823d9-0b6d-400f-8412-2d49de584ae3 tempest-VolumesActionsTest-1174355871 None] Detaching volume e9d8b4ae-0951-4c93-90ec-3b2675940d6a from instance df043bf2-bca4-4ae6-8978-fb02dc2a707d. Nov 03 20:23:48 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-d32823d9-0b6d-400f-8412-2d49de584ae3 tempest-VolumesActionsTest-1174355871 None] Detach volume completed successfully. Nov 03 20:23:48 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d32823d9-0b6d-400f-8412-2d49de584ae3 tempest-VolumesActionsTest-1174355871 None] Lock "cinder-e9d8b4ae-0951-4c93-90ec-3b2675940d6a-detach_volume" released by "detach_volume" :: held 0.240s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:23:57 devstack sudo[96100]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3aac23b2-660e-414b-a754-2615d89bb958" returned: 0 in 10.575s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:57 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] Image conversion details: src /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8, size 1024.00 MB, duration 10.58 sec, destination /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3aac23b2-660e-414b-a754-2615d89bb958 {{(pid=87248) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:23:57 devstack cinder-volume[87248]: INFO cinder.image.image_utils [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] Converted 1024.00 MB image at 96.80 MB/s Nov 03 20:23:57 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3aac23b2-660e-414b-a754-2615d89bb958 is being set with open permissions: ugo+rw Nov 03 20:23:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3aac23b2-660e-414b-a754-2615d89bb958 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:57 devstack sudo[96187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3aac23b2-660e-414b-a754-2615d89bb958 Nov 03 20:23:57 devstack sudo[96187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:57 devstack sudo[96187]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3aac23b2-660e-414b-a754-2615d89bb958" returned: 0 in 0.328s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:57 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] Lock "cinder-quobyte-3aac23b2-660e-414b-a754-2615d89bb958" released by "_copy_volume_from_snapshot" :: held 12.647s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:23:57 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] Lock "cinder-quobyte-79eb434b-f7ca-4e16-9f46-bf0f889b819f-3aac23b2-660e-414b-a754-2615d89bb958" released by "_create_volume_from_snapshot" :: held 12.777s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:23:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.828s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:23:57 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a303d290-ec5b-4e67-935e-7712bd0e8a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3aac23b2-660e-414b-a754-2615d89bb958', 'volume_size': 1, 'snapshot_id': '79eb434b-f7ca-4e16-9f46-bf0f889b819f'}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:57 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8921d27a-9029-4910-9e08-842f9829be94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:23:57 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] Volume volume-3aac23b2-660e-414b-a754-2615d89bb958 (3aac23b2-660e-414b-a754-2615d89bb958): created successfully Nov 03 20:23:57 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8921d27a-9029-4910-9e08-842f9829be94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:23:57 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] Flow 'volume_create_manager' (9125d159-6160-4f30-86ae-f65669ea8b5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:23:57 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-be9b9f1e-95a7-4476-8e47-e71697cb6bc9 tempest-VolumesDeleteCascade-1846270469 None] Created volume successfully. Nov 03 20:23:58 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b07955e6-cfef-4325-b97f-6f07e6771f74 tempest-VolumesDeleteCascade-1846270469 None] Acquiring lock "cinder-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:23:58 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b07955e6-cfef-4325-b97f-6f07e6771f74 tempest-VolumesDeleteCascade-1846270469 None] Lock "cinder-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:23:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b07955e6-cfef-4325-b97f-6f07e6771f74 tempest-VolumesDeleteCascade-1846270469 None] Performing cascade delete. {{(pid=87248) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 03 20:23:58 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b07955e6-cfef-4325-b97f-6f07e6771f74 tempest-VolumesDeleteCascade-1846270469 None] Acquiring lock "cinder-79eb434b-f7ca-4e16-9f46-bf0f889b819f-delete_snapshot" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:23:58 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b07955e6-cfef-4325-b97f-6f07e6771f74 tempest-VolumesDeleteCascade-1846270469 None] Lock "cinder-79eb434b-f7ca-4e16-9f46-bf0f889b819f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:23:58 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b07955e6-cfef-4325-b97f-6f07e6771f74 tempest-VolumesDeleteCascade-1846270469 None] Acquiring lock "cinder-quobyte-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:23:58 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b07955e6-cfef-4325-b97f-6f07e6771f74 tempest-VolumesDeleteCascade-1846270469 None] Lock "cinder-quobyte-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:23:58 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b07955e6-cfef-4325-b97f-6f07e6771f74 tempest-VolumesDeleteCascade-1846270469 None] Acquiring lock "cinder-quobyte-79eb434b-f7ca-4e16-9f46-bf0f889b819f" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:23:58 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b07955e6-cfef-4325-b97f-6f07e6771f74 tempest-VolumesDeleteCascade-1846270469 None] Lock "cinder-quobyte-79eb434b-f7ca-4e16-9f46-bf0f889b819f" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:23:58 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-b07955e6-cfef-4325-b97f-6f07e6771f74 tempest-VolumesDeleteCascade-1846270469 None] Deleting offline snapshot 79eb434b-f7ca-4e16-9f46-bf0f889b819f of volume e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:23:58 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-b07955e6-cfef-4325-b97f-6f07e6771f74 tempest-VolumesDeleteCascade-1846270469 None] snapshot_file for this snap is: volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8.79eb434b-f7ca-4e16-9f46-bf0f889b819f {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:23:58 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41f901b-fabc-4e36-bb08-f09ac7d0ce44]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:23:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b07955e6-cfef-4325-b97f-6f07e6771f74 tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8.79eb434b-f7ca-4e16-9f46-bf0f889b819f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:58 devstack sudo[96195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8.79eb434b-f7ca-4e16-9f46-bf0f889b819f Nov 03 20:23:58 devstack sudo[96195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:23:59 devstack sudo[96195]: pam_unix(sudo:session): session closed for user root Nov 03 20:23:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b07955e6-cfef-4325-b97f-6f07e6771f74 tempest-VolumesDeleteCascade-1846270469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8.79eb434b-f7ca-4e16-9f46-bf0f889b819f" returned: 0 in 0.494s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:23:59 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-b07955e6-cfef-4325-b97f-6f07e6771f74 tempest-VolumesDeleteCascade-1846270469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:23:59 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f49ecd-a79c-4969-a88a-4e1f02343a27]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:23:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b07955e6-cfef-4325-b97f-6f07e6771f74 tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:23:59 devstack sudo[96201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8 Nov 03 20:23:59 devstack sudo[96201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b07955e6-cfef-4325-b97f-6f07e6771f74 tempest-VolumesDeleteCascade-1846270469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8" returned: 0 in 0.689s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b07955e6-cfef-4325-b97f-6f07e6771f74 tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8.79eb434b-f7ca-4e16-9f46-bf0f889b819f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:00 devstack sudo[96201]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:00 devstack sudo[96206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8.79eb434b-f7ca-4e16-9f46-bf0f889b819f Nov 03 20:24:00 devstack sudo[96206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:00 devstack sudo[96206]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b07955e6-cfef-4325-b97f-6f07e6771f74 tempest-VolumesDeleteCascade-1846270469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8.79eb434b-f7ca-4e16-9f46-bf0f889b819f" returned: 0 in 0.862s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b07955e6-cfef-4325-b97f-6f07e6771f74 tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8.79eb434b-f7ca-4e16-9f46-bf0f889b819f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:00 devstack sudo[96269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8.79eb434b-f7ca-4e16-9f46-bf0f889b819f Nov 03 20:24:00 devstack sudo[96269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:00 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:INSERT=21,cinder:SELECT=76,cinder:UPDATE=85,cinder:DELETE=6 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:24:01 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:SELECT=91,cinder:UPDATE=91,cinder:DELETE=10,cinder:INSERT=23 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:24:01 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:24:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Flow 'volume_create_manager' (fa932e75-22db-4337-b063-35e9c685bafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:24:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e822fe9-c5af-45d9-9b69-05b4bcaa07b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e822fe9-c5af-45d9-9b69-05b4bcaa07b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-992591705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ec6d265-44ea-4818-9aea-db1c07e12fa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d013d7604fd5471098e55a51eeb4a77c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:24:01Z,use_quota=True,user_id='6393890961b440be8973d45f2f3c1e5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96546fff-a8e2-4968-908d-a1ef7f67b2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96546fff-a8e2-4968-908d-a1ef7f67b2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28f75125-07fd-495b-a1b4-73496af86770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:01 devstack cinder-volume[87248]: DEBUG cinder.image.glance [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Creating Keystone auth plugin from conf {{(pid=87248) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 20:24:01 devstack sudo[96269]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b07955e6-cfef-4325-b97f-6f07e6771f74 tempest-VolumesDeleteCascade-1846270469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8.79eb434b-f7ca-4e16-9f46-bf0f889b819f" returned: 0 in 0.585s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:01 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b07955e6-cfef-4325-b97f-6f07e6771f74 tempest-VolumesDeleteCascade-1846270469 None] Lock "cinder-quobyte-79eb434b-f7ca-4e16-9f46-bf0f889b819f" released by "_delete_snapshot" :: held 2.840s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:24:01 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b07955e6-cfef-4325-b97f-6f07e6771f74 tempest-VolumesDeleteCascade-1846270469 None] Lock "cinder-quobyte-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8" released by "delete_snapshot" :: held 2.883s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:24:01 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-b07955e6-cfef-4325-b97f-6f07e6771f74 tempest-VolumesDeleteCascade-1846270469 None] Created reservations ['8cd9eb59-0776-464e-bc4c-8abbb9d682a3', '80dcf2c7-2b80-4b89-8e2d-25e337c4dc53', '894ca877-21f6-4e39-aa98-235b0169da1b', 'bc0a1d84-e324-4a95-b03b-f9c290812852'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:24:01 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-b07955e6-cfef-4325-b97f-6f07e6771f74 tempest-VolumesDeleteCascade-1846270469 None] Delete snapshot completed successfully. Nov 03 20:24:01 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b07955e6-cfef-4325-b97f-6f07e6771f74 tempest-VolumesDeleteCascade-1846270469 None] Lock "cinder-79eb434b-f7ca-4e16-9f46-bf0f889b819f-delete_snapshot" released by "delete_snapshot" :: held 3.155s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:24:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b07955e6-cfef-4325-b97f-6f07e6771f74 tempest-VolumesDeleteCascade-1846270469 None] Snapshots deleted, issuing volume delete {{(pid=87248) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 03 20:24:01 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b07955e6-cfef-4325-b97f-6f07e6771f74 tempest-VolumesDeleteCascade-1846270469 None] Acquiring lock "cinder-quobyte-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:24:01 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b07955e6-cfef-4325-b97f-6f07e6771f74 tempest-VolumesDeleteCascade-1846270469 None] Lock "cinder-quobyte-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8" acquired by "delete_volume" :: waited 0.027s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:24:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28f75125-07fd-495b-a1b4-73496af86770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1ec6d265-44ea-4818-9aea-db1c07e12fa3', 'volume_name': 'volume-1ec6d265-44ea-4818-9aea-db1c07e12fa3', 'volume_size': 1, 'image_id': '346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a647f64245a54dad95167f6d04c75eaa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'created_at': datetime.datetime(2026, 11, 3, 19, 11, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 11, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/346de059-5b9a-438e-a6dd-24e9fc9a1ee3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21ff68a8-86f7-45e6-9cc8-6e58162146e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21ff68a8-86f7-45e6-9cc8-6e58162146e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c7d9b3f-48f9-482a-b72c-4092354dc0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:02 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Volume 1ec6d265-44ea-4818-9aea-db1c07e12fa3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1ec6d265-44ea-4818-9aea-db1c07e12fa3', 'volume_size': 1, 'image_id': '346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a647f64245a54dad95167f6d04c75eaa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'created_at': datetime.datetime(2026, 11, 3, 19, 11, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 11, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/346de059-5b9a-438e-a6dd-24e9fc9a1ee3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 20:24:02 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Trying to clone 1ec6d265-44ea-4818-9aea-db1c07e12fa3 from image 346de059-5b9a-438e-a6dd-24e9fc9a1ee3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'metadata': {}}]). {{(pid=87248) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 20:24:02 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[62688888-7762-47e1-96c3-6ae12108cb5f]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b07955e6-cfef-4325-b97f-6f07e6771f74 tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:02 devstack sudo[96325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8 Nov 03 20:24:02 devstack sudo[96325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:02 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_0d39iqfrdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87248) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 20:24:02 devstack cinder-volume[87248]: INFO cinder.image.image_utils [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Image download 20.69 MB at 20.69 MB/s Nov 03 20:24:02 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[f580eb04-936e-44cc-9c3f-50e1d8beea9f]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_0d39iqfrdevstack@QuobyteHD {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:02 devstack sudo[96325]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b07955e6-cfef-4325-b97f-6f07e6771f74 tempest-VolumesDeleteCascade-1846270469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8" returned: 0 in 0.635s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b07955e6-cfef-4325-b97f-6f07e6771f74 tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:02 devstack sudo[96333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8 Nov 03 20:24:02 devstack sudo[96333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:02 devstack sudo[96330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_0d39iqfrdevstack@QuobyteHD Nov 03 20:24:02 devstack sudo[96330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:02 devstack sudo[96333]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b07955e6-cfef-4325-b97f-6f07e6771f74 tempest-VolumesDeleteCascade-1846270469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8" returned: 0 in 0.270s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:02 devstack sudo[96330]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:02 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b07955e6-cfef-4325-b97f-6f07e6771f74 tempest-VolumesDeleteCascade-1846270469 None] Lock "cinder-quobyte-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8" released by "delete_volume" :: held 1.122s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:24:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_0d39iqfrdevstack@QuobyteHD" returned: 0 in 0.383s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:02 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Temporary image 346de059-5b9a-438e-a6dd-24e9fc9a1ee3 is fetched for user 6393890961b440be8973d45f2f3c1e5b. {{(pid=87248) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 20:24:03 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-b07955e6-cfef-4325-b97f-6f07e6771f74 tempest-VolumesDeleteCascade-1846270469 None] Created reservations ['414f1504-6e2a-49a2-9470-aadd94b8eed3', '8da410ba-2200-4c5e-b4c7-b3b20ac73b3a', 'f199fef5-4b46-4319-890b-6305f9e99db3', '06907118-97c9-4e9b-916e-676f09eda6bc'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:24:03 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[06551846-ba19-4199-9982-472883d4e3fd]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_0d39iqfrdevstack@QuobyteHD {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b07955e6-cfef-4325-b97f-6f07e6771f74 tempest-VolumesDeleteCascade-1846270469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b07955e6-cfef-4325-b97f-6f07e6771f74 tempest-VolumesDeleteCascade-1846270469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:03 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-b07955e6-cfef-4325-b97f-6f07e6771f74 tempest-VolumesDeleteCascade-1846270469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:24:03 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-b07955e6-cfef-4325-b97f-6f07e6771f74 tempest-VolumesDeleteCascade-1846270469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:24:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b07955e6-cfef-4325-b97f-6f07e6771f74 tempest-VolumesDeleteCascade-1846270469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b07955e6-cfef-4325-b97f-6f07e6771f74 tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:03 devstack sudo[96341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:24:03 devstack sudo[96341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:03 devstack sudo[96340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_0d39iqfrdevstack@QuobyteHD Nov 03 20:24:03 devstack sudo[96340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:03 devstack sudo[96341]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b07955e6-cfef-4325-b97f-6f07e6771f74 tempest-VolumesDeleteCascade-1846270469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.256s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:03 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-b07955e6-cfef-4325-b97f-6f07e6771f74 tempest-VolumesDeleteCascade-1846270469 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:24:03 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-b07955e6-cfef-4325-b97f-6f07e6771f74 tempest-VolumesDeleteCascade-1846270469 None] Deleted volume successfully. Nov 03 20:24:03 devstack sudo[96340]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:03 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b07955e6-cfef-4325-b97f-6f07e6771f74 tempest-VolumesDeleteCascade-1846270469 None] Lock "cinder-e8fc9336-f8f7-40de-a3d7-5eeb7b7ab6a8-delete_volume" released by "delete_volume" :: held 4.948s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:24:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_0d39iqfrdevstack@QuobyteHD" returned: 0 in 0.416s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:03 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-992591705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ec6d265-44ea-4818-9aea-db1c07e12fa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d013d7604fd5471098e55a51eeb4a77c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:24:01Z,use_quota=True,user_id='6393890961b440be8973d45f2f3c1e5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:24:03 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Creating volume 1ec6d265-44ea-4818-9aea-db1c07e12fa3 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:24:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:03 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:24:03 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:24:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:03 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:24:03 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:24:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ec6d265-44ea-4818-9aea-db1c07e12fa3 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:03 devstack sudo[96348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ec6d265-44ea-4818-9aea-db1c07e12fa3 1073741824 Nov 03 20:24:03 devstack sudo[96348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:03 devstack sudo[96348]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ec6d265-44ea-4818-9aea-db1c07e12fa3 1073741824" returned: 0 in 0.475s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:04 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b47c12b8-ac61-4958-b7c9-50516e498e88 tempest-VolumesActionsTest-1174355871 None] Acquiring lock "cinder-e9d8b4ae-0951-4c93-90ec-3b2675940d6a" by "attach_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:24:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ec6d265-44ea-4818-9aea-db1c07e12fa3 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:04 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b47c12b8-ac61-4958-b7c9-50516e498e88 tempest-VolumesActionsTest-1174355871 None] Lock "cinder-e9d8b4ae-0951-4c93-90ec-3b2675940d6a" acquired by "attach_volume" :: waited 0.030s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:24:04 devstack sudo[96354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ec6d265-44ea-4818-9aea-db1c07e12fa3 Nov 03 20:24:04 devstack sudo[96354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:04 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-b47c12b8-ac61-4958-b7c9-50516e498e88 tempest-VolumesActionsTest-1174355871 None] Attaching volume e9d8b4ae-0951-4c93-90ec-3b2675940d6a to instance 4fce8b3b-9684-44a5-b9c0-8dc9eb0dbbab at mountpoint /dev/vdb on host None. Nov 03 20:24:04 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-b47c12b8-ac61-4958-b7c9-50516e498e88 tempest-VolumesActionsTest-1174355871 None] Attach volume completed successfully. Nov 03 20:24:04 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b47c12b8-ac61-4958-b7c9-50516e498e88 tempest-VolumesActionsTest-1174355871 None] Lock "cinder-e9d8b4ae-0951-4c93-90ec-3b2675940d6a" released by "attach_volume" :: held 0.130s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:24:04 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2791db92-a18d-4b5e-84d3-6d460d938da8 tempest-VolumesDeleteCascade-1846270469 None] Acquiring lock "cinder-3aac23b2-660e-414b-a754-2615d89bb958-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:24:04 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2791db92-a18d-4b5e-84d3-6d460d938da8 tempest-VolumesDeleteCascade-1846270469 None] Lock "cinder-3aac23b2-660e-414b-a754-2615d89bb958-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:24:04 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2791db92-a18d-4b5e-84d3-6d460d938da8 tempest-VolumesDeleteCascade-1846270469 None] Acquiring lock "cinder-quobyte-3aac23b2-660e-414b-a754-2615d89bb958" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:24:04 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2791db92-a18d-4b5e-84d3-6d460d938da8 tempest-VolumesDeleteCascade-1846270469 None] Lock "cinder-quobyte-3aac23b2-660e-414b-a754-2615d89bb958" acquired by "delete_volume" :: waited 0.021s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:24:04 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[678666de-b7b3-4d62-8372-c4f97cc6dd61]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2791db92-a18d-4b5e-84d3-6d460d938da8 tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3aac23b2-660e-414b-a754-2615d89bb958 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:04 devstack sudo[96354]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ec6d265-44ea-4818-9aea-db1c07e12fa3" returned: 0 in 0.450s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:04 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:24:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:04 devstack cinder-volume[87248]: DEBUG cinder.volume.volume_utils [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Attempting download of 346de059-5b9a-438e-a6dd-24e9fc9a1ee3 ((None, [{'url': 'file:///opt/stack/data/glance/images/346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'metadata': {}}])) to volume 1ec6d265-44ea-4818-9aea-db1c07e12fa3. {{(pid=87248) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 20:24:04 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[df692957-58a2-43f8-ae57-bd7650e56f63]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_346de059-5b9a-438e-a6dd-24e9fc9a1ee3__m21izwy {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:04 devstack sudo[96357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3aac23b2-660e-414b-a754-2615d89bb958 Nov 03 20:24:04 devstack sudo[96357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:04 devstack sudo[96358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_346de059-5b9a-438e-a6dd-24e9fc9a1ee3__m21izwy Nov 03 20:24:04 devstack sudo[96358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:04 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-87a44e6c-d4e7-4cc5-9fda-51832687a909 tempest-VolumesActionsTest-1174355871 None] Acquiring lock "cinder-e9d8b4ae-0951-4c93-90ec-3b2675940d6a-detach_volume" by "detach_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:24:04 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-87a44e6c-d4e7-4cc5-9fda-51832687a909 tempest-VolumesActionsTest-1174355871 None] Lock "cinder-e9d8b4ae-0951-4c93-90ec-3b2675940d6a-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:24:04 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-87a44e6c-d4e7-4cc5-9fda-51832687a909 tempest-VolumesActionsTest-1174355871 None] Detaching volume e9d8b4ae-0951-4c93-90ec-3b2675940d6a from instance 4fce8b3b-9684-44a5-b9c0-8dc9eb0dbbab. Nov 03 20:24:04 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-87a44e6c-d4e7-4cc5-9fda-51832687a909 tempest-VolumesActionsTest-1174355871 None] Detach volume completed successfully. Nov 03 20:24:04 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-87a44e6c-d4e7-4cc5-9fda-51832687a909 tempest-VolumesActionsTest-1174355871 None] Lock "cinder-e9d8b4ae-0951-4c93-90ec-3b2675940d6a-detach_volume" released by "detach_volume" :: held 0.093s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:24:04 devstack sudo[96358]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_346de059-5b9a-438e-a6dd-24e9fc9a1ee3__m21izwy" returned: 0 in 0.394s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_346de059-5b9a-438e-a6dd-24e9fc9a1ee3__m21izwy {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:05 devstack sudo[96357]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2791db92-a18d-4b5e-84d3-6d460d938da8 tempest-VolumesDeleteCascade-1846270469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3aac23b2-660e-414b-a754-2615d89bb958" returned: 0 in 0.546s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2791db92-a18d-4b5e-84d3-6d460d938da8 tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3aac23b2-660e-414b-a754-2615d89bb958 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:05 devstack sudo[96367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3aac23b2-660e-414b-a754-2615d89bb958 Nov 03 20:24:05 devstack sudo[96367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:05 devstack sudo[96366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_346de059-5b9a-438e-a6dd-24e9fc9a1ee3__m21izwy Nov 03 20:24:05 devstack sudo[96366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:05 devstack sudo[96367]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2791db92-a18d-4b5e-84d3-6d460d938da8 tempest-VolumesDeleteCascade-1846270469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3aac23b2-660e-414b-a754-2615d89bb958" returned: 0 in 0.331s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:05 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2791db92-a18d-4b5e-84d3-6d460d938da8 tempest-VolumesDeleteCascade-1846270469 None] Lock "cinder-quobyte-3aac23b2-660e-414b-a754-2615d89bb958" released by "delete_volume" :: held 0.968s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:24:05 devstack sudo[96366]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_346de059-5b9a-438e-a6dd-24e9fc9a1ee3__m21izwy" returned: 1 in 0.481s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_346de059-5b9a-438e-a6dd-24e9fc9a1ee3__m21izwy' failed. Not Retrying. {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 20:24:05 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff431ad-53d1-4767-9cbc-b920017f404d]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_0d39iqfrdevstack@QuobyteHD {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:05 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-2791db92-a18d-4b5e-84d3-6d460d938da8 tempest-VolumesDeleteCascade-1846270469 None] Created reservations ['cd4d94a3-0fad-4f57-9cdb-69caea8eac01', 'c20665e1-5f70-45a5-a981-35144e5987cd', '62e0e4ed-21da-4a4d-9bb4-8288c6af2c1e', '60cb4aa5-4fb2-4161-90ad-0cc544bd4d8e'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:24:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2791db92-a18d-4b5e-84d3-6d460d938da8 tempest-VolumesDeleteCascade-1846270469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2791db92-a18d-4b5e-84d3-6d460d938da8 tempest-VolumesDeleteCascade-1846270469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:05 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2791db92-a18d-4b5e-84d3-6d460d938da8 tempest-VolumesDeleteCascade-1846270469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:24:05 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2791db92-a18d-4b5e-84d3-6d460d938da8 tempest-VolumesDeleteCascade-1846270469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:24:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2791db92-a18d-4b5e-84d3-6d460d938da8 tempest-VolumesDeleteCascade-1846270469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2791db92-a18d-4b5e-84d3-6d460d938da8 tempest-VolumesDeleteCascade-1846270469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:05 devstack sudo[96375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_0d39iqfrdevstack@QuobyteHD Nov 03 20:24:05 devstack sudo[96375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:05 devstack sudo[96378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:24:05 devstack sudo[96378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:05 devstack sudo[96375]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_0d39iqfrdevstack@QuobyteHD" returned: 0 in 0.456s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:05 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] 346de059-5b9a-438e-a6dd-24e9fc9a1ee3 was qcow2, converting to qcow2 {{(pid=87248) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 20:24:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_0d39iqfrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ec6d265-44ea-4818-9aea-db1c07e12fa3 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:05 devstack sudo[96401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_0d39iqfrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ec6d265-44ea-4818-9aea-db1c07e12fa3 Nov 03 20:24:05 devstack sudo[96401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:06 devstack sudo[96378]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2791db92-a18d-4b5e-84d3-6d460d938da8 tempest-VolumesDeleteCascade-1846270469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.445s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:06 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-2791db92-a18d-4b5e-84d3-6d460d938da8 tempest-VolumesDeleteCascade-1846270469 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:24:06 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-2791db92-a18d-4b5e-84d3-6d460d938da8 tempest-VolumesDeleteCascade-1846270469 None] Deleted volume successfully. Nov 03 20:24:06 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2791db92-a18d-4b5e-84d3-6d460d938da8 tempest-VolumesDeleteCascade-1846270469 None] Lock "cinder-3aac23b2-660e-414b-a754-2615d89bb958-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:24:08 devstack sudo[96401]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_0d39iqfrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ec6d265-44ea-4818-9aea-db1c07e12fa3" returned: 0 in 2.315s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:08 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_0d39iqfrdevstack@QuobyteHD, size 112.00 MB, duration 2.32 sec, destination /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ec6d265-44ea-4818-9aea-db1c07e12fa3 {{(pid=87248) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:24:08 devstack cinder-volume[87248]: INFO cinder.image.image_utils [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Converted 112.00 MB image at 48.36 MB/s Nov 03 20:24:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ec6d265-44ea-4818-9aea-db1c07e12fa3 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:08 devstack sudo[96412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ec6d265-44ea-4818-9aea-db1c07e12fa3 1G Nov 03 20:24:08 devstack sudo[96412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:08 devstack sudo[96412]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ec6d265-44ea-4818-9aea-db1c07e12fa3 1G" returned: 0 in 0.402s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:08 devstack cinder-volume[87248]: DEBUG cinder.volume.volume_utils [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Downloaded image 346de059-5b9a-438e-a6dd-24e9fc9a1ee3 ((None, [{'url': 'file:///opt/stack/data/glance/images/346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'metadata': {}}])) to volume 1ec6d265-44ea-4818-9aea-db1c07e12fa3 successfully. {{(pid=87248) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 20:24:08 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Temporary image 346de059-5b9a-438e-a6dd-24e9fc9a1ee3 for user 6393890961b440be8973d45f2f3c1e5b is deleted. {{(pid=87248) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 20:24:08 devstack cinder-volume[87248]: DEBUG cinder.volume.volume_utils [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Marking volume 1ec6d265-44ea-4818-9aea-db1c07e12fa3 as bootable. {{(pid=87248) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 20:24:08 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Copying metadata from image 346de059-5b9a-438e-a6dd-24e9fc9a1ee3 to 1ec6d265-44ea-4818-9aea-db1c07e12fa3. {{(pid=87248) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 20:24:08 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Creating volume glance metadata for volume 1ec6d265-44ea-4818-9aea-db1c07e12fa3 backed by image 346de059-5b9a-438e-a6dd-24e9fc9a1ee3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87248) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 20:24:08 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c7d9b3f-48f9-482a-b72c-4092354dc0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ec6d265-44ea-4818-9aea-db1c07e12fa3', 'volume_size': 1, 'image_id': '346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a647f64245a54dad95167f6d04c75eaa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'created_at': datetime.datetime(2026, 11, 3, 19, 11, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 11, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/346de059-5b9a-438e-a6dd-24e9fc9a1ee3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:08 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6ad0da9-bc77-434a-9593-8ac1415bb23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:08 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Volume volume-1ec6d265-44ea-4818-9aea-db1c07e12fa3 (1ec6d265-44ea-4818-9aea-db1c07e12fa3): created successfully Nov 03 20:24:08 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6ad0da9-bc77-434a-9593-8ac1415bb23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:08 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Flow 'volume_create_manager' (fa932e75-22db-4337-b063-35e9c685bafe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:24:08 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-8ddc2679-66a9-4481-92d5-411ce8fb4e41 tempest-VolumesImageMetadata-510734594 None] Created volume successfully. Nov 03 20:24:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-de29bd44-3383-47f1-88e4-7010c0579b1b tempest-VolumesActionsTest-1174355871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-de29bd44-3383-47f1-88e4-7010c0579b1b tempest-VolumesActionsTest-1174355871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:09 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a1de32-e97a-44de-8c96-686dde2afbc1]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-de29bd44-3383-47f1-88e4-7010c0579b1b tempest-VolumesActionsTest-1174355871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e9d8b4ae-0951-4c93-90ec-3b2675940d6a {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:09 devstack sudo[96417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e9d8b4ae-0951-4c93-90ec-3b2675940d6a Nov 03 20:24:09 devstack sudo[96417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:10 devstack sudo[96417]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-de29bd44-3383-47f1-88e4-7010c0579b1b tempest-VolumesActionsTest-1174355871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e9d8b4ae-0951-4c93-90ec-3b2675940d6a" returned: 0 in 0.412s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:10 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba63882-e338-404a-a9a8-aa06d5661607]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-de29bd44-3383-47f1-88e4-7010c0579b1b tempest-VolumesActionsTest-1174355871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e9d8b4ae-0951-4c93-90ec-3b2675940d6a {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:10 devstack sudo[96422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e9d8b4ae-0951-4c93-90ec-3b2675940d6a Nov 03 20:24:10 devstack sudo[96422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:10 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7a4559f6-70fa-411a-aa11-2494c59c9a7b tempest-VolumesImageMetadata-510734594 None] Acquiring lock "cinder-1ec6d265-44ea-4818-9aea-db1c07e12fa3-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:24:10 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7a4559f6-70fa-411a-aa11-2494c59c9a7b tempest-VolumesImageMetadata-510734594 None] Lock "cinder-1ec6d265-44ea-4818-9aea-db1c07e12fa3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:24:10 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7a4559f6-70fa-411a-aa11-2494c59c9a7b tempest-VolumesImageMetadata-510734594 None] Acquiring lock "cinder-quobyte-1ec6d265-44ea-4818-9aea-db1c07e12fa3" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:24:10 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7a4559f6-70fa-411a-aa11-2494c59c9a7b tempest-VolumesImageMetadata-510734594 None] Lock "cinder-quobyte-1ec6d265-44ea-4818-9aea-db1c07e12fa3" acquired by "delete_volume" :: waited 0.018s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:24:10 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[609d2a1a-2948-4261-8b29-91328cfb7038]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7a4559f6-70fa-411a-aa11-2494c59c9a7b tempest-VolumesImageMetadata-510734594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ec6d265-44ea-4818-9aea-db1c07e12fa3 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:10 devstack sudo[96422]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-de29bd44-3383-47f1-88e4-7010c0579b1b tempest-VolumesActionsTest-1174355871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e9d8b4ae-0951-4c93-90ec-3b2675940d6a" returned: 0 in 0.429s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-de29bd44-3383-47f1-88e4-7010c0579b1b tempest-VolumesActionsTest-1174355871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e9d8b4ae-0951-4c93-90ec-3b2675940d6a /opt/stack/data/cinder/conversion/e9d8b4ae-0951-4c93-90ec-3b2675940d6a.temp_image.e57ffe83-5662-4059-a70c-dfa6e5b5fbd6tgs45ti9.img {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:10 devstack sudo[96428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e9d8b4ae-0951-4c93-90ec-3b2675940d6a /opt/stack/data/cinder/conversion/e9d8b4ae-0951-4c93-90ec-3b2675940d6a.temp_image.e57ffe83-5662-4059-a70c-dfa6e5b5fbd6tgs45ti9.img Nov 03 20:24:10 devstack sudo[96428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:10 devstack sudo[96426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ec6d265-44ea-4818-9aea-db1c07e12fa3 Nov 03 20:24:10 devstack sudo[96426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:10 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc97e34a-9cd0-4b83-ae71-4355656a6478 tempest-VolumesMetadataTest-1077152343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:24:10 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-fc97e34a-9cd0-4b83-ae71-4355656a6478 tempest-VolumesMetadataTest-1077152343 None] Flow 'volume_create_manager' (a12fc883-d33f-422a-9414-e4fe0ac68a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:24:10 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-fc97e34a-9cd0-4b83-ae71-4355656a6478 tempest-VolumesMetadataTest-1077152343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (530380a9-c556-4f22-b929-e89e8b3c92e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:10 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-fc97e34a-9cd0-4b83-ae71-4355656a6478 tempest-VolumesMetadataTest-1077152343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (530380a9-c556-4f22-b929-e89e8b3c92e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-566370252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa961c1f-0783-4964-a9e8-f90bb3d7bd54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b885e4049724aa2b2f320954d3ae243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:24:11Z,use_quota=True,user_id='20f194e3b30c4299ba0ef2b98c0ddca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:10 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-fc97e34a-9cd0-4b83-ae71-4355656a6478 tempest-VolumesMetadataTest-1077152343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e9e228b-f3ed-466a-90ee-799655e119c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:10 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-fc97e34a-9cd0-4b83-ae71-4355656a6478 tempest-VolumesMetadataTest-1077152343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e9e228b-f3ed-466a-90ee-799655e119c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:10 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-fc97e34a-9cd0-4b83-ae71-4355656a6478 tempest-VolumesMetadataTest-1077152343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5227ea1-2d12-4e50-ba11-352fe7ce6855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:10 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-fc97e34a-9cd0-4b83-ae71-4355656a6478 tempest-VolumesMetadataTest-1077152343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5227ea1-2d12-4e50-ba11-352fe7ce6855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa961c1f-0783-4964-a9e8-f90bb3d7bd54', 'volume_name': 'volume-fa961c1f-0783-4964-a9e8-f90bb3d7bd54', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:10 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-fc97e34a-9cd0-4b83-ae71-4355656a6478 tempest-VolumesMetadataTest-1077152343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d899b74-9fcf-4cc9-b0a8-b065ac198039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:10 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-fc97e34a-9cd0-4b83-ae71-4355656a6478 tempest-VolumesMetadataTest-1077152343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d899b74-9fcf-4cc9-b0a8-b065ac198039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:10 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-fc97e34a-9cd0-4b83-ae71-4355656a6478 tempest-VolumesMetadataTest-1077152343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a399a8d9-cc63-44d8-a068-380b8cb88f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:10 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-fc97e34a-9cd0-4b83-ae71-4355656a6478 tempest-VolumesMetadataTest-1077152343 None] Volume fa961c1f-0783-4964-a9e8-f90bb3d7bd54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa961c1f-0783-4964-a9e8-f90bb3d7bd54', 'volume_size': 1} Nov 03 20:24:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-fc97e34a-9cd0-4b83-ae71-4355656a6478 tempest-VolumesMetadataTest-1077152343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:10 devstack sudo[96426]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7a4559f6-70fa-411a-aa11-2494c59c9a7b tempest-VolumesImageMetadata-510734594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ec6d265-44ea-4818-9aea-db1c07e12fa3" returned: 0 in 0.476s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7a4559f6-70fa-411a-aa11-2494c59c9a7b tempest-VolumesImageMetadata-510734594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ec6d265-44ea-4818-9aea-db1c07e12fa3 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:11 devstack sudo[96443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ec6d265-44ea-4818-9aea-db1c07e12fa3 Nov 03 20:24:11 devstack sudo[96443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:11 devstack sudo[96443]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7a4559f6-70fa-411a-aa11-2494c59c9a7b tempest-VolumesImageMetadata-510734594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1ec6d265-44ea-4818-9aea-db1c07e12fa3" returned: 0 in 0.577s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:11 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7a4559f6-70fa-411a-aa11-2494c59c9a7b tempest-VolumesImageMetadata-510734594 None] Lock "cinder-quobyte-1ec6d265-44ea-4818-9aea-db1c07e12fa3" released by "delete_volume" :: held 1.110s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:24:11 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-7a4559f6-70fa-411a-aa11-2494c59c9a7b tempest-VolumesImageMetadata-510734594 None] Created reservations ['1b39ecbe-13d0-4689-b0d9-fbe382bf49ed', '836d837f-b258-47e7-b513-f69421cdb7bf', 'f77046c6-76a4-49ec-8db2-88b82ff0cab1', '43a5e46d-53a5-454b-ba1b-faf9a1b6bf01'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:24:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7a4559f6-70fa-411a-aa11-2494c59c9a7b tempest-VolumesImageMetadata-510734594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7a4559f6-70fa-411a-aa11-2494c59c9a7b tempest-VolumesImageMetadata-510734594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:11 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-7a4559f6-70fa-411a-aa11-2494c59c9a7b tempest-VolumesImageMetadata-510734594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:24:11 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-7a4559f6-70fa-411a-aa11-2494c59c9a7b tempest-VolumesImageMetadata-510734594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:24:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7a4559f6-70fa-411a-aa11-2494c59c9a7b tempest-VolumesImageMetadata-510734594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7a4559f6-70fa-411a-aa11-2494c59c9a7b tempest-VolumesImageMetadata-510734594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:11 devstack sudo[96449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:24:11 devstack sudo[96449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:12 devstack sudo[96449]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7a4559f6-70fa-411a-aa11-2494c59c9a7b tempest-VolumesImageMetadata-510734594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.301s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:12 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-7a4559f6-70fa-411a-aa11-2494c59c9a7b tempest-VolumesImageMetadata-510734594 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:24:12 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-7a4559f6-70fa-411a-aa11-2494c59c9a7b tempest-VolumesImageMetadata-510734594 None] Deleted volume successfully. Nov 03 20:24:12 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7a4559f6-70fa-411a-aa11-2494c59c9a7b tempest-VolumesImageMetadata-510734594 None] Lock "cinder-1ec6d265-44ea-4818-9aea-db1c07e12fa3-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:24:15 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-15113cdf-b1dd-4b5d-ad8c-65463733a7d8 req-8f8dbb56-3686-43e0-b9b8-fcc25e044326 tempest-AttachVolumeTestJSON-1951495544 None] Terminate volume connection completed successfully. Nov 03 20:24:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-15113cdf-b1dd-4b5d-ad8c-65463733a7d8 req-8f8dbb56-3686-43e0-b9b8-fcc25e044326 tempest-AttachVolumeTestJSON-1951495544 None] Deleting attachment 8d4f79ee-805c-440f-a944-36552b9cdc31. {{(pid=87248) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 20:24:18 devstack sudo[96428]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-de29bd44-3383-47f1-88e4-7010c0579b1b tempest-VolumesActionsTest-1174355871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e9d8b4ae-0951-4c93-90ec-3b2675940d6a /opt/stack/data/cinder/conversion/e9d8b4ae-0951-4c93-90ec-3b2675940d6a.temp_image.e57ffe83-5662-4059-a70c-dfa6e5b5fbd6tgs45ti9.img" returned: 0 in 7.529s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:18 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6dc19a-0c4a-4780-b000-1d6771190bbe]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-de29bd44-3383-47f1-88e4-7010c0579b1b tempest-VolumesActionsTest-1174355871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e9d8b4ae-0951-4c93-90ec-3b2675940d6a {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:18 devstack sudo[96467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e9d8b4ae-0951-4c93-90ec-3b2675940d6a Nov 03 20:24:18 devstack sudo[96467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:18 devstack sudo[96467]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-de29bd44-3383-47f1-88e4-7010c0579b1b tempest-VolumesActionsTest-1174355871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e9d8b4ae-0951-4c93-90ec-3b2675940d6a" returned: 0 in 0.649s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:18 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-de29bd44-3383-47f1-88e4-7010c0579b1b tempest-VolumesActionsTest-1174355871 None] Image conversion details: src /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e9d8b4ae-0951-4c93-90ec-3b2675940d6a, size 1024.00 MB, duration 7.53 sec, destination /opt/stack/data/cinder/conversion/e9d8b4ae-0951-4c93-90ec-3b2675940d6a.temp_image.e57ffe83-5662-4059-a70c-dfa6e5b5fbd6tgs45ti9.img {{(pid=87248) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:24:18 devstack cinder-volume[87248]: INFO cinder.image.image_utils [None req-de29bd44-3383-47f1-88e4-7010c0579b1b tempest-VolumesActionsTest-1174355871 None] Converted 1024.00 MB image at 135.98 MB/s Nov 03 20:24:18 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-de29bd44-3383-47f1-88e4-7010c0579b1b tempest-VolumesActionsTest-1174355871 None] e57ffe83-5662-4059-a70c-dfa6e5b5fbd6 was raw, no need to convert to raw {{(pid=87248) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 03 20:24:20 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-a15bf2ad-6fd3-45be-8767-fe79d2d1e02d tempest-AbsoluteLimitsTests-402285673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:24:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a15bf2ad-6fd3-45be-8767-fe79d2d1e02d tempest-AbsoluteLimitsTests-402285673 None] Flow 'volume_create_manager' (5747ddf3-9b38-41ea-bae9-9d0367a6d2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:24:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a15bf2ad-6fd3-45be-8767-fe79d2d1e02d tempest-AbsoluteLimitsTests-402285673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ea19db8-9f69-4b41-8472-5119d096cb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a15bf2ad-6fd3-45be-8767-fe79d2d1e02d tempest-AbsoluteLimitsTests-402285673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ea19db8-9f69-4b41-8472-5119d096cb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:24:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-902668739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09467876-24d9-4233-b7ca-4685adda32fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9989e97da6574e59a70b040571bd1845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:24:20Z,use_quota=True,user_id='83fc094663d4476a82af28cfe4a02c71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a15bf2ad-6fd3-45be-8767-fe79d2d1e02d tempest-AbsoluteLimitsTests-402285673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37792e75-ad1b-42f0-b5ce-65f8245dc7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a15bf2ad-6fd3-45be-8767-fe79d2d1e02d tempest-AbsoluteLimitsTests-402285673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37792e75-ad1b-42f0-b5ce-65f8245dc7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a15bf2ad-6fd3-45be-8767-fe79d2d1e02d tempest-AbsoluteLimitsTests-402285673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de082f03-961d-4d51-88a1-69520b4423a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a15bf2ad-6fd3-45be-8767-fe79d2d1e02d tempest-AbsoluteLimitsTests-402285673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de082f03-961d-4d51-88a1-69520b4423a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09467876-24d9-4233-b7ca-4685adda32fa', 'volume_name': 'volume-09467876-24d9-4233-b7ca-4685adda32fa', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a15bf2ad-6fd3-45be-8767-fe79d2d1e02d tempest-AbsoluteLimitsTests-402285673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67648062-67c1-4af6-a5fa-d2172ff43c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a15bf2ad-6fd3-45be-8767-fe79d2d1e02d tempest-AbsoluteLimitsTests-402285673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67648062-67c1-4af6-a5fa-d2172ff43c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a15bf2ad-6fd3-45be-8767-fe79d2d1e02d tempest-AbsoluteLimitsTests-402285673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a77e54f2-1a78-495a-bd39-2e702aab00a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:20 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-a15bf2ad-6fd3-45be-8767-fe79d2d1e02d tempest-AbsoluteLimitsTests-402285673 None] Volume 09467876-24d9-4233-b7ca-4685adda32fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09467876-24d9-4233-b7ca-4685adda32fa', 'volume_size': 1} Nov 03 20:24:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a15bf2ad-6fd3-45be-8767-fe79d2d1e02d tempest-AbsoluteLimitsTests-402285673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:28 devstack cinder-volume[87248]: DEBUG oslo_service.periodic_task [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:24:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:24:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:24:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:28 devstack sudo[96571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:24:28 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:29 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.311s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:29 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:24:29 devstack cinder-volume[87248]: DEBUG oslo_service.periodic_task [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running periodic task VolumeManager._thread_info {{(pid=87248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:24:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] thread count: 28 {{(pid=87248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:24:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] thread info: [<_MainThread(MainThread, started 124862067372160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:24:30 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:SELECT=46,cinder:INSERT=12,cinder:UPDATE=30 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:24:30 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:SELECT=32,cinder:INSERT=20,cinder:UPDATE=45,cinder:DELETE=4 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:24:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-de29bd44-3383-47f1-88e4-7010c0579b1b tempest-VolumesActionsTest-1174355871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.211s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:39 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-de29bd44-3383-47f1-88e4-7010c0579b1b tempest-VolumesActionsTest-1174355871 None] Uploaded volume to glance image-id: e57ffe83-5662-4059-a70c-dfa6e5b5fbd6. {{(pid=87248) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 03 20:24:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-fc97e34a-9cd0-4b83-ae71-4355656a6478 tempest-VolumesMetadataTest-1077152343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 28.975s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:39 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-fc97e34a-9cd0-4b83-ae71-4355656a6478 tempest-VolumesMetadataTest-1077152343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-566370252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa961c1f-0783-4964-a9e8-f90bb3d7bd54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b885e4049724aa2b2f320954d3ae243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:24:11Z,use_quota=True,user_id='20f194e3b30c4299ba0ef2b98c0ddca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:24:39 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-fc97e34a-9cd0-4b83-ae71-4355656a6478 tempest-VolumesMetadataTest-1077152343 None] Creating volume fa961c1f-0783-4964-a9e8-f90bb3d7bd54 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:24:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-fc97e34a-9cd0-4b83-ae71-4355656a6478 tempest-VolumesMetadataTest-1077152343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-fc97e34a-9cd0-4b83-ae71-4355656a6478 tempest-VolumesMetadataTest-1077152343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:39 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-fc97e34a-9cd0-4b83-ae71-4355656a6478 tempest-VolumesMetadataTest-1077152343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:24:39 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-fc97e34a-9cd0-4b83-ae71-4355656a6478 tempest-VolumesMetadataTest-1077152343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:24:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-fc97e34a-9cd0-4b83-ae71-4355656a6478 tempest-VolumesMetadataTest-1077152343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:39 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-fc97e34a-9cd0-4b83-ae71-4355656a6478 tempest-VolumesMetadataTest-1077152343 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:24:39 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-fc97e34a-9cd0-4b83-ae71-4355656a6478 tempest-VolumesMetadataTest-1077152343 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:24:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fc97e34a-9cd0-4b83-ae71-4355656a6478 tempest-VolumesMetadataTest-1077152343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-fa961c1f-0783-4964-a9e8-f90bb3d7bd54 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:39 devstack sudo[96578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-fa961c1f-0783-4964-a9e8-f90bb3d7bd54 1073741824 Nov 03 20:24:39 devstack sudo[96578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:39 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-de29bd44-3383-47f1-88e4-7010c0579b1b tempest-VolumesActionsTest-1174355871 None] Copy volume to image completed successfully. Nov 03 20:24:40 devstack sudo[96578]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fc97e34a-9cd0-4b83-ae71-4355656a6478 tempest-VolumesMetadataTest-1077152343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-fa961c1f-0783-4964-a9e8-f90bb3d7bd54 1073741824" returned: 0 in 0.445s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fc97e34a-9cd0-4b83-ae71-4355656a6478 tempest-VolumesMetadataTest-1077152343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-fa961c1f-0783-4964-a9e8-f90bb3d7bd54 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:40 devstack sudo[96584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-fa961c1f-0783-4964-a9e8-f90bb3d7bd54 Nov 03 20:24:40 devstack sudo[96584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:40 devstack sudo[96584]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fc97e34a-9cd0-4b83-ae71-4355656a6478 tempest-VolumesMetadataTest-1077152343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-fa961c1f-0783-4964-a9e8-f90bb3d7bd54" returned: 0 in 0.255s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:40 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-fc97e34a-9cd0-4b83-ae71-4355656a6478 tempest-VolumesMetadataTest-1077152343 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:24:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-fc97e34a-9cd0-4b83-ae71-4355656a6478 tempest-VolumesMetadataTest-1077152343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a15bf2ad-6fd3-45be-8767-fe79d2d1e02d tempest-AbsoluteLimitsTests-402285673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.133s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:40 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a15bf2ad-6fd3-45be-8767-fe79d2d1e02d tempest-AbsoluteLimitsTests-402285673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:24:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-902668739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09467876-24d9-4233-b7ca-4685adda32fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9989e97da6574e59a70b040571bd1845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:24:20Z,use_quota=True,user_id='83fc094663d4476a82af28cfe4a02c71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:24:40 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-a15bf2ad-6fd3-45be-8767-fe79d2d1e02d tempest-AbsoluteLimitsTests-402285673 None] Creating volume 09467876-24d9-4233-b7ca-4685adda32fa {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:24:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a15bf2ad-6fd3-45be-8767-fe79d2d1e02d tempest-AbsoluteLimitsTests-402285673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a15bf2ad-6fd3-45be-8767-fe79d2d1e02d tempest-AbsoluteLimitsTests-402285673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:40 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a15bf2ad-6fd3-45be-8767-fe79d2d1e02d tempest-AbsoluteLimitsTests-402285673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:24:40 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a15bf2ad-6fd3-45be-8767-fe79d2d1e02d tempest-AbsoluteLimitsTests-402285673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:24:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a15bf2ad-6fd3-45be-8767-fe79d2d1e02d tempest-AbsoluteLimitsTests-402285673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:40 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a15bf2ad-6fd3-45be-8767-fe79d2d1e02d tempest-AbsoluteLimitsTests-402285673 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:24:40 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-a15bf2ad-6fd3-45be-8767-fe79d2d1e02d tempest-AbsoluteLimitsTests-402285673 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:24:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a15bf2ad-6fd3-45be-8767-fe79d2d1e02d tempest-AbsoluteLimitsTests-402285673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-09467876-24d9-4233-b7ca-4685adda32fa 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:40 devstack sudo[96587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-09467876-24d9-4233-b7ca-4685adda32fa 1073741824 Nov 03 20:24:40 devstack sudo[96587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:40 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-fc97e34a-9cd0-4b83-ae71-4355656a6478 tempest-VolumesMetadataTest-1077152343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a399a8d9-cc63-44d8-a068-380b8cb88f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa961c1f-0783-4964-a9e8-f90bb3d7bd54', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:40 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-fc97e34a-9cd0-4b83-ae71-4355656a6478 tempest-VolumesMetadataTest-1077152343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (252e0190-5978-436a-8b85-ceae65d3e1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:40 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-fc97e34a-9cd0-4b83-ae71-4355656a6478 tempest-VolumesMetadataTest-1077152343 None] Volume volume-fa961c1f-0783-4964-a9e8-f90bb3d7bd54 (fa961c1f-0783-4964-a9e8-f90bb3d7bd54): created successfully Nov 03 20:24:40 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-fc97e34a-9cd0-4b83-ae71-4355656a6478 tempest-VolumesMetadataTest-1077152343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (252e0190-5978-436a-8b85-ceae65d3e1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:40 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-fc97e34a-9cd0-4b83-ae71-4355656a6478 tempest-VolumesMetadataTest-1077152343 None] Flow 'volume_create_manager' (a12fc883-d33f-422a-9414-e4fe0ac68a9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:24:40 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-fc97e34a-9cd0-4b83-ae71-4355656a6478 tempest-VolumesMetadataTest-1077152343 None] Created volume successfully. Nov 03 20:24:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-abcfeca9-e1a3-4844-80df-bef8a6f59c8d tempest-VolumesActionsTest-1174355871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:41 devstack sudo[96587]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a15bf2ad-6fd3-45be-8767-fe79d2d1e02d tempest-AbsoluteLimitsTests-402285673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-09467876-24d9-4233-b7ca-4685adda32fa 1073741824" returned: 0 in 0.481s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a15bf2ad-6fd3-45be-8767-fe79d2d1e02d tempest-AbsoluteLimitsTests-402285673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-09467876-24d9-4233-b7ca-4685adda32fa {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:41 devstack sudo[96593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-09467876-24d9-4233-b7ca-4685adda32fa Nov 03 20:24:41 devstack sudo[96593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:41 devstack sudo[96593]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a15bf2ad-6fd3-45be-8767-fe79d2d1e02d tempest-AbsoluteLimitsTests-402285673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-09467876-24d9-4233-b7ca-4685adda32fa" returned: 0 in 0.276s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:41 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a15bf2ad-6fd3-45be-8767-fe79d2d1e02d tempest-AbsoluteLimitsTests-402285673 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:24:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a15bf2ad-6fd3-45be-8767-fe79d2d1e02d tempest-AbsoluteLimitsTests-402285673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-abcfeca9-e1a3-4844-80df-bef8a6f59c8d tempest-VolumesActionsTest-1174355871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.516s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:41 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a15bf2ad-6fd3-45be-8767-fe79d2d1e02d tempest-AbsoluteLimitsTests-402285673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a77e54f2-1a78-495a-bd39-2e702aab00a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09467876-24d9-4233-b7ca-4685adda32fa', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:41 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a15bf2ad-6fd3-45be-8767-fe79d2d1e02d tempest-AbsoluteLimitsTests-402285673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ccad648-15ce-4b7b-90c8-0dc3e47fe99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:41 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdcfd1a7-a369-4d50-89f2-d1360e215c5e]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-abcfeca9-e1a3-4844-80df-bef8a6f59c8d tempest-VolumesActionsTest-1174355871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e9d8b4ae-0951-4c93-90ec-3b2675940d6a {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:41 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-a15bf2ad-6fd3-45be-8767-fe79d2d1e02d tempest-AbsoluteLimitsTests-402285673 None] Volume volume-09467876-24d9-4233-b7ca-4685adda32fa (09467876-24d9-4233-b7ca-4685adda32fa): created successfully Nov 03 20:24:41 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a15bf2ad-6fd3-45be-8767-fe79d2d1e02d tempest-AbsoluteLimitsTests-402285673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ccad648-15ce-4b7b-90c8-0dc3e47fe99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:41 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a15bf2ad-6fd3-45be-8767-fe79d2d1e02d tempest-AbsoluteLimitsTests-402285673 None] Flow 'volume_create_manager' (5747ddf3-9b38-41ea-bae9-9d0367a6d2d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:24:41 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-a15bf2ad-6fd3-45be-8767-fe79d2d1e02d tempest-AbsoluteLimitsTests-402285673 None] Created volume successfully. Nov 03 20:24:41 devstack sudo[96596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e9d8b4ae-0951-4c93-90ec-3b2675940d6a Nov 03 20:24:41 devstack sudo[96596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:41 devstack sudo[96596]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-abcfeca9-e1a3-4844-80df-bef8a6f59c8d tempest-VolumesActionsTest-1174355871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e9d8b4ae-0951-4c93-90ec-3b2675940d6a" returned: 0 in 0.502s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:42 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b39d167a-bba5-415f-9571-0b91566c612b tempest-AbsoluteLimitsTests-402285673 None] Acquiring lock "cinder-09467876-24d9-4233-b7ca-4685adda32fa-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:24:42 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c9ffae-2761-4a8a-9d9f-56946094fc82]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-abcfeca9-e1a3-4844-80df-bef8a6f59c8d tempest-VolumesActionsTest-1174355871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e9d8b4ae-0951-4c93-90ec-3b2675940d6a {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:42 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b39d167a-bba5-415f-9571-0b91566c612b tempest-AbsoluteLimitsTests-402285673 None] Lock "cinder-09467876-24d9-4233-b7ca-4685adda32fa-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:24:42 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b39d167a-bba5-415f-9571-0b91566c612b tempest-AbsoluteLimitsTests-402285673 None] Acquiring lock "cinder-quobyte-09467876-24d9-4233-b7ca-4685adda32fa" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:24:42 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b39d167a-bba5-415f-9571-0b91566c612b tempest-AbsoluteLimitsTests-402285673 None] Lock "cinder-quobyte-09467876-24d9-4233-b7ca-4685adda32fa" acquired by "delete_volume" :: waited 0.028s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:24:42 devstack sudo[96602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e9d8b4ae-0951-4c93-90ec-3b2675940d6a Nov 03 20:24:42 devstack sudo[96602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:42 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a92d90-ce5b-4071-b015-05b53ef320dd]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b39d167a-bba5-415f-9571-0b91566c612b tempest-AbsoluteLimitsTests-402285673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-09467876-24d9-4233-b7ca-4685adda32fa {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:42 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-bf918afd-9a9f-4fbd-89eb-77b98a064e4a tempest-VolumesMetadataTest-1077152343 None] Acquiring lock "cinder-fa961c1f-0783-4964-a9e8-f90bb3d7bd54-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:24:42 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-bf918afd-9a9f-4fbd-89eb-77b98a064e4a tempest-VolumesMetadataTest-1077152343 None] Lock "cinder-fa961c1f-0783-4964-a9e8-f90bb3d7bd54-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:24:42 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-bf918afd-9a9f-4fbd-89eb-77b98a064e4a tempest-VolumesMetadataTest-1077152343 None] Acquiring lock "cinder-quobyte-fa961c1f-0783-4964-a9e8-f90bb3d7bd54" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:24:42 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-bf918afd-9a9f-4fbd-89eb-77b98a064e4a tempest-VolumesMetadataTest-1077152343 None] Lock "cinder-quobyte-fa961c1f-0783-4964-a9e8-f90bb3d7bd54" acquired by "delete_volume" :: waited 0.034s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:24:42 devstack sudo[96604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-09467876-24d9-4233-b7ca-4685adda32fa Nov 03 20:24:42 devstack sudo[96604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:42 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[5486efef-290e-4fe9-8768-c90bb61ff379]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-bf918afd-9a9f-4fbd-89eb-77b98a064e4a tempest-VolumesMetadataTest-1077152343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-fa961c1f-0783-4964-a9e8-f90bb3d7bd54 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:42 devstack sudo[96602]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-abcfeca9-e1a3-4844-80df-bef8a6f59c8d tempest-VolumesActionsTest-1174355871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e9d8b4ae-0951-4c93-90ec-3b2675940d6a" returned: 0 in 0.561s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-abcfeca9-e1a3-4844-80df-bef8a6f59c8d tempest-VolumesActionsTest-1174355871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e9d8b4ae-0951-4c93-90ec-3b2675940d6a /opt/stack/data/cinder/conversion/e9d8b4ae-0951-4c93-90ec-3b2675940d6a.temp_image.cab8b4f6-8e45-4e88-aed1-40dff14e39fesgum3l9s.img {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:42 devstack sudo[96612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e9d8b4ae-0951-4c93-90ec-3b2675940d6a /opt/stack/data/cinder/conversion/e9d8b4ae-0951-4c93-90ec-3b2675940d6a.temp_image.cab8b4f6-8e45-4e88-aed1-40dff14e39fesgum3l9s.img Nov 03 20:24:42 devstack sudo[96612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:42 devstack sudo[96610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-fa961c1f-0783-4964-a9e8-f90bb3d7bd54 Nov 03 20:24:42 devstack sudo[96610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:42 devstack sudo[96604]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b39d167a-bba5-415f-9571-0b91566c612b tempest-AbsoluteLimitsTests-402285673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-09467876-24d9-4233-b7ca-4685adda32fa" returned: 0 in 0.590s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b39d167a-bba5-415f-9571-0b91566c612b tempest-AbsoluteLimitsTests-402285673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-09467876-24d9-4233-b7ca-4685adda32fa {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:42 devstack sudo[96619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-09467876-24d9-4233-b7ca-4685adda32fa Nov 03 20:24:42 devstack sudo[96619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:43 devstack sudo[96610]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-bf918afd-9a9f-4fbd-89eb-77b98a064e4a tempest-VolumesMetadataTest-1077152343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-fa961c1f-0783-4964-a9e8-f90bb3d7bd54" returned: 0 in 0.529s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-bf918afd-9a9f-4fbd-89eb-77b98a064e4a tempest-VolumesMetadataTest-1077152343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-fa961c1f-0783-4964-a9e8-f90bb3d7bd54 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:43 devstack sudo[96634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-fa961c1f-0783-4964-a9e8-f90bb3d7bd54 Nov 03 20:24:43 devstack sudo[96634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:43 devstack sudo[96619]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b39d167a-bba5-415f-9571-0b91566c612b tempest-AbsoluteLimitsTests-402285673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-09467876-24d9-4233-b7ca-4685adda32fa" returned: 0 in 0.503s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:43 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b39d167a-bba5-415f-9571-0b91566c612b tempest-AbsoluteLimitsTests-402285673 None] Lock "cinder-quobyte-09467876-24d9-4233-b7ca-4685adda32fa" released by "delete_volume" :: held 1.199s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:24:43 devstack sudo[96634]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-bf918afd-9a9f-4fbd-89eb-77b98a064e4a tempest-VolumesMetadataTest-1077152343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-fa961c1f-0783-4964-a9e8-f90bb3d7bd54" returned: 0 in 0.521s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:43 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-bf918afd-9a9f-4fbd-89eb-77b98a064e4a tempest-VolumesMetadataTest-1077152343 None] Lock "cinder-quobyte-fa961c1f-0783-4964-a9e8-f90bb3d7bd54" released by "delete_volume" :: held 1.183s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:24:43 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-b39d167a-bba5-415f-9571-0b91566c612b tempest-AbsoluteLimitsTests-402285673 None] Created reservations ['919ee590-ce53-4ced-a33b-f336c607cf19', '798e3ed8-1313-4460-b7aa-ca0b0d459d31', 'f00ff0ac-8da5-4160-aa62-c4e025680dff', 'cf09e32a-f23f-48d4-8456-0b3013b5d260'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:24:43 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-bf918afd-9a9f-4fbd-89eb-77b98a064e4a tempest-VolumesMetadataTest-1077152343 None] Created reservations ['0b7fa9c1-0514-4375-9e4d-bd99b75f2e23', '30f57c76-28cc-4cc4-b9ab-91ac270d6c07', 'b3b7dcd4-985e-4491-9eae-7fe441a9cb40', 'e5d878d7-2769-45b4-9631-a0aa55bb4d29'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:24:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b39d167a-bba5-415f-9571-0b91566c612b tempest-AbsoluteLimitsTests-402285673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b39d167a-bba5-415f-9571-0b91566c612b tempest-AbsoluteLimitsTests-402285673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:43 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-b39d167a-bba5-415f-9571-0b91566c612b tempest-AbsoluteLimitsTests-402285673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:24:43 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-b39d167a-bba5-415f-9571-0b91566c612b tempest-AbsoluteLimitsTests-402285673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:24:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b39d167a-bba5-415f-9571-0b91566c612b tempest-AbsoluteLimitsTests-402285673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b39d167a-bba5-415f-9571-0b91566c612b tempest-AbsoluteLimitsTests-402285673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:43 devstack sudo[96647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:24:43 devstack sudo[96647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-bf918afd-9a9f-4fbd-89eb-77b98a064e4a tempest-VolumesMetadataTest-1077152343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-bf918afd-9a9f-4fbd-89eb-77b98a064e4a tempest-VolumesMetadataTest-1077152343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:43 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-bf918afd-9a9f-4fbd-89eb-77b98a064e4a tempest-VolumesMetadataTest-1077152343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:24:43 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-bf918afd-9a9f-4fbd-89eb-77b98a064e4a tempest-VolumesMetadataTest-1077152343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:24:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-bf918afd-9a9f-4fbd-89eb-77b98a064e4a tempest-VolumesMetadataTest-1077152343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-bf918afd-9a9f-4fbd-89eb-77b98a064e4a tempest-VolumesMetadataTest-1077152343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:44 devstack sudo[96654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:24:44 devstack sudo[96654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:44 devstack sudo[96647]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b39d167a-bba5-415f-9571-0b91566c612b tempest-AbsoluteLimitsTests-402285673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.637s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:44 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-b39d167a-bba5-415f-9571-0b91566c612b tempest-AbsoluteLimitsTests-402285673 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:24:44 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-b39d167a-bba5-415f-9571-0b91566c612b tempest-AbsoluteLimitsTests-402285673 None] Deleted volume successfully. Nov 03 20:24:44 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b39d167a-bba5-415f-9571-0b91566c612b tempest-AbsoluteLimitsTests-402285673 None] Lock "cinder-09467876-24d9-4233-b7ca-4685adda32fa-delete_volume" released by "delete_volume" :: held 2.445s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:24:44 devstack sudo[96654]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-bf918afd-9a9f-4fbd-89eb-77b98a064e4a tempest-VolumesMetadataTest-1077152343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.808s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:44 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-bf918afd-9a9f-4fbd-89eb-77b98a064e4a tempest-VolumesMetadataTest-1077152343 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:24:44 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-bf918afd-9a9f-4fbd-89eb-77b98a064e4a tempest-VolumesMetadataTest-1077152343 None] Deleted volume successfully. Nov 03 20:24:44 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-bf918afd-9a9f-4fbd-89eb-77b98a064e4a tempest-VolumesMetadataTest-1077152343 None] Lock "cinder-fa961c1f-0783-4964-a9e8-f90bb3d7bd54-delete_volume" released by "delete_volume" :: held 2.506s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:24:52 devstack sudo[96612]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-abcfeca9-e1a3-4844-80df-bef8a6f59c8d tempest-VolumesActionsTest-1174355871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e9d8b4ae-0951-4c93-90ec-3b2675940d6a /opt/stack/data/cinder/conversion/e9d8b4ae-0951-4c93-90ec-3b2675940d6a.temp_image.cab8b4f6-8e45-4e88-aed1-40dff14e39fesgum3l9s.img" returned: 0 in 10.246s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:52 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a2a4db-194f-4e6c-81ac-082f966eca2f]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-abcfeca9-e1a3-4844-80df-bef8a6f59c8d tempest-VolumesActionsTest-1174355871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e9d8b4ae-0951-4c93-90ec-3b2675940d6a {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:53 devstack sudo[96675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e9d8b4ae-0951-4c93-90ec-3b2675940d6a Nov 03 20:24:53 devstack sudo[96675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:53 devstack sudo[96675]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-abcfeca9-e1a3-4844-80df-bef8a6f59c8d tempest-VolumesActionsTest-1174355871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e9d8b4ae-0951-4c93-90ec-3b2675940d6a" returned: 0 in 0.687s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:53 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-abcfeca9-e1a3-4844-80df-bef8a6f59c8d tempest-VolumesActionsTest-1174355871 None] Image conversion details: src /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e9d8b4ae-0951-4c93-90ec-3b2675940d6a, size 1024.00 MB, duration 10.25 sec, destination /opt/stack/data/cinder/conversion/e9d8b4ae-0951-4c93-90ec-3b2675940d6a.temp_image.cab8b4f6-8e45-4e88-aed1-40dff14e39fesgum3l9s.img {{(pid=87248) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:24:53 devstack cinder-volume[87248]: INFO cinder.image.image_utils [None req-abcfeca9-e1a3-4844-80df-bef8a6f59c8d tempest-VolumesActionsTest-1174355871 None] Converted 1024.00 MB image at 99.93 MB/s Nov 03 20:24:53 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-abcfeca9-e1a3-4844-80df-bef8a6f59c8d tempest-VolumesActionsTest-1174355871 None] cab8b4f6-8e45-4e88-aed1-40dff14e39fe was raw, converting to qcow2 {{(pid=87248) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Nov 03 20:24:53 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[52320eba-01e2-4658-8615-fd749beae2ac]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-abcfeca9-e1a3-4844-80df-bef8a6f59c8d tempest-VolumesActionsTest-1174355871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e9d8b4ae-0951-4c93-90ec-3b2675940d6a.temp_image.cab8b4f6-8e45-4e88-aed1-40dff14e39fesgum3l9s.img {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:53 devstack sudo[96680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e9d8b4ae-0951-4c93-90ec-3b2675940d6a.temp_image.cab8b4f6-8e45-4e88-aed1-40dff14e39fesgum3l9s.img Nov 03 20:24:53 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:53 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-abcfeca9-e1a3-4844-80df-bef8a6f59c8d tempest-VolumesActionsTest-1174355871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e9d8b4ae-0951-4c93-90ec-3b2675940d6a.temp_image.cab8b4f6-8e45-4e88-aed1-40dff14e39fesgum3l9s.img" returned: 0 in 0.364s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-abcfeca9-e1a3-4844-80df-bef8a6f59c8d tempest-VolumesActionsTest-1174355871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e9d8b4ae-0951-4c93-90ec-3b2675940d6a.temp_image.cab8b4f6-8e45-4e88-aed1-40dff14e39fesgum3l9s.img {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:54 devstack sudo[96684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e9d8b4ae-0951-4c93-90ec-3b2675940d6a.temp_image.cab8b4f6-8e45-4e88-aed1-40dff14e39fesgum3l9s.img Nov 03 20:24:54 devstack sudo[96684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:54 devstack sudo[96684]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-abcfeca9-e1a3-4844-80df-bef8a6f59c8d tempest-VolumesActionsTest-1174355871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e9d8b4ae-0951-4c93-90ec-3b2675940d6a.temp_image.cab8b4f6-8e45-4e88-aed1-40dff14e39fesgum3l9s.img" returned: 1 in 0.378s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-abcfeca9-e1a3-4844-80df-bef8a6f59c8d tempest-VolumesActionsTest-1174355871 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e9d8b4ae-0951-4c93-90ec-3b2675940d6a.temp_image.cab8b4f6-8e45-4e88-aed1-40dff14e39fesgum3l9s.img' failed. Not Retrying. {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 20:24:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-abcfeca9-e1a3-4844-80df-bef8a6f59c8d tempest-VolumesActionsTest-1174355871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e9d8b4ae-0951-4c93-90ec-3b2675940d6a.temp_image.cab8b4f6-8e45-4e88-aed1-40dff14e39fesgum3l9s.img /opt/stack/data/cinder/conversion/vol_upload_c91v5pai {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:54 devstack sudo[96689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e9d8b4ae-0951-4c93-90ec-3b2675940d6a.temp_image.cab8b4f6-8e45-4e88-aed1-40dff14e39fesgum3l9s.img /opt/stack/data/cinder/conversion/vol_upload_c91v5pai Nov 03 20:24:54 devstack sudo[96689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:54 devstack sudo[96689]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-abcfeca9-e1a3-4844-80df-bef8a6f59c8d tempest-VolumesActionsTest-1174355871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e9d8b4ae-0951-4c93-90ec-3b2675940d6a.temp_image.cab8b4f6-8e45-4e88-aed1-40dff14e39fesgum3l9s.img /opt/stack/data/cinder/conversion/vol_upload_c91v5pai" returned: 0 in 0.352s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:54 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-abcfeca9-e1a3-4844-80df-bef8a6f59c8d tempest-VolumesActionsTest-1174355871 None] Image conversion details: src /opt/stack/data/cinder/conversion/e9d8b4ae-0951-4c93-90ec-3b2675940d6a.temp_image.cab8b4f6-8e45-4e88-aed1-40dff14e39fesgum3l9s.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_c91v5pai {{(pid=87248) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:24:54 devstack cinder-volume[87248]: INFO cinder.image.image_utils [None req-abcfeca9-e1a3-4844-80df-bef8a6f59c8d tempest-VolumesActionsTest-1174355871 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 03 20:24:54 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[76aaf6e8-15dc-4b54-b457-f13a1c26069d]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-abcfeca9-e1a3-4844-80df-bef8a6f59c8d tempest-VolumesActionsTest-1174355871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_c91v5pai {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:54 devstack sudo[96696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_c91v5pai Nov 03 20:24:54 devstack sudo[96696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:55 devstack sudo[96696]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-abcfeca9-e1a3-4844-80df-bef8a6f59c8d tempest-VolumesActionsTest-1174355871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_c91v5pai" returned: 0 in 0.388s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:56 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-18052054-2eb7-42ad-85ec-8f671396f531 tempest-VolumesTransfersV357Test-330146551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:24:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-18052054-2eb7-42ad-85ec-8f671396f531 tempest-VolumesTransfersV357Test-330146551 None] Flow 'volume_create_manager' (2d131eb8-d61a-4c54-9ebd-ded9c6c20847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:24:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-18052054-2eb7-42ad-85ec-8f671396f531 tempest-VolumesTransfersV357Test-330146551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (930d168d-4628-4dde-b990-aa25a263b600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-18052054-2eb7-42ad-85ec-8f671396f531 tempest-VolumesTransfersV357Test-330146551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (930d168d-4628-4dde-b990-aa25a263b600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-555233049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1769ea87-fc9b-4705-983d-2bec5d35f66a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='201582b723234de5a2399efcdb63ee21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:24:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:24:57Z,use_quota=True,user_id='5cf545dabb514bf6a76fd0a3bedd1887',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-18052054-2eb7-42ad-85ec-8f671396f531 tempest-VolumesTransfersV357Test-330146551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96fcc0d9-1dee-4614-9db5-f4bab5512218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-18052054-2eb7-42ad-85ec-8f671396f531 tempest-VolumesTransfersV357Test-330146551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96fcc0d9-1dee-4614-9db5-f4bab5512218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-18052054-2eb7-42ad-85ec-8f671396f531 tempest-VolumesTransfersV357Test-330146551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (161af4ea-fc7c-40b8-8a4a-f3fcfd26ec39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-18052054-2eb7-42ad-85ec-8f671396f531 tempest-VolumesTransfersV357Test-330146551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (161af4ea-fc7c-40b8-8a4a-f3fcfd26ec39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1769ea87-fc9b-4705-983d-2bec5d35f66a', 'volume_name': 'volume-1769ea87-fc9b-4705-983d-2bec5d35f66a', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-18052054-2eb7-42ad-85ec-8f671396f531 tempest-VolumesTransfersV357Test-330146551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dbfc8a9-3470-4b37-8aab-5066de73dc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-18052054-2eb7-42ad-85ec-8f671396f531 tempest-VolumesTransfersV357Test-330146551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dbfc8a9-3470-4b37-8aab-5066de73dc03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-18052054-2eb7-42ad-85ec-8f671396f531 tempest-VolumesTransfersV357Test-330146551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aa24f55-727a-452e-9ba1-a6ef331f42ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:56 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-18052054-2eb7-42ad-85ec-8f671396f531 tempest-VolumesTransfersV357Test-330146551 None] Volume 1769ea87-fc9b-4705-983d-2bec5d35f66a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1769ea87-fc9b-4705-983d-2bec5d35f66a', 'volume_size': 1} Nov 03 20:24:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-18052054-2eb7-42ad-85ec-8f671396f531 tempest-VolumesTransfersV357Test-330146551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-abcfeca9-e1a3-4844-80df-bef8a6f59c8d tempest-VolumesActionsTest-1174355871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 15.877s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:57 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-abcfeca9-e1a3-4844-80df-bef8a6f59c8d tempest-VolumesActionsTest-1174355871 None] Uploaded volume to glance image-id: cab8b4f6-8e45-4e88-aed1-40dff14e39fe. {{(pid=87248) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 03 20:24:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-18052054-2eb7-42ad-85ec-8f671396f531 tempest-VolumesTransfersV357Test-330146551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.451s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:57 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-18052054-2eb7-42ad-85ec-8f671396f531 tempest-VolumesTransfersV357Test-330146551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-555233049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1769ea87-fc9b-4705-983d-2bec5d35f66a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='201582b723234de5a2399efcdb63ee21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:24:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:24:57Z,use_quota=True,user_id='5cf545dabb514bf6a76fd0a3bedd1887',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:24:57 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-18052054-2eb7-42ad-85ec-8f671396f531 tempest-VolumesTransfersV357Test-330146551 None] Creating volume 1769ea87-fc9b-4705-983d-2bec5d35f66a {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:24:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-18052054-2eb7-42ad-85ec-8f671396f531 tempest-VolumesTransfersV357Test-330146551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-18052054-2eb7-42ad-85ec-8f671396f531 tempest-VolumesTransfersV357Test-330146551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:57 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-18052054-2eb7-42ad-85ec-8f671396f531 tempest-VolumesTransfersV357Test-330146551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:24:57 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-18052054-2eb7-42ad-85ec-8f671396f531 tempest-VolumesTransfersV357Test-330146551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:24:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-18052054-2eb7-42ad-85ec-8f671396f531 tempest-VolumesTransfersV357Test-330146551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:57 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-18052054-2eb7-42ad-85ec-8f671396f531 tempest-VolumesTransfersV357Test-330146551 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:24:57 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-18052054-2eb7-42ad-85ec-8f671396f531 tempest-VolumesTransfersV357Test-330146551 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:24:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-18052054-2eb7-42ad-85ec-8f671396f531 tempest-VolumesTransfersV357Test-330146551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1769ea87-fc9b-4705-983d-2bec5d35f66a 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:57 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-abcfeca9-e1a3-4844-80df-bef8a6f59c8d tempest-VolumesActionsTest-1174355871 None] Copy volume to image completed successfully. Nov 03 20:24:57 devstack sudo[96706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1769ea87-fc9b-4705-983d-2bec5d35f66a 1073741824 Nov 03 20:24:57 devstack sudo[96706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:57 devstack sudo[96706]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-18052054-2eb7-42ad-85ec-8f671396f531 tempest-VolumesTransfersV357Test-330146551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1769ea87-fc9b-4705-983d-2bec5d35f66a 1073741824" returned: 0 in 0.645s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-18052054-2eb7-42ad-85ec-8f671396f531 tempest-VolumesTransfersV357Test-330146551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1769ea87-fc9b-4705-983d-2bec5d35f66a {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:58 devstack sudo[96721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1769ea87-fc9b-4705-983d-2bec5d35f66a Nov 03 20:24:58 devstack sudo[96721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:58 devstack sudo[96721]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-18052054-2eb7-42ad-85ec-8f671396f531 tempest-VolumesTransfersV357Test-330146551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1769ea87-fc9b-4705-983d-2bec5d35f66a" returned: 0 in 0.470s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:58 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-18052054-2eb7-42ad-85ec-8f671396f531 tempest-VolumesTransfersV357Test-330146551 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:24:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-18052054-2eb7-42ad-85ec-8f671396f531 tempest-VolumesTransfersV357Test-330146551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-18052054-2eb7-42ad-85ec-8f671396f531 tempest-VolumesTransfersV357Test-330146551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aa24f55-727a-452e-9ba1-a6ef331f42ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1769ea87-fc9b-4705-983d-2bec5d35f66a', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-18052054-2eb7-42ad-85ec-8f671396f531 tempest-VolumesTransfersV357Test-330146551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de706210-8348-4bb6-b662-bb35264f096b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:58 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-18052054-2eb7-42ad-85ec-8f671396f531 tempest-VolumesTransfersV357Test-330146551 None] Volume volume-1769ea87-fc9b-4705-983d-2bec5d35f66a (1769ea87-fc9b-4705-983d-2bec5d35f66a): created successfully Nov 03 20:24:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-18052054-2eb7-42ad-85ec-8f671396f531 tempest-VolumesTransfersV357Test-330146551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de706210-8348-4bb6-b662-bb35264f096b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-18052054-2eb7-42ad-85ec-8f671396f531 tempest-VolumesTransfersV357Test-330146551 None] Flow 'volume_create_manager' (2d131eb8-d61a-4c54-9ebd-ded9c6c20847) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:24:58 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-18052054-2eb7-42ad-85ec-8f671396f531 tempest-VolumesTransfersV357Test-330146551 None] Created volume successfully. Nov 03 20:24:58 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-52278549-44d6-4bb2-b37e-59a28d521a39 tempest-VolumesTransfersTest-302046744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:24:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-52278549-44d6-4bb2-b37e-59a28d521a39 tempest-VolumesTransfersTest-302046744 None] Flow 'volume_create_manager' (1120617f-482f-4340-85c5-cc27d4d08e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:24:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-52278549-44d6-4bb2-b37e-59a28d521a39 tempest-VolumesTransfersTest-302046744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05111473-944a-44ff-b4ff-7014dd3b5426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-52278549-44d6-4bb2-b37e-59a28d521a39 tempest-VolumesTransfersTest-302046744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05111473-944a-44ff-b4ff-7014dd3b5426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1727118308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2063155a-cb51-4848-910e-e451d085f765,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57502a331524777842a4ae61de00894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:24:59Z,use_quota=True,user_id='d46426ead8444861bd7a1f75517a6bb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-52278549-44d6-4bb2-b37e-59a28d521a39 tempest-VolumesTransfersTest-302046744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd84ebd3-59f9-4b5d-862c-e24c03f946ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-52278549-44d6-4bb2-b37e-59a28d521a39 tempest-VolumesTransfersTest-302046744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd84ebd3-59f9-4b5d-862c-e24c03f946ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-52278549-44d6-4bb2-b37e-59a28d521a39 tempest-VolumesTransfersTest-302046744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05957c34-88e2-4d74-992b-a25553157ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-52278549-44d6-4bb2-b37e-59a28d521a39 tempest-VolumesTransfersTest-302046744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05957c34-88e2-4d74-992b-a25553157ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2063155a-cb51-4848-910e-e451d085f765', 'volume_name': 'volume-2063155a-cb51-4848-910e-e451d085f765', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-52278549-44d6-4bb2-b37e-59a28d521a39 tempest-VolumesTransfersTest-302046744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eef4a256-a96d-4fa7-94d7-43092e239689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-52278549-44d6-4bb2-b37e-59a28d521a39 tempest-VolumesTransfersTest-302046744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eef4a256-a96d-4fa7-94d7-43092e239689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-52278549-44d6-4bb2-b37e-59a28d521a39 tempest-VolumesTransfersTest-302046744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06ad24e5-6c87-4156-9786-a7c67068e26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:58 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-52278549-44d6-4bb2-b37e-59a28d521a39 tempest-VolumesTransfersTest-302046744 None] Volume 2063155a-cb51-4848-910e-e451d085f765: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2063155a-cb51-4848-910e-e451d085f765', 'volume_size': 1} Nov 03 20:24:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-52278549-44d6-4bb2-b37e-59a28d521a39 tempest-VolumesTransfersTest-302046744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-52278549-44d6-4bb2-b37e-59a28d521a39 tempest-VolumesTransfersTest-302046744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:58 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-52278549-44d6-4bb2-b37e-59a28d521a39 tempest-VolumesTransfersTest-302046744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1727118308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2063155a-cb51-4848-910e-e451d085f765,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57502a331524777842a4ae61de00894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:24:59Z,use_quota=True,user_id='d46426ead8444861bd7a1f75517a6bb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:24:58 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-52278549-44d6-4bb2-b37e-59a28d521a39 tempest-VolumesTransfersTest-302046744 None] Creating volume 2063155a-cb51-4848-910e-e451d085f765 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:24:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-52278549-44d6-4bb2-b37e-59a28d521a39 tempest-VolumesTransfersTest-302046744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:24:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-52278549-44d6-4bb2-b37e-59a28d521a39 tempest-VolumesTransfersTest-302046744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:24:58 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-52278549-44d6-4bb2-b37e-59a28d521a39 tempest-VolumesTransfersTest-302046744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:24:58 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-52278549-44d6-4bb2-b37e-59a28d521a39 tempest-VolumesTransfersTest-302046744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:24:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-52278549-44d6-4bb2-b37e-59a28d521a39 tempest-VolumesTransfersTest-302046744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:58 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-52278549-44d6-4bb2-b37e-59a28d521a39 tempest-VolumesTransfersTest-302046744 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:24:58 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-52278549-44d6-4bb2-b37e-59a28d521a39 tempest-VolumesTransfersTest-302046744 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:24:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-52278549-44d6-4bb2-b37e-59a28d521a39 tempest-VolumesTransfersTest-302046744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2063155a-cb51-4848-910e-e451d085f765 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:59 devstack sudo[96730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2063155a-cb51-4848-910e-e451d085f765 1073741824 Nov 03 20:24:59 devstack sudo[96730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:59 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6605a6e7-baff-4154-b5ff-9f9e7bb56a9b tempest-VolumesActionsTest-1174355871 None] Acquiring lock "cinder-e9d8b4ae-0951-4c93-90ec-3b2675940d6a-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:24:59 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6605a6e7-baff-4154-b5ff-9f9e7bb56a9b tempest-VolumesActionsTest-1174355871 None] Lock "cinder-e9d8b4ae-0951-4c93-90ec-3b2675940d6a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:24:59 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6605a6e7-baff-4154-b5ff-9f9e7bb56a9b tempest-VolumesActionsTest-1174355871 None] Acquiring lock "cinder-quobyte-e9d8b4ae-0951-4c93-90ec-3b2675940d6a" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:24:59 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6605a6e7-baff-4154-b5ff-9f9e7bb56a9b tempest-VolumesActionsTest-1174355871 None] Lock "cinder-quobyte-e9d8b4ae-0951-4c93-90ec-3b2675940d6a" acquired by "delete_volume" :: waited 0.017s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:24:59 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[1205e020-d095-446c-8bb1-a08e9385fc29]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:24:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6605a6e7-baff-4154-b5ff-9f9e7bb56a9b tempest-VolumesActionsTest-1174355871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e9d8b4ae-0951-4c93-90ec-3b2675940d6a {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:59 devstack sudo[96732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e9d8b4ae-0951-4c93-90ec-3b2675940d6a Nov 03 20:24:59 devstack sudo[96732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:59 devstack sudo[96730]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-52278549-44d6-4bb2-b37e-59a28d521a39 tempest-VolumesTransfersTest-302046744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2063155a-cb51-4848-910e-e451d085f765 1073741824" returned: 0 in 0.550s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-52278549-44d6-4bb2-b37e-59a28d521a39 tempest-VolumesTransfersTest-302046744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2063155a-cb51-4848-910e-e451d085f765 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:59 devstack sudo[96741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2063155a-cb51-4848-910e-e451d085f765 Nov 03 20:24:59 devstack sudo[96741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:59 devstack sudo[96732]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6605a6e7-baff-4154-b5ff-9f9e7bb56a9b tempest-VolumesActionsTest-1174355871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e9d8b4ae-0951-4c93-90ec-3b2675940d6a" returned: 0 in 0.444s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6605a6e7-baff-4154-b5ff-9f9e7bb56a9b tempest-VolumesActionsTest-1174355871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e9d8b4ae-0951-4c93-90ec-3b2675940d6a {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:24:59 devstack sudo[96743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e9d8b4ae-0951-4c93-90ec-3b2675940d6a Nov 03 20:24:59 devstack sudo[96743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:24:59 devstack sudo[96741]: pam_unix(sudo:session): session closed for user root Nov 03 20:24:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-52278549-44d6-4bb2-b37e-59a28d521a39 tempest-VolumesTransfersTest-302046744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2063155a-cb51-4848-910e-e451d085f765" returned: 0 in 0.364s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:24:59 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-52278549-44d6-4bb2-b37e-59a28d521a39 tempest-VolumesTransfersTest-302046744 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:24:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-52278549-44d6-4bb2-b37e-59a28d521a39 tempest-VolumesTransfersTest-302046744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:24:59 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-52278549-44d6-4bb2-b37e-59a28d521a39 tempest-VolumesTransfersTest-302046744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06ad24e5-6c87-4156-9786-a7c67068e26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2063155a-cb51-4848-910e-e451d085f765', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:24:59 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-52278549-44d6-4bb2-b37e-59a28d521a39 tempest-VolumesTransfersTest-302046744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65b47e95-cfc8-43ce-ab86-87baf7365751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:24:59 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-52278549-44d6-4bb2-b37e-59a28d521a39 tempest-VolumesTransfersTest-302046744 None] Volume volume-2063155a-cb51-4848-910e-e451d085f765 (2063155a-cb51-4848-910e-e451d085f765): created successfully Nov 03 20:25:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-52278549-44d6-4bb2-b37e-59a28d521a39 tempest-VolumesTransfersTest-302046744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65b47e95-cfc8-43ce-ab86-87baf7365751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-52278549-44d6-4bb2-b37e-59a28d521a39 tempest-VolumesTransfersTest-302046744 None] Flow 'volume_create_manager' (1120617f-482f-4340-85c5-cc27d4d08e6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:00 devstack sudo[96743]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:00 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-52278549-44d6-4bb2-b37e-59a28d521a39 tempest-VolumesTransfersTest-302046744 None] Created volume successfully. Nov 03 20:25:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6605a6e7-baff-4154-b5ff-9f9e7bb56a9b tempest-VolumesActionsTest-1174355871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e9d8b4ae-0951-4c93-90ec-3b2675940d6a" returned: 0 in 0.383s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:00 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6605a6e7-baff-4154-b5ff-9f9e7bb56a9b tempest-VolumesActionsTest-1174355871 None] Lock "cinder-quobyte-e9d8b4ae-0951-4c93-90ec-3b2675940d6a" released by "delete_volume" :: held 0.880s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:25:00 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-6605a6e7-baff-4154-b5ff-9f9e7bb56a9b tempest-VolumesActionsTest-1174355871 None] Created reservations ['9de03108-8ed9-4412-bef3-c50284ffb08b', '51206ec3-6c7e-47a8-984f-597944817d36', '4ed8d50b-6104-4a13-8854-bcbfdf3a0af6', 'c6a12b86-37e7-4b32-a291-301bc9ea20c1'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:25:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6605a6e7-baff-4154-b5ff-9f9e7bb56a9b tempest-VolumesActionsTest-1174355871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6605a6e7-baff-4154-b5ff-9f9e7bb56a9b tempest-VolumesActionsTest-1174355871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:00 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-6605a6e7-baff-4154-b5ff-9f9e7bb56a9b tempest-VolumesActionsTest-1174355871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:25:00 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-6605a6e7-baff-4154-b5ff-9f9e7bb56a9b tempest-VolumesActionsTest-1174355871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:25:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6605a6e7-baff-4154-b5ff-9f9e7bb56a9b tempest-VolumesActionsTest-1174355871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6605a6e7-baff-4154-b5ff-9f9e7bb56a9b tempest-VolumesActionsTest-1174355871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:00 devstack sudo[96748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:25:00 devstack sudo[96748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:00 devstack sudo[96748]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6605a6e7-baff-4154-b5ff-9f9e7bb56a9b tempest-VolumesActionsTest-1174355871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.290s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:00 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-6605a6e7-baff-4154-b5ff-9f9e7bb56a9b tempest-VolumesActionsTest-1174355871 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:25:00 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-6605a6e7-baff-4154-b5ff-9f9e7bb56a9b tempest-VolumesActionsTest-1174355871 None] Deleted volume successfully. Nov 03 20:25:00 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6605a6e7-baff-4154-b5ff-9f9e7bb56a9b tempest-VolumesActionsTest-1174355871 None] Lock "cinder-e9d8b4ae-0951-4c93-90ec-3b2675940d6a-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:25:00 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-a41680a3-c535-4fd6-8982-e13e44eb88b9 tempest-VolumesTransfersV357Test-1637783008 None] Transfer volume completed successfully. Nov 03 20:25:02 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-136fc1b5-379a-4cd8-a25d-64ecafedb30a tempest-VolumesTransfersV357Test-413188335 None] Acquiring lock "cinder-1769ea87-fc9b-4705-983d-2bec5d35f66a-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:25:02 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-136fc1b5-379a-4cd8-a25d-64ecafedb30a tempest-VolumesTransfersV357Test-413188335 None] Lock "cinder-1769ea87-fc9b-4705-983d-2bec5d35f66a-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:25:02 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-136fc1b5-379a-4cd8-a25d-64ecafedb30a tempest-VolumesTransfersV357Test-413188335 None] Acquiring lock "cinder-quobyte-1769ea87-fc9b-4705-983d-2bec5d35f66a" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:25:02 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-136fc1b5-379a-4cd8-a25d-64ecafedb30a tempest-VolumesTransfersV357Test-413188335 None] Lock "cinder-quobyte-1769ea87-fc9b-4705-983d-2bec5d35f66a" acquired by "delete_volume" :: waited 0.041s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:25:02 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5487e07-ae59-4636-85d4-0742ae371221]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:25:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-136fc1b5-379a-4cd8-a25d-64ecafedb30a tempest-VolumesTransfersV357Test-413188335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1769ea87-fc9b-4705-983d-2bec5d35f66a {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:02 devstack sudo[97190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1769ea87-fc9b-4705-983d-2bec5d35f66a Nov 03 20:25:02 devstack sudo[97190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:03 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-42660b64-5d31-43c5-984b-71ac453aefbd tempest-VolumesTransfersTest-1493002455 None] Transfer volume completed successfully. Nov 03 20:25:03 devstack sudo[97190]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-136fc1b5-379a-4cd8-a25d-64ecafedb30a tempest-VolumesTransfersV357Test-413188335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1769ea87-fc9b-4705-983d-2bec5d35f66a" returned: 0 in 0.978s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-136fc1b5-379a-4cd8-a25d-64ecafedb30a tempest-VolumesTransfersV357Test-413188335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1769ea87-fc9b-4705-983d-2bec5d35f66a {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:03 devstack sudo[97200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1769ea87-fc9b-4705-983d-2bec5d35f66a Nov 03 20:25:03 devstack sudo[97200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:04 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fcfd36c2-3708-421c-a643-6c403ee40f9a tempest-VolumesTransfersTest-14984373 None] Acquiring lock "cinder-2063155a-cb51-4848-910e-e451d085f765-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:25:04 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fcfd36c2-3708-421c-a643-6c403ee40f9a tempest-VolumesTransfersTest-14984373 None] Lock "cinder-2063155a-cb51-4848-910e-e451d085f765-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:25:04 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fcfd36c2-3708-421c-a643-6c403ee40f9a tempest-VolumesTransfersTest-14984373 None] Acquiring lock "cinder-quobyte-2063155a-cb51-4848-910e-e451d085f765" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:25:04 devstack sudo[97200]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-136fc1b5-379a-4cd8-a25d-64ecafedb30a tempest-VolumesTransfersV357Test-413188335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1769ea87-fc9b-4705-983d-2bec5d35f66a" returned: 0 in 0.539s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:04 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-136fc1b5-379a-4cd8-a25d-64ecafedb30a tempest-VolumesTransfersV357Test-413188335 None] Lock "cinder-quobyte-1769ea87-fc9b-4705-983d-2bec5d35f66a" released by "delete_volume" :: held 1.602s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:25:04 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fcfd36c2-3708-421c-a643-6c403ee40f9a tempest-VolumesTransfersTest-14984373 None] Lock "cinder-quobyte-2063155a-cb51-4848-910e-e451d085f765" acquired by "delete_volume" :: waited 0.037s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:25:04 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2d2a3b-46af-4b44-85c4-b0eeabda232f]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:25:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fcfd36c2-3708-421c-a643-6c403ee40f9a tempest-VolumesTransfersTest-14984373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2063155a-cb51-4848-910e-e451d085f765 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:04 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-136fc1b5-379a-4cd8-a25d-64ecafedb30a tempest-VolumesTransfersV357Test-413188335 None] Created reservations ['227c97b9-4ccb-4513-8321-38e9831a30f0', '4f8b321b-7c7f-4bce-a974-2751af5e5722', 'fcf85b0d-5742-4436-8ec2-dd696226bd2d', '82097f3e-2bb1-4712-b70f-b0362c0a54ed'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:25:04 devstack sudo[97204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2063155a-cb51-4848-910e-e451d085f765 Nov 03 20:25:04 devstack sudo[97204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-136fc1b5-379a-4cd8-a25d-64ecafedb30a tempest-VolumesTransfersV357Test-413188335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-136fc1b5-379a-4cd8-a25d-64ecafedb30a tempest-VolumesTransfersV357Test-413188335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:04 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-136fc1b5-379a-4cd8-a25d-64ecafedb30a tempest-VolumesTransfersV357Test-413188335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:25:04 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-136fc1b5-379a-4cd8-a25d-64ecafedb30a tempest-VolumesTransfersV357Test-413188335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:25:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-136fc1b5-379a-4cd8-a25d-64ecafedb30a tempest-VolumesTransfersV357Test-413188335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-136fc1b5-379a-4cd8-a25d-64ecafedb30a tempest-VolumesTransfersV357Test-413188335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:04 devstack sudo[97206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:25:04 devstack sudo[97206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:04 devstack sudo[97206]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-136fc1b5-379a-4cd8-a25d-64ecafedb30a tempest-VolumesTransfersV357Test-413188335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.292s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:04 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-136fc1b5-379a-4cd8-a25d-64ecafedb30a tempest-VolumesTransfersV357Test-413188335 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:25:04 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-136fc1b5-379a-4cd8-a25d-64ecafedb30a tempest-VolumesTransfersV357Test-413188335 None] Deleted volume successfully. Nov 03 20:25:04 devstack sudo[97204]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fcfd36c2-3708-421c-a643-6c403ee40f9a tempest-VolumesTransfersTest-14984373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2063155a-cb51-4848-910e-e451d085f765" returned: 0 in 0.515s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fcfd36c2-3708-421c-a643-6c403ee40f9a tempest-VolumesTransfersTest-14984373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2063155a-cb51-4848-910e-e451d085f765 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:04 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-136fc1b5-379a-4cd8-a25d-64ecafedb30a tempest-VolumesTransfersV357Test-413188335 None] Lock "cinder-1769ea87-fc9b-4705-983d-2bec5d35f66a-delete_volume" released by "delete_volume" :: held 2.370s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:25:04 devstack sudo[97212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2063155a-cb51-4848-910e-e451d085f765 Nov 03 20:25:04 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:05 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fcfd36c2-3708-421c-a643-6c403ee40f9a tempest-VolumesTransfersTest-14984373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2063155a-cb51-4848-910e-e451d085f765" returned: 0 in 0.525s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:05 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fcfd36c2-3708-421c-a643-6c403ee40f9a tempest-VolumesTransfersTest-14984373 None] Lock "cinder-quobyte-2063155a-cb51-4848-910e-e451d085f765" released by "delete_volume" :: held 1.103s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:25:05 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-fcfd36c2-3708-421c-a643-6c403ee40f9a tempest-VolumesTransfersTest-14984373 None] Created reservations ['169bbabe-125b-47f1-a9f6-7be56d579780', 'f8cdb4fe-ecae-4f72-b92d-5f1e2edbdcab', 'aa0ad901-c8e9-4171-94f0-b6b3bf221005', 'fd2f9da3-a4b2-4efc-91ae-abb99a75020a'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:25:05 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-8358d063-ff74-4b97-92e7-3bdc1659e582 tempest-VolumesTransfersV357Test-330146551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:25:05 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8358d063-ff74-4b97-92e7-3bdc1659e582 tempest-VolumesTransfersV357Test-330146551 None] Flow 'volume_create_manager' (a4108662-bc27-476c-80f7-6103b09c53b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:05 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8358d063-ff74-4b97-92e7-3bdc1659e582 tempest-VolumesTransfersV357Test-330146551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (793a8f6b-8173-4e9a-8ddc-39e3545cb686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-fcfd36c2-3708-421c-a643-6c403ee40f9a tempest-VolumesTransfersTest-14984373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-fcfd36c2-3708-421c-a643-6c403ee40f9a tempest-VolumesTransfersTest-14984373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:05 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-fcfd36c2-3708-421c-a643-6c403ee40f9a tempest-VolumesTransfersTest-14984373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:25:05 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-fcfd36c2-3708-421c-a643-6c403ee40f9a tempest-VolumesTransfersTest-14984373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:25:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-fcfd36c2-3708-421c-a643-6c403ee40f9a tempest-VolumesTransfersTest-14984373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fcfd36c2-3708-421c-a643-6c403ee40f9a tempest-VolumesTransfersTest-14984373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:05 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8358d063-ff74-4b97-92e7-3bdc1659e582 tempest-VolumesTransfersV357Test-330146551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (793a8f6b-8173-4e9a-8ddc-39e3545cb686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-945062971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d5adc06-de99-4df5-a567-e928932b967f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='201582b723234de5a2399efcdb63ee21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:25:06Z,use_quota=True,user_id='5cf545dabb514bf6a76fd0a3bedd1887',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:05 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8358d063-ff74-4b97-92e7-3bdc1659e582 tempest-VolumesTransfersV357Test-330146551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d56708f-d391-444e-8b11-f534c660e433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:05 devstack sudo[97215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:25:05 devstack sudo[97215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:05 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8358d063-ff74-4b97-92e7-3bdc1659e582 tempest-VolumesTransfersV357Test-330146551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d56708f-d391-444e-8b11-f534c660e433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:05 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8358d063-ff74-4b97-92e7-3bdc1659e582 tempest-VolumesTransfersV357Test-330146551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78491ea5-ec25-4266-b32d-3e00300a9a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:05 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8358d063-ff74-4b97-92e7-3bdc1659e582 tempest-VolumesTransfersV357Test-330146551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78491ea5-ec25-4266-b32d-3e00300a9a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d5adc06-de99-4df5-a567-e928932b967f', 'volume_name': 'volume-2d5adc06-de99-4df5-a567-e928932b967f', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:05 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8358d063-ff74-4b97-92e7-3bdc1659e582 tempest-VolumesTransfersV357Test-330146551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (709344da-f524-44e8-9ac8-cfa4a2ecdbe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:05 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8358d063-ff74-4b97-92e7-3bdc1659e582 tempest-VolumesTransfersV357Test-330146551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (709344da-f524-44e8-9ac8-cfa4a2ecdbe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:05 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8358d063-ff74-4b97-92e7-3bdc1659e582 tempest-VolumesTransfersV357Test-330146551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3e21e68-b456-4f20-9718-0dd5b84bd955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:05 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-8358d063-ff74-4b97-92e7-3bdc1659e582 tempest-VolumesTransfersV357Test-330146551 None] Volume 2d5adc06-de99-4df5-a567-e928932b967f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d5adc06-de99-4df5-a567-e928932b967f', 'volume_size': 1} Nov 03 20:25:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8358d063-ff74-4b97-92e7-3bdc1659e582 tempest-VolumesTransfersV357Test-330146551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8358d063-ff74-4b97-92e7-3bdc1659e582 tempest-VolumesTransfersV357Test-330146551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:05 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8358d063-ff74-4b97-92e7-3bdc1659e582 tempest-VolumesTransfersV357Test-330146551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-945062971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d5adc06-de99-4df5-a567-e928932b967f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='201582b723234de5a2399efcdb63ee21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:25:06Z,use_quota=True,user_id='5cf545dabb514bf6a76fd0a3bedd1887',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:25:05 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-8358d063-ff74-4b97-92e7-3bdc1659e582 tempest-VolumesTransfersV357Test-330146551 None] Creating volume 2d5adc06-de99-4df5-a567-e928932b967f {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:25:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8358d063-ff74-4b97-92e7-3bdc1659e582 tempest-VolumesTransfersV357Test-330146551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8358d063-ff74-4b97-92e7-3bdc1659e582 tempest-VolumesTransfersV357Test-330146551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:05 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8358d063-ff74-4b97-92e7-3bdc1659e582 tempest-VolumesTransfersV357Test-330146551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:25:05 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8358d063-ff74-4b97-92e7-3bdc1659e582 tempest-VolumesTransfersV357Test-330146551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:25:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8358d063-ff74-4b97-92e7-3bdc1659e582 tempest-VolumesTransfersV357Test-330146551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:05 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8358d063-ff74-4b97-92e7-3bdc1659e582 tempest-VolumesTransfersV357Test-330146551 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:25:05 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-8358d063-ff74-4b97-92e7-3bdc1659e582 tempest-VolumesTransfersV357Test-330146551 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:25:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8358d063-ff74-4b97-92e7-3bdc1659e582 tempest-VolumesTransfersV357Test-330146551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2d5adc06-de99-4df5-a567-e928932b967f 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:06 devstack sudo[97217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2d5adc06-de99-4df5-a567-e928932b967f 1073741824 Nov 03 20:25:06 devstack sudo[97217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:06 devstack sudo[97215]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fcfd36c2-3708-421c-a643-6c403ee40f9a tempest-VolumesTransfersTest-14984373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.428s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:06 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-fcfd36c2-3708-421c-a643-6c403ee40f9a tempest-VolumesTransfersTest-14984373 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:25:06 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-fcfd36c2-3708-421c-a643-6c403ee40f9a tempest-VolumesTransfersTest-14984373 None] Deleted volume successfully. Nov 03 20:25:06 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fcfd36c2-3708-421c-a643-6c403ee40f9a tempest-VolumesTransfersTest-14984373 None] Lock "cinder-2063155a-cb51-4848-910e-e451d085f765-delete_volume" released by "delete_volume" :: held 2.126s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:25:06 devstack sudo[97217]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8358d063-ff74-4b97-92e7-3bdc1659e582 tempest-VolumesTransfersV357Test-330146551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2d5adc06-de99-4df5-a567-e928932b967f 1073741824" returned: 0 in 0.687s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8358d063-ff74-4b97-92e7-3bdc1659e582 tempest-VolumesTransfersV357Test-330146551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2d5adc06-de99-4df5-a567-e928932b967f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:06 devstack sudo[97224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2d5adc06-de99-4df5-a567-e928932b967f Nov 03 20:25:06 devstack sudo[97224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:07 devstack sudo[97224]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8358d063-ff74-4b97-92e7-3bdc1659e582 tempest-VolumesTransfersV357Test-330146551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2d5adc06-de99-4df5-a567-e928932b967f" returned: 0 in 0.587s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:07 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8358d063-ff74-4b97-92e7-3bdc1659e582 tempest-VolumesTransfersV357Test-330146551 None] <== create_volume: return (1369ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:25:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8358d063-ff74-4b97-92e7-3bdc1659e582 tempest-VolumesTransfersV357Test-330146551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.371s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8358d063-ff74-4b97-92e7-3bdc1659e582 tempest-VolumesTransfersV357Test-330146551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3e21e68-b456-4f20-9718-0dd5b84bd955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d5adc06-de99-4df5-a567-e928932b967f', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8358d063-ff74-4b97-92e7-3bdc1659e582 tempest-VolumesTransfersV357Test-330146551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0b210dc-f69e-4ba3-8822-52723a1341c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:07 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-5df9361b-1b25-4914-8b9d-e340ca2ad92b tempest-VolumesTransfersTest-302046744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:25:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5df9361b-1b25-4914-8b9d-e340ca2ad92b tempest-VolumesTransfersTest-302046744 None] Flow 'volume_create_manager' (4fb3e4e7-4bc7-459b-bb9a-ac963caedbba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5df9361b-1b25-4914-8b9d-e340ca2ad92b tempest-VolumesTransfersTest-302046744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0b6b9b3-7d1c-450b-a522-211a580b1f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:07 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-8358d063-ff74-4b97-92e7-3bdc1659e582 tempest-VolumesTransfersV357Test-330146551 None] Volume volume-2d5adc06-de99-4df5-a567-e928932b967f (2d5adc06-de99-4df5-a567-e928932b967f): created successfully Nov 03 20:25:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8358d063-ff74-4b97-92e7-3bdc1659e582 tempest-VolumesTransfersV357Test-330146551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0b210dc-f69e-4ba3-8822-52723a1341c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8358d063-ff74-4b97-92e7-3bdc1659e582 tempest-VolumesTransfersV357Test-330146551 None] Flow 'volume_create_manager' (a4108662-bc27-476c-80f7-6103b09c53b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5df9361b-1b25-4914-8b9d-e340ca2ad92b tempest-VolumesTransfersTest-302046744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0b6b9b3-7d1c-450b-a522-211a580b1f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1977490929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bf533be-4976-4992-aa3b-c5316328f34e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57502a331524777842a4ae61de00894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:25:07Z,use_quota=True,user_id='d46426ead8444861bd7a1f75517a6bb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5df9361b-1b25-4914-8b9d-e340ca2ad92b tempest-VolumesTransfersTest-302046744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbbac965-c399-45db-9e97-4bcb002e9eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5df9361b-1b25-4914-8b9d-e340ca2ad92b tempest-VolumesTransfersTest-302046744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbbac965-c399-45db-9e97-4bcb002e9eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5df9361b-1b25-4914-8b9d-e340ca2ad92b tempest-VolumesTransfersTest-302046744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cc19e15-0e8d-467c-99af-6b54c86c00e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5df9361b-1b25-4914-8b9d-e340ca2ad92b tempest-VolumesTransfersTest-302046744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cc19e15-0e8d-467c-99af-6b54c86c00e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bf533be-4976-4992-aa3b-c5316328f34e', 'volume_name': 'volume-1bf533be-4976-4992-aa3b-c5316328f34e', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5df9361b-1b25-4914-8b9d-e340ca2ad92b tempest-VolumesTransfersTest-302046744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48a5b7cb-9880-4626-82ad-6aa79555388b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5df9361b-1b25-4914-8b9d-e340ca2ad92b tempest-VolumesTransfersTest-302046744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48a5b7cb-9880-4626-82ad-6aa79555388b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5df9361b-1b25-4914-8b9d-e340ca2ad92b tempest-VolumesTransfersTest-302046744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a060bcd-acea-4d81-80c3-b194c0cae1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:07 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-5df9361b-1b25-4914-8b9d-e340ca2ad92b tempest-VolumesTransfersTest-302046744 None] Volume 1bf533be-4976-4992-aa3b-c5316328f34e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bf533be-4976-4992-aa3b-c5316328f34e', 'volume_size': 1} Nov 03 20:25:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-5df9361b-1b25-4914-8b9d-e340ca2ad92b tempest-VolumesTransfersTest-302046744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-5df9361b-1b25-4914-8b9d-e340ca2ad92b tempest-VolumesTransfersTest-302046744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:07 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-5df9361b-1b25-4914-8b9d-e340ca2ad92b tempest-VolumesTransfersTest-302046744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1977490929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bf533be-4976-4992-aa3b-c5316328f34e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57502a331524777842a4ae61de00894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:25:07Z,use_quota=True,user_id='d46426ead8444861bd7a1f75517a6bb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:25:07 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-5df9361b-1b25-4914-8b9d-e340ca2ad92b tempest-VolumesTransfersTest-302046744 None] Creating volume 1bf533be-4976-4992-aa3b-c5316328f34e {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:25:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-5df9361b-1b25-4914-8b9d-e340ca2ad92b tempest-VolumesTransfersTest-302046744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-5df9361b-1b25-4914-8b9d-e340ca2ad92b tempest-VolumesTransfersTest-302046744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:07 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-5df9361b-1b25-4914-8b9d-e340ca2ad92b tempest-VolumesTransfersTest-302046744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:25:07 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-5df9361b-1b25-4914-8b9d-e340ca2ad92b tempest-VolumesTransfersTest-302046744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:25:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-5df9361b-1b25-4914-8b9d-e340ca2ad92b tempest-VolumesTransfersTest-302046744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:07 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-5df9361b-1b25-4914-8b9d-e340ca2ad92b tempest-VolumesTransfersTest-302046744 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:25:07 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-5df9361b-1b25-4914-8b9d-e340ca2ad92b tempest-VolumesTransfersTest-302046744 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:25:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5df9361b-1b25-4914-8b9d-e340ca2ad92b tempest-VolumesTransfersTest-302046744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1bf533be-4976-4992-aa3b-c5316328f34e 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:07 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-8358d063-ff74-4b97-92e7-3bdc1659e582 tempest-VolumesTransfersV357Test-330146551 None] Created volume successfully. Nov 03 20:25:07 devstack sudo[97228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1bf533be-4976-4992-aa3b-c5316328f34e 1073741824 Nov 03 20:25:07 devstack sudo[97228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:08 devstack sudo[97228]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5df9361b-1b25-4914-8b9d-e340ca2ad92b tempest-VolumesTransfersTest-302046744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1bf533be-4976-4992-aa3b-c5316328f34e 1073741824" returned: 0 in 0.810s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5df9361b-1b25-4914-8b9d-e340ca2ad92b tempest-VolumesTransfersTest-302046744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1bf533be-4976-4992-aa3b-c5316328f34e {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:08 devstack sudo[97236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1bf533be-4976-4992-aa3b-c5316328f34e Nov 03 20:25:08 devstack sudo[97236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:08 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ae0ada59-81f0-41f3-948e-20f7eeff5af9 tempest-VolumesTransfersV357Test-413188335 None] Acquiring lock "cinder-2d5adc06-de99-4df5-a567-e928932b967f-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:25:08 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ae0ada59-81f0-41f3-948e-20f7eeff5af9 tempest-VolumesTransfersV357Test-413188335 None] Lock "cinder-2d5adc06-de99-4df5-a567-e928932b967f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:25:08 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ae0ada59-81f0-41f3-948e-20f7eeff5af9 tempest-VolumesTransfersV357Test-413188335 None] Acquiring lock "cinder-quobyte-2d5adc06-de99-4df5-a567-e928932b967f" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:25:08 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ae0ada59-81f0-41f3-948e-20f7eeff5af9 tempest-VolumesTransfersV357Test-413188335 None] Lock "cinder-quobyte-2d5adc06-de99-4df5-a567-e928932b967f" acquired by "delete_volume" :: waited 0.025s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:25:08 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e53beaf-8da7-4cc0-95f7-2fc64bdc8b46]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:25:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ae0ada59-81f0-41f3-948e-20f7eeff5af9 tempest-VolumesTransfersV357Test-413188335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2d5adc06-de99-4df5-a567-e928932b967f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:08 devstack sudo[97236]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5df9361b-1b25-4914-8b9d-e340ca2ad92b tempest-VolumesTransfersTest-302046744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1bf533be-4976-4992-aa3b-c5316328f34e" returned: 0 in 0.439s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:08 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-5df9361b-1b25-4914-8b9d-e340ca2ad92b tempest-VolumesTransfersTest-302046744 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:25:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-5df9361b-1b25-4914-8b9d-e340ca2ad92b tempest-VolumesTransfersTest-302046744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:08 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5df9361b-1b25-4914-8b9d-e340ca2ad92b tempest-VolumesTransfersTest-302046744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a060bcd-acea-4d81-80c3-b194c0cae1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bf533be-4976-4992-aa3b-c5316328f34e', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:08 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5df9361b-1b25-4914-8b9d-e340ca2ad92b tempest-VolumesTransfersTest-302046744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e827254-b31a-421f-a998-3553ec0a035f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:08 devstack sudo[97238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2d5adc06-de99-4df5-a567-e928932b967f Nov 03 20:25:08 devstack sudo[97238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:08 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-5df9361b-1b25-4914-8b9d-e340ca2ad92b tempest-VolumesTransfersTest-302046744 None] Volume volume-1bf533be-4976-4992-aa3b-c5316328f34e (1bf533be-4976-4992-aa3b-c5316328f34e): created successfully Nov 03 20:25:08 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5df9361b-1b25-4914-8b9d-e340ca2ad92b tempest-VolumesTransfersTest-302046744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e827254-b31a-421f-a998-3553ec0a035f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:08 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5df9361b-1b25-4914-8b9d-e340ca2ad92b tempest-VolumesTransfersTest-302046744 None] Flow 'volume_create_manager' (4fb3e4e7-4bc7-459b-bb9a-ac963caedbba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:08 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-5df9361b-1b25-4914-8b9d-e340ca2ad92b tempest-VolumesTransfersTest-302046744 None] Created volume successfully. Nov 03 20:25:09 devstack sudo[97238]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ae0ada59-81f0-41f3-948e-20f7eeff5af9 tempest-VolumesTransfersV357Test-413188335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2d5adc06-de99-4df5-a567-e928932b967f" returned: 0 in 0.542s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ae0ada59-81f0-41f3-948e-20f7eeff5af9 tempest-VolumesTransfersV357Test-413188335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2d5adc06-de99-4df5-a567-e928932b967f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:09 devstack sudo[97245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2d5adc06-de99-4df5-a567-e928932b967f Nov 03 20:25:09 devstack sudo[97245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:09 devstack sudo[97245]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ae0ada59-81f0-41f3-948e-20f7eeff5af9 tempest-VolumesTransfersV357Test-413188335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2d5adc06-de99-4df5-a567-e928932b967f" returned: 0 in 0.426s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:09 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ae0ada59-81f0-41f3-948e-20f7eeff5af9 tempest-VolumesTransfersV357Test-413188335 None] Lock "cinder-quobyte-2d5adc06-de99-4df5-a567-e928932b967f" released by "delete_volume" :: held 1.065s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:25:09 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-ae0ada59-81f0-41f3-948e-20f7eeff5af9 tempest-VolumesTransfersV357Test-413188335 None] Created reservations ['4dbc581e-de54-4261-b8d6-3462fedf6f76', 'f84a2dd8-0bca-4022-b029-3b232c762bde', 'e1d9fb88-3122-42bc-a584-fa6c0b149d71', '7e1b4a7a-4cf5-42c7-936f-e349a21a751f'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:25:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ae0ada59-81f0-41f3-948e-20f7eeff5af9 tempest-VolumesTransfersV357Test-413188335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ae0ada59-81f0-41f3-948e-20f7eeff5af9 tempest-VolumesTransfersV357Test-413188335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:09 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-ae0ada59-81f0-41f3-948e-20f7eeff5af9 tempest-VolumesTransfersV357Test-413188335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:25:09 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-ae0ada59-81f0-41f3-948e-20f7eeff5af9 tempest-VolumesTransfersV357Test-413188335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:25:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ae0ada59-81f0-41f3-948e-20f7eeff5af9 tempest-VolumesTransfersV357Test-413188335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ae0ada59-81f0-41f3-948e-20f7eeff5af9 tempest-VolumesTransfersV357Test-413188335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:09 devstack sudo[97248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:25:09 devstack sudo[97248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:09 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-89133045-b4a9-4f5b-896a-aa515b072a5d tempest-VolumesTransfersTest-14984373 None] Acquiring lock "cinder-1bf533be-4976-4992-aa3b-c5316328f34e-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:25:10 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-89133045-b4a9-4f5b-896a-aa515b072a5d tempest-VolumesTransfersTest-14984373 None] Lock "cinder-1bf533be-4976-4992-aa3b-c5316328f34e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:25:10 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-89133045-b4a9-4f5b-896a-aa515b072a5d tempest-VolumesTransfersTest-14984373 None] Acquiring lock "cinder-quobyte-1bf533be-4976-4992-aa3b-c5316328f34e" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:25:10 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-89133045-b4a9-4f5b-896a-aa515b072a5d tempest-VolumesTransfersTest-14984373 None] Lock "cinder-quobyte-1bf533be-4976-4992-aa3b-c5316328f34e" acquired by "delete_volume" :: waited 0.034s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:25:10 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb088a4a-306e-4d94-af41-9a305c5550a7]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:25:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-89133045-b4a9-4f5b-896a-aa515b072a5d tempest-VolumesTransfersTest-14984373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1bf533be-4976-4992-aa3b-c5316328f34e {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:10 devstack sudo[97248]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ae0ada59-81f0-41f3-948e-20f7eeff5af9 tempest-VolumesTransfersV357Test-413188335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.369s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:10 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-ae0ada59-81f0-41f3-948e-20f7eeff5af9 tempest-VolumesTransfersV357Test-413188335 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:25:10 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-ae0ada59-81f0-41f3-948e-20f7eeff5af9 tempest-VolumesTransfersV357Test-413188335 None] Deleted volume successfully. Nov 03 20:25:10 devstack sudo[97250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1bf533be-4976-4992-aa3b-c5316328f34e Nov 03 20:25:10 devstack sudo[97250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:10 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ae0ada59-81f0-41f3-948e-20f7eeff5af9 tempest-VolumesTransfersV357Test-413188335 None] Lock "cinder-2d5adc06-de99-4df5-a567-e928932b967f-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:25:10 devstack sudo[97250]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-89133045-b4a9-4f5b-896a-aa515b072a5d tempest-VolumesTransfersTest-14984373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1bf533be-4976-4992-aa3b-c5316328f34e" returned: 0 in 0.452s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-89133045-b4a9-4f5b-896a-aa515b072a5d tempest-VolumesTransfersTest-14984373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1bf533be-4976-4992-aa3b-c5316328f34e {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:10 devstack sudo[97256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1bf533be-4976-4992-aa3b-c5316328f34e Nov 03 20:25:10 devstack sudo[97256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:10 devstack sudo[97256]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-89133045-b4a9-4f5b-896a-aa515b072a5d tempest-VolumesTransfersTest-14984373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1bf533be-4976-4992-aa3b-c5316328f34e" returned: 0 in 0.312s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:10 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-89133045-b4a9-4f5b-896a-aa515b072a5d tempest-VolumesTransfersTest-14984373 None] Lock "cinder-quobyte-1bf533be-4976-4992-aa3b-c5316328f34e" released by "delete_volume" :: held 0.826s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:25:11 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-89133045-b4a9-4f5b-896a-aa515b072a5d tempest-VolumesTransfersTest-14984373 None] Created reservations ['ca0e1655-4d82-4c2a-8c65-be097bfce9aa', 'e047869e-fe89-4111-964a-f790b2a4ba30', '4e3e7d38-bd6c-4dfd-ae16-e9336b5f738c', '539b4100-7910-417c-80af-93be571a798a'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:25:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-89133045-b4a9-4f5b-896a-aa515b072a5d tempest-VolumesTransfersTest-14984373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-89133045-b4a9-4f5b-896a-aa515b072a5d tempest-VolumesTransfersTest-14984373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:11 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-89133045-b4a9-4f5b-896a-aa515b072a5d tempest-VolumesTransfersTest-14984373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:25:11 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-89133045-b4a9-4f5b-896a-aa515b072a5d tempest-VolumesTransfersTest-14984373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:25:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-89133045-b4a9-4f5b-896a-aa515b072a5d tempest-VolumesTransfersTest-14984373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-89133045-b4a9-4f5b-896a-aa515b072a5d tempest-VolumesTransfersTest-14984373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:11 devstack sudo[97259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:25:11 devstack sudo[97259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:11 devstack sudo[97259]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-89133045-b4a9-4f5b-896a-aa515b072a5d tempest-VolumesTransfersTest-14984373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.327s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:11 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-89133045-b4a9-4f5b-896a-aa515b072a5d tempest-VolumesTransfersTest-14984373 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:25:11 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-89133045-b4a9-4f5b-896a-aa515b072a5d tempest-VolumesTransfersTest-14984373 None] Deleted volume successfully. Nov 03 20:25:11 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-89133045-b4a9-4f5b-896a-aa515b072a5d tempest-VolumesTransfersTest-14984373 None] Lock "cinder-1bf533be-4976-4992-aa3b-c5316328f34e-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:25:15 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-986a5261-3777-42a7-a95e-ca0412549ea7 tempest-VolumesListTestJSON-1198716789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:25:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-986a5261-3777-42a7-a95e-ca0412549ea7 tempest-VolumesListTestJSON-1198716789 None] Flow 'volume_create_manager' (98b81d34-a7b1-4110-8885-abc073491a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-986a5261-3777-42a7-a95e-ca0412549ea7 tempest-VolumesListTestJSON-1198716789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11328bc5-41fb-4ec1-baf8-eb6c7dbe78c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-986a5261-3777-42a7-a95e-ca0412549ea7 tempest-VolumesListTestJSON-1198716789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11328bc5-41fb-4ec1-baf8-eb6c7dbe78c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2086719028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05ebd836-bb3a-4d36-a298-7bcd5fe6cb17,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0a43d0c9fc854cd0af51ba9fe953200e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:25:16Z,use_quota=True,user_id='22fd1423f8d54860b157e9e76a62549b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-986a5261-3777-42a7-a95e-ca0412549ea7 tempest-VolumesListTestJSON-1198716789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4cc70dd-3cc4-4678-84eb-9716724a290f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-986a5261-3777-42a7-a95e-ca0412549ea7 tempest-VolumesListTestJSON-1198716789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4cc70dd-3cc4-4678-84eb-9716724a290f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-986a5261-3777-42a7-a95e-ca0412549ea7 tempest-VolumesListTestJSON-1198716789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f9754a0-55f0-465b-b030-7dd47788b5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-986a5261-3777-42a7-a95e-ca0412549ea7 tempest-VolumesListTestJSON-1198716789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f9754a0-55f0-465b-b030-7dd47788b5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05ebd836-bb3a-4d36-a298-7bcd5fe6cb17', 'volume_name': 'volume-05ebd836-bb3a-4d36-a298-7bcd5fe6cb17', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-986a5261-3777-42a7-a95e-ca0412549ea7 tempest-VolumesListTestJSON-1198716789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2fa5e17-c352-4a06-b74b-e613d190e54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-986a5261-3777-42a7-a95e-ca0412549ea7 tempest-VolumesListTestJSON-1198716789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2fa5e17-c352-4a06-b74b-e613d190e54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-986a5261-3777-42a7-a95e-ca0412549ea7 tempest-VolumesListTestJSON-1198716789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (593e5820-72bf-48a2-bcc9-aae39d4f8617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:15 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-986a5261-3777-42a7-a95e-ca0412549ea7 tempest-VolumesListTestJSON-1198716789 None] Volume 05ebd836-bb3a-4d36-a298-7bcd5fe6cb17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05ebd836-bb3a-4d36-a298-7bcd5fe6cb17', 'volume_size': 1} Nov 03 20:25:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-986a5261-3777-42a7-a95e-ca0412549ea7 tempest-VolumesListTestJSON-1198716789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-986a5261-3777-42a7-a95e-ca0412549ea7 tempest-VolumesListTestJSON-1198716789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:15 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-986a5261-3777-42a7-a95e-ca0412549ea7 tempest-VolumesListTestJSON-1198716789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2086719028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05ebd836-bb3a-4d36-a298-7bcd5fe6cb17,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0a43d0c9fc854cd0af51ba9fe953200e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:25:16Z,use_quota=True,user_id='22fd1423f8d54860b157e9e76a62549b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:25:15 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-986a5261-3777-42a7-a95e-ca0412549ea7 tempest-VolumesListTestJSON-1198716789 None] Creating volume 05ebd836-bb3a-4d36-a298-7bcd5fe6cb17 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:25:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-986a5261-3777-42a7-a95e-ca0412549ea7 tempest-VolumesListTestJSON-1198716789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-986a5261-3777-42a7-a95e-ca0412549ea7 tempest-VolumesListTestJSON-1198716789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:15 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-986a5261-3777-42a7-a95e-ca0412549ea7 tempest-VolumesListTestJSON-1198716789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:25:15 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-986a5261-3777-42a7-a95e-ca0412549ea7 tempest-VolumesListTestJSON-1198716789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:25:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-986a5261-3777-42a7-a95e-ca0412549ea7 tempest-VolumesListTestJSON-1198716789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:15 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-986a5261-3777-42a7-a95e-ca0412549ea7 tempest-VolumesListTestJSON-1198716789 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:25:15 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-986a5261-3777-42a7-a95e-ca0412549ea7 tempest-VolumesListTestJSON-1198716789 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:25:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-986a5261-3777-42a7-a95e-ca0412549ea7 tempest-VolumesListTestJSON-1198716789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-05ebd836-bb3a-4d36-a298-7bcd5fe6cb17 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:15 devstack sudo[97285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-05ebd836-bb3a-4d36-a298-7bcd5fe6cb17 1073741824 Nov 03 20:25:15 devstack sudo[97285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:16 devstack sudo[97285]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-986a5261-3777-42a7-a95e-ca0412549ea7 tempest-VolumesListTestJSON-1198716789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-05ebd836-bb3a-4d36-a298-7bcd5fe6cb17 1073741824" returned: 0 in 0.618s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-986a5261-3777-42a7-a95e-ca0412549ea7 tempest-VolumesListTestJSON-1198716789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-05ebd836-bb3a-4d36-a298-7bcd5fe6cb17 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:16 devstack sudo[97291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-05ebd836-bb3a-4d36-a298-7bcd5fe6cb17 Nov 03 20:25:16 devstack sudo[97291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:16 devstack sudo[97291]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-986a5261-3777-42a7-a95e-ca0412549ea7 tempest-VolumesListTestJSON-1198716789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-05ebd836-bb3a-4d36-a298-7bcd5fe6cb17" returned: 0 in 0.260s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:16 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-986a5261-3777-42a7-a95e-ca0412549ea7 tempest-VolumesListTestJSON-1198716789 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:25:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-986a5261-3777-42a7-a95e-ca0412549ea7 tempest-VolumesListTestJSON-1198716789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:16 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-986a5261-3777-42a7-a95e-ca0412549ea7 tempest-VolumesListTestJSON-1198716789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (593e5820-72bf-48a2-bcc9-aae39d4f8617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05ebd836-bb3a-4d36-a298-7bcd5fe6cb17', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:16 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-986a5261-3777-42a7-a95e-ca0412549ea7 tempest-VolumesListTestJSON-1198716789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93092c47-c735-4895-b29d-7cbe7b335c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:16 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-986a5261-3777-42a7-a95e-ca0412549ea7 tempest-VolumesListTestJSON-1198716789 None] Volume volume-05ebd836-bb3a-4d36-a298-7bcd5fe6cb17 (05ebd836-bb3a-4d36-a298-7bcd5fe6cb17): created successfully Nov 03 20:25:16 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-986a5261-3777-42a7-a95e-ca0412549ea7 tempest-VolumesListTestJSON-1198716789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93092c47-c735-4895-b29d-7cbe7b335c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:16 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-986a5261-3777-42a7-a95e-ca0412549ea7 tempest-VolumesListTestJSON-1198716789 None] Flow 'volume_create_manager' (98b81d34-a7b1-4110-8885-abc073491a01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:16 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-986a5261-3777-42a7-a95e-ca0412549ea7 tempest-VolumesListTestJSON-1198716789 None] Created volume successfully. Nov 03 20:25:18 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc9bc7a2-03bb-45d1-919a-065453ae59b5 tempest-VolumesListTestJSON-1198716789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:25:18 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-dc9bc7a2-03bb-45d1-919a-065453ae59b5 tempest-VolumesListTestJSON-1198716789 None] Flow 'volume_create_manager' (791afda2-fe6d-4fa6-b482-75bcb86e683b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:18 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-dc9bc7a2-03bb-45d1-919a-065453ae59b5 tempest-VolumesListTestJSON-1198716789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31331247-6be6-4537-98b6-f6330fa240bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:18 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-dc9bc7a2-03bb-45d1-919a-065453ae59b5 tempest-VolumesListTestJSON-1198716789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31331247-6be6-4537-98b6-f6330fa240bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-54790544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25d77441-9097-4032-9429-6c50a1fc195f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0a43d0c9fc854cd0af51ba9fe953200e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:25:18Z,use_quota=True,user_id='22fd1423f8d54860b157e9e76a62549b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:18 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-dc9bc7a2-03bb-45d1-919a-065453ae59b5 tempest-VolumesListTestJSON-1198716789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d944394-8385-40e4-b400-8073907c1d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:18 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-dc9bc7a2-03bb-45d1-919a-065453ae59b5 tempest-VolumesListTestJSON-1198716789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d944394-8385-40e4-b400-8073907c1d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:18 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-dc9bc7a2-03bb-45d1-919a-065453ae59b5 tempest-VolumesListTestJSON-1198716789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06781924-c02b-4586-acc8-30ca4721d7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:18 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-dc9bc7a2-03bb-45d1-919a-065453ae59b5 tempest-VolumesListTestJSON-1198716789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06781924-c02b-4586-acc8-30ca4721d7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25d77441-9097-4032-9429-6c50a1fc195f', 'volume_name': 'volume-25d77441-9097-4032-9429-6c50a1fc195f', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:18 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-dc9bc7a2-03bb-45d1-919a-065453ae59b5 tempest-VolumesListTestJSON-1198716789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd9060d0-b60b-4106-b7b9-6a94975765d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:18 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-dc9bc7a2-03bb-45d1-919a-065453ae59b5 tempest-VolumesListTestJSON-1198716789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd9060d0-b60b-4106-b7b9-6a94975765d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:18 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-dc9bc7a2-03bb-45d1-919a-065453ae59b5 tempest-VolumesListTestJSON-1198716789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92d2f103-9d39-4337-8ee2-c5956faab651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:18 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-dc9bc7a2-03bb-45d1-919a-065453ae59b5 tempest-VolumesListTestJSON-1198716789 None] Volume 25d77441-9097-4032-9429-6c50a1fc195f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25d77441-9097-4032-9429-6c50a1fc195f', 'volume_size': 1} Nov 03 20:25:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-dc9bc7a2-03bb-45d1-919a-065453ae59b5 tempest-VolumesListTestJSON-1198716789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-dc9bc7a2-03bb-45d1-919a-065453ae59b5 tempest-VolumesListTestJSON-1198716789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:18 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-dc9bc7a2-03bb-45d1-919a-065453ae59b5 tempest-VolumesListTestJSON-1198716789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-54790544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25d77441-9097-4032-9429-6c50a1fc195f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0a43d0c9fc854cd0af51ba9fe953200e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:25:18Z,use_quota=True,user_id='22fd1423f8d54860b157e9e76a62549b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:25:18 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-dc9bc7a2-03bb-45d1-919a-065453ae59b5 tempest-VolumesListTestJSON-1198716789 None] Creating volume 25d77441-9097-4032-9429-6c50a1fc195f {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:25:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-dc9bc7a2-03bb-45d1-919a-065453ae59b5 tempest-VolumesListTestJSON-1198716789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-dc9bc7a2-03bb-45d1-919a-065453ae59b5 tempest-VolumesListTestJSON-1198716789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:18 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-dc9bc7a2-03bb-45d1-919a-065453ae59b5 tempest-VolumesListTestJSON-1198716789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:25:18 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-dc9bc7a2-03bb-45d1-919a-065453ae59b5 tempest-VolumesListTestJSON-1198716789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:25:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-dc9bc7a2-03bb-45d1-919a-065453ae59b5 tempest-VolumesListTestJSON-1198716789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:18 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-dc9bc7a2-03bb-45d1-919a-065453ae59b5 tempest-VolumesListTestJSON-1198716789 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:25:18 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-dc9bc7a2-03bb-45d1-919a-065453ae59b5 tempest-VolumesListTestJSON-1198716789 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:25:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-dc9bc7a2-03bb-45d1-919a-065453ae59b5 tempest-VolumesListTestJSON-1198716789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-25d77441-9097-4032-9429-6c50a1fc195f 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:18 devstack sudo[97294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-25d77441-9097-4032-9429-6c50a1fc195f 1073741824 Nov 03 20:25:18 devstack sudo[97294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:18 devstack sudo[97294]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-dc9bc7a2-03bb-45d1-919a-065453ae59b5 tempest-VolumesListTestJSON-1198716789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-25d77441-9097-4032-9429-6c50a1fc195f 1073741824" returned: 0 in 0.483s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-dc9bc7a2-03bb-45d1-919a-065453ae59b5 tempest-VolumesListTestJSON-1198716789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-25d77441-9097-4032-9429-6c50a1fc195f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:19 devstack sudo[97300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-25d77441-9097-4032-9429-6c50a1fc195f Nov 03 20:25:19 devstack sudo[97300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:19 devstack sudo[97300]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-dc9bc7a2-03bb-45d1-919a-065453ae59b5 tempest-VolumesListTestJSON-1198716789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-25d77441-9097-4032-9429-6c50a1fc195f" returned: 0 in 0.262s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:19 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-dc9bc7a2-03bb-45d1-919a-065453ae59b5 tempest-VolumesListTestJSON-1198716789 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:25:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-dc9bc7a2-03bb-45d1-919a-065453ae59b5 tempest-VolumesListTestJSON-1198716789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:19 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-dc9bc7a2-03bb-45d1-919a-065453ae59b5 tempest-VolumesListTestJSON-1198716789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92d2f103-9d39-4337-8ee2-c5956faab651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25d77441-9097-4032-9429-6c50a1fc195f', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:19 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-dc9bc7a2-03bb-45d1-919a-065453ae59b5 tempest-VolumesListTestJSON-1198716789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04b99360-43e8-4873-af1b-b8e6b1219d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:19 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-dc9bc7a2-03bb-45d1-919a-065453ae59b5 tempest-VolumesListTestJSON-1198716789 None] Volume volume-25d77441-9097-4032-9429-6c50a1fc195f (25d77441-9097-4032-9429-6c50a1fc195f): created successfully Nov 03 20:25:19 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-dc9bc7a2-03bb-45d1-919a-065453ae59b5 tempest-VolumesListTestJSON-1198716789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04b99360-43e8-4873-af1b-b8e6b1219d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:19 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-dc9bc7a2-03bb-45d1-919a-065453ae59b5 tempest-VolumesListTestJSON-1198716789 None] Flow 'volume_create_manager' (791afda2-fe6d-4fa6-b482-75bcb86e683b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:19 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-dc9bc7a2-03bb-45d1-919a-065453ae59b5 tempest-VolumesListTestJSON-1198716789 None] Created volume successfully. Nov 03 20:25:19 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-702bc547-1450-4942-97db-a17495876bf0 tempest-VolumesCloneTest-1896973397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:25:19 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-702bc547-1450-4942-97db-a17495876bf0 tempest-VolumesCloneTest-1896973397 None] Flow 'volume_create_manager' (50aa361d-3f17-4e77-9604-eaf991bacd51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:19 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-702bc547-1450-4942-97db-a17495876bf0 tempest-VolumesCloneTest-1896973397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e2abd37-b79a-40dc-8a4c-201741f68d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:19 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-702bc547-1450-4942-97db-a17495876bf0 tempest-VolumesCloneTest-1896973397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e2abd37-b79a-40dc-8a4c-201741f68d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:25:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1135463588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b9afc5f-8b43-4f86-a425-2953b02d7027,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40fbe59185e54f33aa0ccb64117e499d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:25:20Z,use_quota=True,user_id='8607b3b507184c2d8c205729014ccce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:19 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-702bc547-1450-4942-97db-a17495876bf0 tempest-VolumesCloneTest-1896973397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d37493a-f6e8-4d70-af44-6e99cb9fd773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:19 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-702bc547-1450-4942-97db-a17495876bf0 tempest-VolumesCloneTest-1896973397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d37493a-f6e8-4d70-af44-6e99cb9fd773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:19 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-702bc547-1450-4942-97db-a17495876bf0 tempest-VolumesCloneTest-1896973397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dda07dae-04ff-4978-be56-9fd24a684938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:19 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-702bc547-1450-4942-97db-a17495876bf0 tempest-VolumesCloneTest-1896973397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dda07dae-04ff-4978-be56-9fd24a684938) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b9afc5f-8b43-4f86-a425-2953b02d7027', 'volume_name': 'volume-0b9afc5f-8b43-4f86-a425-2953b02d7027', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:19 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-702bc547-1450-4942-97db-a17495876bf0 tempest-VolumesCloneTest-1896973397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e167903-8d1e-410d-8a41-b84983317905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:19 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-702bc547-1450-4942-97db-a17495876bf0 tempest-VolumesCloneTest-1896973397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e167903-8d1e-410d-8a41-b84983317905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:19 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-702bc547-1450-4942-97db-a17495876bf0 tempest-VolumesCloneTest-1896973397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53f7eb3d-257a-4cd0-836e-4b2ac1df1fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:19 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-702bc547-1450-4942-97db-a17495876bf0 tempest-VolumesCloneTest-1896973397 None] Volume 0b9afc5f-8b43-4f86-a425-2953b02d7027: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b9afc5f-8b43-4f86-a425-2953b02d7027', 'volume_size': 1} Nov 03 20:25:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-702bc547-1450-4942-97db-a17495876bf0 tempest-VolumesCloneTest-1896973397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-702bc547-1450-4942-97db-a17495876bf0 tempest-VolumesCloneTest-1896973397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:19 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-702bc547-1450-4942-97db-a17495876bf0 tempest-VolumesCloneTest-1896973397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:25:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1135463588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b9afc5f-8b43-4f86-a425-2953b02d7027,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40fbe59185e54f33aa0ccb64117e499d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:25:20Z,use_quota=True,user_id='8607b3b507184c2d8c205729014ccce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:25:19 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-702bc547-1450-4942-97db-a17495876bf0 tempest-VolumesCloneTest-1896973397 None] Creating volume 0b9afc5f-8b43-4f86-a425-2953b02d7027 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:25:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-702bc547-1450-4942-97db-a17495876bf0 tempest-VolumesCloneTest-1896973397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-702bc547-1450-4942-97db-a17495876bf0 tempest-VolumesCloneTest-1896973397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:19 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-702bc547-1450-4942-97db-a17495876bf0 tempest-VolumesCloneTest-1896973397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:25:19 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-702bc547-1450-4942-97db-a17495876bf0 tempest-VolumesCloneTest-1896973397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:25:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-702bc547-1450-4942-97db-a17495876bf0 tempest-VolumesCloneTest-1896973397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:19 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-702bc547-1450-4942-97db-a17495876bf0 tempest-VolumesCloneTest-1896973397 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:25:19 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-702bc547-1450-4942-97db-a17495876bf0 tempest-VolumesCloneTest-1896973397 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:25:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-702bc547-1450-4942-97db-a17495876bf0 tempest-VolumesCloneTest-1896973397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:19 devstack sudo[97303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027 1073741824 Nov 03 20:25:19 devstack sudo[97303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:19 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d8f72ec-f74a-4cd7-858d-3cac9baa7346 tempest-VolumesGetTest-644387191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:25:19 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6d8f72ec-f74a-4cd7-858d-3cac9baa7346 tempest-VolumesGetTest-644387191 None] Flow 'volume_create_manager' (3482db69-42b5-40c9-b38b-1d2a08a0574e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:19 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6d8f72ec-f74a-4cd7-858d-3cac9baa7346 tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e07f7c5d-50a7-47f2-ab57-b1d8e044eca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:19 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6d8f72ec-f74a-4cd7-858d-3cac9baa7346 tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e07f7c5d-50a7-47f2-ab57-b1d8e044eca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:25:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1853471826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2f9b069-1ff9-4b71-913c-f4159b05882d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7ab0e227a82349bc909b7d4688755960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:25:20Z,use_quota=True,user_id='46e27afb1f9e4540be79dd576cbaaaeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:19 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6d8f72ec-f74a-4cd7-858d-3cac9baa7346 tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d37217b3-856d-4770-a670-583728bc9326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:19 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6d8f72ec-f74a-4cd7-858d-3cac9baa7346 tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d37217b3-856d-4770-a670-583728bc9326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:19 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6d8f72ec-f74a-4cd7-858d-3cac9baa7346 tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0a614c9-0001-44bd-8e05-4372bb1e26a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:19 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6d8f72ec-f74a-4cd7-858d-3cac9baa7346 tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0a614c9-0001-44bd-8e05-4372bb1e26a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2f9b069-1ff9-4b71-913c-f4159b05882d', 'volume_name': 'volume-f2f9b069-1ff9-4b71-913c-f4159b05882d', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:19 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6d8f72ec-f74a-4cd7-858d-3cac9baa7346 tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f353429-0740-4753-8c96-11bab7b53531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:19 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6d8f72ec-f74a-4cd7-858d-3cac9baa7346 tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f353429-0740-4753-8c96-11bab7b53531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:19 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6d8f72ec-f74a-4cd7-858d-3cac9baa7346 tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (014f3d0d-b155-426a-93ed-efe2b87819d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:19 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-6d8f72ec-f74a-4cd7-858d-3cac9baa7346 tempest-VolumesGetTest-644387191 None] Volume f2f9b069-1ff9-4b71-913c-f4159b05882d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2f9b069-1ff9-4b71-913c-f4159b05882d', 'volume_size': 1} Nov 03 20:25:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6d8f72ec-f74a-4cd7-858d-3cac9baa7346 tempest-VolumesGetTest-644387191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:20 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff8fa445-4ae7-47ca-867c-6ce7b2195528 tempest-VolumesListTestJSON-1198716789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:25:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ff8fa445-4ae7-47ca-867c-6ce7b2195528 tempest-VolumesListTestJSON-1198716789 None] Flow 'volume_create_manager' (2424945a-b72f-4f8d-aa95-da75deeae214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ff8fa445-4ae7-47ca-867c-6ce7b2195528 tempest-VolumesListTestJSON-1198716789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce43acfe-6e1b-45f2-9f00-c94a278b209d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ff8fa445-4ae7-47ca-867c-6ce7b2195528 tempest-VolumesListTestJSON-1198716789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce43acfe-6e1b-45f2-9f00-c94a278b209d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1035302845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70a16fa0-732f-44a2-bfe2-9b45d4071288,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0a43d0c9fc854cd0af51ba9fe953200e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:25:20Z,use_quota=True,user_id='22fd1423f8d54860b157e9e76a62549b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ff8fa445-4ae7-47ca-867c-6ce7b2195528 tempest-VolumesListTestJSON-1198716789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62c538f0-a0f3-48c1-b892-4d90e8d411a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ff8fa445-4ae7-47ca-867c-6ce7b2195528 tempest-VolumesListTestJSON-1198716789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62c538f0-a0f3-48c1-b892-4d90e8d411a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ff8fa445-4ae7-47ca-867c-6ce7b2195528 tempest-VolumesListTestJSON-1198716789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04b34e7a-ba3a-47db-b732-0d36d587debe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ff8fa445-4ae7-47ca-867c-6ce7b2195528 tempest-VolumesListTestJSON-1198716789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04b34e7a-ba3a-47db-b732-0d36d587debe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70a16fa0-732f-44a2-bfe2-9b45d4071288', 'volume_name': 'volume-70a16fa0-732f-44a2-bfe2-9b45d4071288', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ff8fa445-4ae7-47ca-867c-6ce7b2195528 tempest-VolumesListTestJSON-1198716789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54f02f45-cbf8-4b5b-8263-23048cffb81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ff8fa445-4ae7-47ca-867c-6ce7b2195528 tempest-VolumesListTestJSON-1198716789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54f02f45-cbf8-4b5b-8263-23048cffb81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ff8fa445-4ae7-47ca-867c-6ce7b2195528 tempest-VolumesListTestJSON-1198716789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd867660-6588-41f7-8c3a-cd7d3a5f5051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:20 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-ff8fa445-4ae7-47ca-867c-6ce7b2195528 tempest-VolumesListTestJSON-1198716789 None] Volume 70a16fa0-732f-44a2-bfe2-9b45d4071288: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70a16fa0-732f-44a2-bfe2-9b45d4071288', 'volume_size': 1} Nov 03 20:25:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ff8fa445-4ae7-47ca-867c-6ce7b2195528 tempest-VolumesListTestJSON-1198716789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:20 devstack sudo[97303]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-702bc547-1450-4942-97db-a17495876bf0 tempest-VolumesCloneTest-1896973397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027 1073741824" returned: 0 in 0.455s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-702bc547-1450-4942-97db-a17495876bf0 tempest-VolumesCloneTest-1896973397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:20 devstack sudo[97309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027 Nov 03 20:25:20 devstack sudo[97309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:20 devstack sudo[97309]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-702bc547-1450-4942-97db-a17495876bf0 tempest-VolumesCloneTest-1896973397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027" returned: 0 in 0.251s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:20 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-702bc547-1450-4942-97db-a17495876bf0 tempest-VolumesCloneTest-1896973397 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:25:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-702bc547-1450-4942-97db-a17495876bf0 tempest-VolumesCloneTest-1896973397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6d8f72ec-f74a-4cd7-858d-3cac9baa7346 tempest-VolumesGetTest-644387191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.624s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:20 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-6d8f72ec-f74a-4cd7-858d-3cac9baa7346 tempest-VolumesGetTest-644387191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:25:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1853471826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2f9b069-1ff9-4b71-913c-f4159b05882d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7ab0e227a82349bc909b7d4688755960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:25:20Z,use_quota=True,user_id='46e27afb1f9e4540be79dd576cbaaaeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:25:20 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-6d8f72ec-f74a-4cd7-858d-3cac9baa7346 tempest-VolumesGetTest-644387191 None] Creating volume f2f9b069-1ff9-4b71-913c-f4159b05882d {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:25:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6d8f72ec-f74a-4cd7-858d-3cac9baa7346 tempest-VolumesGetTest-644387191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6d8f72ec-f74a-4cd7-858d-3cac9baa7346 tempest-VolumesGetTest-644387191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:20 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-6d8f72ec-f74a-4cd7-858d-3cac9baa7346 tempest-VolumesGetTest-644387191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:25:20 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-6d8f72ec-f74a-4cd7-858d-3cac9baa7346 tempest-VolumesGetTest-644387191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:25:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6d8f72ec-f74a-4cd7-858d-3cac9baa7346 tempest-VolumesGetTest-644387191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:20 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-6d8f72ec-f74a-4cd7-858d-3cac9baa7346 tempest-VolumesGetTest-644387191 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:25:20 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-6d8f72ec-f74a-4cd7-858d-3cac9baa7346 tempest-VolumesGetTest-644387191 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:25:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6d8f72ec-f74a-4cd7-858d-3cac9baa7346 tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2f9b069-1ff9-4b71-913c-f4159b05882d 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:20 devstack sudo[97312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2f9b069-1ff9-4b71-913c-f4159b05882d 1073741824 Nov 03 20:25:20 devstack sudo[97312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-702bc547-1450-4942-97db-a17495876bf0 tempest-VolumesCloneTest-1896973397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53f7eb3d-257a-4cd0-836e-4b2ac1df1fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b9afc5f-8b43-4f86-a425-2953b02d7027', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-702bc547-1450-4942-97db-a17495876bf0 tempest-VolumesCloneTest-1896973397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7db94010-3dcb-4502-9fd7-762fe60494eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:20 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-702bc547-1450-4942-97db-a17495876bf0 tempest-VolumesCloneTest-1896973397 None] Volume volume-0b9afc5f-8b43-4f86-a425-2953b02d7027 (0b9afc5f-8b43-4f86-a425-2953b02d7027): created successfully Nov 03 20:25:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-702bc547-1450-4942-97db-a17495876bf0 tempest-VolumesCloneTest-1896973397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7db94010-3dcb-4502-9fd7-762fe60494eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-702bc547-1450-4942-97db-a17495876bf0 tempest-VolumesCloneTest-1896973397 None] Flow 'volume_create_manager' (50aa361d-3f17-4e77-9604-eaf991bacd51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:20 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-702bc547-1450-4942-97db-a17495876bf0 tempest-VolumesCloneTest-1896973397 None] Created volume successfully. Nov 03 20:25:21 devstack sudo[97312]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6d8f72ec-f74a-4cd7-858d-3cac9baa7346 tempest-VolumesGetTest-644387191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2f9b069-1ff9-4b71-913c-f4159b05882d 1073741824" returned: 0 in 0.447s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6d8f72ec-f74a-4cd7-858d-3cac9baa7346 tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2f9b069-1ff9-4b71-913c-f4159b05882d {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:21 devstack sudo[97318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2f9b069-1ff9-4b71-913c-f4159b05882d Nov 03 20:25:21 devstack sudo[97318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:21 devstack sudo[97318]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6d8f72ec-f74a-4cd7-858d-3cac9baa7346 tempest-VolumesGetTest-644387191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2f9b069-1ff9-4b71-913c-f4159b05882d" returned: 0 in 0.242s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-6d8f72ec-f74a-4cd7-858d-3cac9baa7346 tempest-VolumesGetTest-644387191 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:25:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6d8f72ec-f74a-4cd7-858d-3cac9baa7346 tempest-VolumesGetTest-644387191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ff8fa445-4ae7-47ca-867c-6ce7b2195528 tempest-VolumesListTestJSON-1198716789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.219s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-ff8fa445-4ae7-47ca-867c-6ce7b2195528 tempest-VolumesListTestJSON-1198716789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1035302845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70a16fa0-732f-44a2-bfe2-9b45d4071288,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0a43d0c9fc854cd0af51ba9fe953200e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:25:20Z,use_quota=True,user_id='22fd1423f8d54860b157e9e76a62549b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:25:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-ff8fa445-4ae7-47ca-867c-6ce7b2195528 tempest-VolumesListTestJSON-1198716789 None] Creating volume 70a16fa0-732f-44a2-bfe2-9b45d4071288 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:25:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ff8fa445-4ae7-47ca-867c-6ce7b2195528 tempest-VolumesListTestJSON-1198716789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ff8fa445-4ae7-47ca-867c-6ce7b2195528 tempest-VolumesListTestJSON-1198716789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-ff8fa445-4ae7-47ca-867c-6ce7b2195528 tempest-VolumesListTestJSON-1198716789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:25:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-ff8fa445-4ae7-47ca-867c-6ce7b2195528 tempest-VolumesListTestJSON-1198716789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:25:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ff8fa445-4ae7-47ca-867c-6ce7b2195528 tempest-VolumesListTestJSON-1198716789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-ff8fa445-4ae7-47ca-867c-6ce7b2195528 tempest-VolumesListTestJSON-1198716789 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:25:21 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-ff8fa445-4ae7-47ca-867c-6ce7b2195528 tempest-VolumesListTestJSON-1198716789 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:25:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ff8fa445-4ae7-47ca-867c-6ce7b2195528 tempest-VolumesListTestJSON-1198716789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-70a16fa0-732f-44a2-bfe2-9b45d4071288 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:21 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6d8f72ec-f74a-4cd7-858d-3cac9baa7346 tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (014f3d0d-b155-426a-93ed-efe2b87819d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2f9b069-1ff9-4b71-913c-f4159b05882d', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:21 devstack sudo[97321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-70a16fa0-732f-44a2-bfe2-9b45d4071288 1073741824 Nov 03 20:25:21 devstack sudo[97321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:21 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6d8f72ec-f74a-4cd7-858d-3cac9baa7346 tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2133028e-bb0c-41fe-ac2e-070b4046f073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:21 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-6d8f72ec-f74a-4cd7-858d-3cac9baa7346 tempest-VolumesGetTest-644387191 None] Volume volume-f2f9b069-1ff9-4b71-913c-f4159b05882d (f2f9b069-1ff9-4b71-913c-f4159b05882d): created successfully Nov 03 20:25:21 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6d8f72ec-f74a-4cd7-858d-3cac9baa7346 tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2133028e-bb0c-41fe-ac2e-070b4046f073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:21 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6d8f72ec-f74a-4cd7-858d-3cac9baa7346 tempest-VolumesGetTest-644387191 None] Flow 'volume_create_manager' (3482db69-42b5-40c9-b38b-1d2a08a0574e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:21 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-6d8f72ec-f74a-4cd7-858d-3cac9baa7346 tempest-VolumesGetTest-644387191 None] Created volume successfully. Nov 03 20:25:21 devstack sudo[97321]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ff8fa445-4ae7-47ca-867c-6ce7b2195528 tempest-VolumesListTestJSON-1198716789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-70a16fa0-732f-44a2-bfe2-9b45d4071288 1073741824" returned: 0 in 0.482s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ff8fa445-4ae7-47ca-867c-6ce7b2195528 tempest-VolumesListTestJSON-1198716789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-70a16fa0-732f-44a2-bfe2-9b45d4071288 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:21 devstack sudo[97328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-70a16fa0-732f-44a2-bfe2-9b45d4071288 Nov 03 20:25:21 devstack sudo[97328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:22 devstack sudo[97328]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ff8fa445-4ae7-47ca-867c-6ce7b2195528 tempest-VolumesListTestJSON-1198716789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-70a16fa0-732f-44a2-bfe2-9b45d4071288" returned: 0 in 0.449s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:22 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-ff8fa445-4ae7-47ca-867c-6ce7b2195528 tempest-VolumesListTestJSON-1198716789 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:25:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ff8fa445-4ae7-47ca-867c-6ce7b2195528 tempest-VolumesListTestJSON-1198716789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ff8fa445-4ae7-47ca-867c-6ce7b2195528 tempest-VolumesListTestJSON-1198716789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd867660-6588-41f7-8c3a-cd7d3a5f5051) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70a16fa0-732f-44a2-bfe2-9b45d4071288', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ff8fa445-4ae7-47ca-867c-6ce7b2195528 tempest-VolumesListTestJSON-1198716789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (380fcd75-9b75-4838-9b73-dede95affe79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:22 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:25:22 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-ff8fa445-4ae7-47ca-867c-6ce7b2195528 tempest-VolumesListTestJSON-1198716789 None] Volume volume-70a16fa0-732f-44a2-bfe2-9b45d4071288 (70a16fa0-732f-44a2-bfe2-9b45d4071288): created successfully Nov 03 20:25:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ff8fa445-4ae7-47ca-867c-6ce7b2195528 tempest-VolumesListTestJSON-1198716789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (380fcd75-9b75-4838-9b73-dede95affe79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ff8fa445-4ae7-47ca-867c-6ce7b2195528 tempest-VolumesListTestJSON-1198716789 None] Flow 'volume_create_manager' (2424945a-b72f-4f8d-aa95-da75deeae214) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Flow 'volume_create_manager' (f34ea4e1-e16c-4075-a67b-225bd59cca6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ebf713d-4f11-42c0-a9bd-c8fde83da833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ebf713d-4f11-42c0-a9bd-c8fde83da833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1514037017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df368e2a-4e0d-4b34-986b-d0ff8214b5cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40fbe59185e54f33aa0ccb64117e499d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:25:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=0b9afc5f-8b43-4f86-a425-2953b02d7027,status='creating',terminated_at=None,updated_at=2026-11-03T19:25:22Z,use_quota=True,user_id='8607b3b507184c2d8c205729014ccce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cc71842-b65a-48ae-81a9-b188ed82af15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cc71842-b65a-48ae-81a9-b188ed82af15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f2e9d37-a551-47bd-b334-c640bda171ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:22 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-ff8fa445-4ae7-47ca-867c-6ce7b2195528 tempest-VolumesListTestJSON-1198716789 None] Created volume successfully. Nov 03 20:25:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f2e9d37-a551-47bd-b334-c640bda171ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'df368e2a-4e0d-4b34-986b-d0ff8214b5cc', 'volume_name': 'volume-df368e2a-4e0d-4b34-986b-d0ff8214b5cc', 'volume_size': 2, 'source_volid': '0b9afc5f-8b43-4f86-a425-2953b02d7027', 'source_volstatus': 'available'}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbda81c4-8aff-4e13-bc99-83db8f012ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbda81c4-8aff-4e13-bc99-83db8f012ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d402cf72-31a3-4961-ac42-6da1b4f83c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:22 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Volume df368e2a-4e0d-4b34-986b-d0ff8214b5cc: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-df368e2a-4e0d-4b34-986b-d0ff8214b5cc', 'volume_size': 2, 'source_volid': '0b9afc5f-8b43-4f86-a425-2953b02d7027', 'source_volstatus': 'available'} Nov 03 20:25:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:22 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Cloning volume 0b9afc5f-8b43-4f86-a425-2953b02d7027 to volume df368e2a-4e0d-4b34-986b-d0ff8214b5cc Nov 03 20:25:22 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Creating offline snapshot 31f24dd9-acdd-4e29-bb69-345fa8455510 of volume 0b9afc5f-8b43-4f86-a425-2953b02d7027 {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:25:22 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1cc981-c72f-4de7-89ae-80c9ab7b7ab7]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:25:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:22 devstack sudo[97425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027 Nov 03 20:25:22 devstack sudo[97425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:22 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-5743216c-21f5-44c3-883e-44039018dedc tempest-VolumesGetTest-644387191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:25:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5743216c-21f5-44c3-883e-44039018dedc tempest-VolumesGetTest-644387191 None] Flow 'volume_create_manager' (3e42b071-d16c-45ff-8a15-2fb42b0d81dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5743216c-21f5-44c3-883e-44039018dedc tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83f5e474-1547-4f79-bf02-dd91f2e22020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5743216c-21f5-44c3-883e-44039018dedc tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83f5e474-1547-4f79-bf02-dd91f2e22020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:25:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1316142555',display_name='tempest-VolumesGetTest-Volume-1422541644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=271a4d94-235e-4887-b6ac-9610b3f42534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ab0e227a82349bc909b7d4688755960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:25:23Z,use_quota=True,user_id='46e27afb1f9e4540be79dd576cbaaaeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5743216c-21f5-44c3-883e-44039018dedc tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (911f32e0-090b-4d7a-b92c-6d305dd3798b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5743216c-21f5-44c3-883e-44039018dedc tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (911f32e0-090b-4d7a-b92c-6d305dd3798b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5743216c-21f5-44c3-883e-44039018dedc tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac0098c9-7d9b-4c21-90d9-32f78ef7cd57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5743216c-21f5-44c3-883e-44039018dedc tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac0098c9-7d9b-4c21-90d9-32f78ef7cd57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '271a4d94-235e-4887-b6ac-9610b3f42534', 'volume_name': 'volume-271a4d94-235e-4887-b6ac-9610b3f42534', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5743216c-21f5-44c3-883e-44039018dedc tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e9e496c-1143-4e6c-a384-b369834b4cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5743216c-21f5-44c3-883e-44039018dedc tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e9e496c-1143-4e6c-a384-b369834b4cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5743216c-21f5-44c3-883e-44039018dedc tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f3ed33f-958c-45e8-8fee-87a37170af36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:22 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-5743216c-21f5-44c3-883e-44039018dedc tempest-VolumesGetTest-644387191 None] Volume 271a4d94-235e-4887-b6ac-9610b3f42534: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-271a4d94-235e-4887-b6ac-9610b3f42534', 'volume_size': 1} Nov 03 20:25:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-5743216c-21f5-44c3-883e-44039018dedc tempest-VolumesGetTest-644387191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:23 devstack sudo[97425]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027" returned: 0 in 0.433s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027.31f24dd9-acdd-4e29-bb69-345fa8455510 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:23 devstack sudo[97430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027.31f24dd9-acdd-4e29-bb69-345fa8455510 1G Nov 03 20:25:23 devstack sudo[97430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:23 devstack sudo[97430]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027.31f24dd9-acdd-4e29-bb69-345fa8455510 1G" returned: 0 in 0.521s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b9afc5f-8b43-4f86-a425-2953b02d7027 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027.31f24dd9-acdd-4e29-bb69-345fa8455510 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:23 devstack sudo[97436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b9afc5f-8b43-4f86-a425-2953b02d7027 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027.31f24dd9-acdd-4e29-bb69-345fa8455510 Nov 03 20:25:23 devstack sudo[97436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:23 devstack sudo[97436]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b9afc5f-8b43-4f86-a425-2953b02d7027 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027.31f24dd9-acdd-4e29-bb69-345fa8455510" returned: 0 in 0.320s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:23 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027.31f24dd9-acdd-4e29-bb69-345fa8455510 is being set with open permissions: ugo+rw Nov 03 20:25:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027.31f24dd9-acdd-4e29-bb69-345fa8455510 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:23 devstack sudo[97441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027.31f24dd9-acdd-4e29-bb69-345fa8455510 Nov 03 20:25:23 devstack sudo[97441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:24 devstack sudo[97441]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027.31f24dd9-acdd-4e29-bb69-345fa8455510" returned: 0 in 0.264s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:24 devstack sudo[97444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027.info Nov 03 20:25:24 devstack sudo[97444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:24 devstack sudo[97444]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027.info" returned: 0 in 0.306s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:24 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027.info is being set with open permissions: ugo+rw Nov 03 20:25:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:24 devstack sudo[97447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027.info Nov 03 20:25:24 devstack sudo[97447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:24 devstack sudo[97447]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027.info" returned: 0 in 0.269s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:24 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Acquiring lock "cinder-quobyte-df368e2a-4e0d-4b34-986b-d0ff8214b5cc" by "_copy_volume_from_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:25:24 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Lock "cinder-quobyte-df368e2a-4e0d-4b34-986b-d0ff8214b5cc" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:25:24 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] snapshot: 31f24dd9-acdd-4e29-bb69-345fa8455510, volume: df368e2a-4e0d-4b34-986b-d0ff8214b5cc, {{(pid=87248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 20:25:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:24 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:25:24 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:25:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:24 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[828da5f6-8fa9-4b58-bb9f-c7a8ed25bb63]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:25:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027.31f24dd9-acdd-4e29-bb69-345fa8455510 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:24 devstack sudo[97450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027.31f24dd9-acdd-4e29-bb69-345fa8455510 Nov 03 20:25:24 devstack sudo[97450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:25 devstack sudo[97450]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027.31f24dd9-acdd-4e29-bb69-345fa8455510" returned: 0 in 0.397s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:25 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b9afc5f-8b43-4f86-a425-2953b02d7027(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:25:25 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca65215a-b5da-465f-8b59-7436a88153ff]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:25:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:25 devstack sudo[97455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027 Nov 03 20:25:25 devstack sudo[97455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:25 devstack sudo[97455]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027" returned: 0 in 0.419s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:25 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027 {{(pid=87248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 20:25:25 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Creating direct copy from snapshot {{(pid=87248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 20:25:25 devstack cinder-volume[87248]: DEBUG cinder.utils [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Path /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-df368e2a-4e0d-4b34-986b-d0ff8214b5cc not found in is_blk_device check {{(pid=87248) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 20:25:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-df368e2a-4e0d-4b34-986b-d0ff8214b5cc {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:25 devstack sudo[97461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-df368e2a-4e0d-4b34-986b-d0ff8214b5cc Nov 03 20:25:25 devstack sudo[97461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:25 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-78502461-93a7-4f69-8eb4-f1d8667d1982 tempest-VolumesListTestJSON-1198716789 None] Acquiring lock "cinder-70a16fa0-732f-44a2-bfe2-9b45d4071288-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:25:25 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-78502461-93a7-4f69-8eb4-f1d8667d1982 tempest-VolumesListTestJSON-1198716789 None] Lock "cinder-70a16fa0-732f-44a2-bfe2-9b45d4071288-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:25:25 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-78502461-93a7-4f69-8eb4-f1d8667d1982 tempest-VolumesListTestJSON-1198716789 None] Acquiring lock "cinder-quobyte-70a16fa0-732f-44a2-bfe2-9b45d4071288" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:25:25 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-78502461-93a7-4f69-8eb4-f1d8667d1982 tempest-VolumesListTestJSON-1198716789 None] Lock "cinder-quobyte-70a16fa0-732f-44a2-bfe2-9b45d4071288" acquired by "delete_volume" :: waited 0.016s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:25:25 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbad682-9451-4de1-9863-eae75b497614]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:25:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-78502461-93a7-4f69-8eb4-f1d8667d1982 tempest-VolumesListTestJSON-1198716789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-70a16fa0-732f-44a2-bfe2-9b45d4071288 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:26 devstack sudo[97465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-70a16fa0-732f-44a2-bfe2-9b45d4071288 Nov 03 20:25:26 devstack sudo[97465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:26 devstack sudo[97465]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-78502461-93a7-4f69-8eb4-f1d8667d1982 tempest-VolumesListTestJSON-1198716789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-70a16fa0-732f-44a2-bfe2-9b45d4071288" returned: 0 in 0.496s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-78502461-93a7-4f69-8eb4-f1d8667d1982 tempest-VolumesListTestJSON-1198716789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-70a16fa0-732f-44a2-bfe2-9b45d4071288 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:26 devstack sudo[97479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-70a16fa0-732f-44a2-bfe2-9b45d4071288 Nov 03 20:25:26 devstack sudo[97479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:26 devstack sudo[97479]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-78502461-93a7-4f69-8eb4-f1d8667d1982 tempest-VolumesListTestJSON-1198716789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-70a16fa0-732f-44a2-bfe2-9b45d4071288" returned: 0 in 0.366s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:26 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-78502461-93a7-4f69-8eb4-f1d8667d1982 tempest-VolumesListTestJSON-1198716789 None] Lock "cinder-quobyte-70a16fa0-732f-44a2-bfe2-9b45d4071288" released by "delete_volume" :: held 0.911s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:25:26 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-78502461-93a7-4f69-8eb4-f1d8667d1982 tempest-VolumesListTestJSON-1198716789 None] Created reservations ['dd40b000-49cc-4857-8d0e-020641373b54', '4bc6f177-c338-4b3f-a387-8017427dc90e', '5cf7d19b-d2b5-4b8b-8a86-6df465aba4f6', '30f28147-8fe6-4160-b37d-bcab16a0e079'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:25:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-78502461-93a7-4f69-8eb4-f1d8667d1982 tempest-VolumesListTestJSON-1198716789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-78502461-93a7-4f69-8eb4-f1d8667d1982 tempest-VolumesListTestJSON-1198716789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:26 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-78502461-93a7-4f69-8eb4-f1d8667d1982 tempest-VolumesListTestJSON-1198716789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:25:27 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-78502461-93a7-4f69-8eb4-f1d8667d1982 tempest-VolumesListTestJSON-1198716789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:25:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-78502461-93a7-4f69-8eb4-f1d8667d1982 tempest-VolumesListTestJSON-1198716789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-78502461-93a7-4f69-8eb4-f1d8667d1982 tempest-VolumesListTestJSON-1198716789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:27 devstack sudo[97484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:25:27 devstack sudo[97484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:27 devstack sudo[97484]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-78502461-93a7-4f69-8eb4-f1d8667d1982 tempest-VolumesListTestJSON-1198716789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.376s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:27 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-78502461-93a7-4f69-8eb4-f1d8667d1982 tempest-VolumesListTestJSON-1198716789 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:25:27 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-78502461-93a7-4f69-8eb4-f1d8667d1982 tempest-VolumesListTestJSON-1198716789 None] Deleted volume successfully. Nov 03 20:25:27 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-78502461-93a7-4f69-8eb4-f1d8667d1982 tempest-VolumesListTestJSON-1198716789 None] Lock "cinder-70a16fa0-732f-44a2-bfe2-9b45d4071288-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:25:28 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-c93ac464-7645-4d25-a6da-ebdebb9cc608 tempest-AttachVolumeTestJSON-1951495544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:25:28 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c93ac464-7645-4d25-a6da-ebdebb9cc608 tempest-AttachVolumeTestJSON-1951495544 None] Flow 'volume_create_manager' (2534694e-91a3-4548-837b-ffb1e96c8688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:28 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c93ac464-7645-4d25-a6da-ebdebb9cc608 tempest-AttachVolumeTestJSON-1951495544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ace1bbd-3787-45b5-af12-1deb7dc65276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:28 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c93ac464-7645-4d25-a6da-ebdebb9cc608 tempest-AttachVolumeTestJSON-1951495544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ace1bbd-3787-45b5-af12-1deb7dc65276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1197200828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc7e0e9f-b845-4406-b203-01af3e2a7b80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='079eb8d6ee6d4ce2afd949bf58276a24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:25:28Z,use_quota=True,user_id='47bae0c200dd4f588e92d432b5755d05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:28 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c93ac464-7645-4d25-a6da-ebdebb9cc608 tempest-AttachVolumeTestJSON-1951495544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa127ab5-6988-4124-b74d-da5770c22e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:28 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c93ac464-7645-4d25-a6da-ebdebb9cc608 tempest-AttachVolumeTestJSON-1951495544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa127ab5-6988-4124-b74d-da5770c22e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:28 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c93ac464-7645-4d25-a6da-ebdebb9cc608 tempest-AttachVolumeTestJSON-1951495544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74992ba8-752c-4c6b-bbde-a03455ea14f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:28 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c93ac464-7645-4d25-a6da-ebdebb9cc608 tempest-AttachVolumeTestJSON-1951495544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74992ba8-752c-4c6b-bbde-a03455ea14f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc7e0e9f-b845-4406-b203-01af3e2a7b80', 'volume_name': 'volume-dc7e0e9f-b845-4406-b203-01af3e2a7b80', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:28 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c93ac464-7645-4d25-a6da-ebdebb9cc608 tempest-AttachVolumeTestJSON-1951495544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b9c434d-5c0e-4707-a2f5-5d9a35f0a5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:28 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c93ac464-7645-4d25-a6da-ebdebb9cc608 tempest-AttachVolumeTestJSON-1951495544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b9c434d-5c0e-4707-a2f5-5d9a35f0a5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:28 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c93ac464-7645-4d25-a6da-ebdebb9cc608 tempest-AttachVolumeTestJSON-1951495544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (488badfb-1daf-4332-b8d9-9f25c4012356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:28 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-c93ac464-7645-4d25-a6da-ebdebb9cc608 tempest-AttachVolumeTestJSON-1951495544 None] Volume dc7e0e9f-b845-4406-b203-01af3e2a7b80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc7e0e9f-b845-4406-b203-01af3e2a7b80', 'volume_size': 1} Nov 03 20:25:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c93ac464-7645-4d25-a6da-ebdebb9cc608 tempest-AttachVolumeTestJSON-1951495544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:28 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-74254c3e-849c-4e5f-8bea-2f9ad9d206b0 tempest-VolumesListTestJSON-1198716789 None] Acquiring lock "cinder-25d77441-9097-4032-9429-6c50a1fc195f-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:25:28 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-74254c3e-849c-4e5f-8bea-2f9ad9d206b0 tempest-VolumesListTestJSON-1198716789 None] Lock "cinder-25d77441-9097-4032-9429-6c50a1fc195f-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:25:28 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-74254c3e-849c-4e5f-8bea-2f9ad9d206b0 tempest-VolumesListTestJSON-1198716789 None] Acquiring lock "cinder-quobyte-25d77441-9097-4032-9429-6c50a1fc195f" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:25:28 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-74254c3e-849c-4e5f-8bea-2f9ad9d206b0 tempest-VolumesListTestJSON-1198716789 None] Lock "cinder-quobyte-25d77441-9097-4032-9429-6c50a1fc195f" acquired by "delete_volume" :: waited 0.017s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:25:28 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[350f74e5-7e39-4f43-bb26-93a79dbffcfa]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:25:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-74254c3e-849c-4e5f-8bea-2f9ad9d206b0 tempest-VolumesListTestJSON-1198716789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-25d77441-9097-4032-9429-6c50a1fc195f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:28 devstack cinder-volume[87248]: DEBUG oslo_service.periodic_task [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:25:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:25:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:25:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:28 devstack sudo[97488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:25:28 devstack sudo[97488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:28 devstack sudo[97487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-25d77441-9097-4032-9429-6c50a1fc195f Nov 03 20:25:28 devstack sudo[97487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:29 devstack sudo[97488]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.531s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:29 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:25:29 devstack cinder-volume[87248]: DEBUG oslo_service.periodic_task [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running periodic task VolumeManager._thread_info {{(pid=87248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:25:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] thread count: 28 {{(pid=87248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:25:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] thread info: [<_MainThread(MainThread, started 124862067372160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:25:29 devstack sudo[97487]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-74254c3e-849c-4e5f-8bea-2f9ad9d206b0 tempest-VolumesListTestJSON-1198716789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-25d77441-9097-4032-9429-6c50a1fc195f" returned: 0 in 0.729s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-74254c3e-849c-4e5f-8bea-2f9ad9d206b0 tempest-VolumesListTestJSON-1198716789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-25d77441-9097-4032-9429-6c50a1fc195f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:29 devstack sudo[97497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-25d77441-9097-4032-9429-6c50a1fc195f Nov 03 20:25:29 devstack sudo[97497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:29 devstack sudo[97497]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-74254c3e-849c-4e5f-8bea-2f9ad9d206b0 tempest-VolumesListTestJSON-1198716789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-25d77441-9097-4032-9429-6c50a1fc195f" returned: 0 in 0.474s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:29 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-74254c3e-849c-4e5f-8bea-2f9ad9d206b0 tempest-VolumesListTestJSON-1198716789 None] Lock "cinder-quobyte-25d77441-9097-4032-9429-6c50a1fc195f" released by "delete_volume" :: held 1.288s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:25:29 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-74254c3e-849c-4e5f-8bea-2f9ad9d206b0 tempest-VolumesListTestJSON-1198716789 None] Created reservations ['dcd20fe1-4692-47a5-a2dc-279aa2c7c432', 'aa9d9736-cc53-417c-86a4-37bf4d9a5a95', '9b41ef4d-79a1-48de-bfa3-c3ec546f087a', '88650962-76bc-48bc-b621-2511c638d33a'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:25:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-74254c3e-849c-4e5f-8bea-2f9ad9d206b0 tempest-VolumesListTestJSON-1198716789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-74254c3e-849c-4e5f-8bea-2f9ad9d206b0 tempest-VolumesListTestJSON-1198716789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:30 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-74254c3e-849c-4e5f-8bea-2f9ad9d206b0 tempest-VolumesListTestJSON-1198716789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:25:30 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-74254c3e-849c-4e5f-8bea-2f9ad9d206b0 tempest-VolumesListTestJSON-1198716789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:25:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-74254c3e-849c-4e5f-8bea-2f9ad9d206b0 tempest-VolumesListTestJSON-1198716789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-74254c3e-849c-4e5f-8bea-2f9ad9d206b0 tempest-VolumesListTestJSON-1198716789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:30 devstack sudo[97500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:25:30 devstack sudo[97500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:30 devstack sudo[97500]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-74254c3e-849c-4e5f-8bea-2f9ad9d206b0 tempest-VolumesListTestJSON-1198716789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.400s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:30 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-74254c3e-849c-4e5f-8bea-2f9ad9d206b0 tempest-VolumesListTestJSON-1198716789 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:25:30 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-74254c3e-849c-4e5f-8bea-2f9ad9d206b0 tempest-VolumesListTestJSON-1198716789 None] Deleted volume successfully. Nov 03 20:25:30 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:UPDATE=100,cinder:SELECT=87,cinder:DELETE=9,cinder:INSERT=25 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:25:30 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-74254c3e-849c-4e5f-8bea-2f9ad9d206b0 tempest-VolumesListTestJSON-1198716789 None] Lock "cinder-25d77441-9097-4032-9429-6c50a1fc195f-delete_volume" released by "delete_volume" :: held 2.093s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:25:30 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d102bd91-190f-4ac4-879c-270d43d24e7c tempest-VolumesListTestJSON-1198716789 None] Acquiring lock "cinder-05ebd836-bb3a-4d36-a298-7bcd5fe6cb17-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:25:30 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d102bd91-190f-4ac4-879c-270d43d24e7c tempest-VolumesListTestJSON-1198716789 None] Lock "cinder-05ebd836-bb3a-4d36-a298-7bcd5fe6cb17-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:25:30 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:SELECT=62,cinder:UPDATE=115,cinder:INSERT=24,cinder:DELETE=11 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:25:31 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d102bd91-190f-4ac4-879c-270d43d24e7c tempest-VolumesListTestJSON-1198716789 None] Acquiring lock "cinder-quobyte-05ebd836-bb3a-4d36-a298-7bcd5fe6cb17" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:25:31 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d102bd91-190f-4ac4-879c-270d43d24e7c tempest-VolumesListTestJSON-1198716789 None] Lock "cinder-quobyte-05ebd836-bb3a-4d36-a298-7bcd5fe6cb17" acquired by "delete_volume" :: waited 0.049s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:25:31 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f7e78a-2a45-4b22-9c49-50d46663a68a]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:25:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d102bd91-190f-4ac4-879c-270d43d24e7c tempest-VolumesListTestJSON-1198716789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-05ebd836-bb3a-4d36-a298-7bcd5fe6cb17 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:31 devstack sudo[97503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-05ebd836-bb3a-4d36-a298-7bcd5fe6cb17 Nov 03 20:25:31 devstack sudo[97503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:31 devstack sudo[97503]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d102bd91-190f-4ac4-879c-270d43d24e7c tempest-VolumesListTestJSON-1198716789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-05ebd836-bb3a-4d36-a298-7bcd5fe6cb17" returned: 0 in 0.665s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d102bd91-190f-4ac4-879c-270d43d24e7c tempest-VolumesListTestJSON-1198716789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-05ebd836-bb3a-4d36-a298-7bcd5fe6cb17 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:31 devstack sudo[97510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-05ebd836-bb3a-4d36-a298-7bcd5fe6cb17 Nov 03 20:25:31 devstack sudo[97510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:32 devstack sudo[97510]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d102bd91-190f-4ac4-879c-270d43d24e7c tempest-VolumesListTestJSON-1198716789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-05ebd836-bb3a-4d36-a298-7bcd5fe6cb17" returned: 0 in 0.431s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:32 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d102bd91-190f-4ac4-879c-270d43d24e7c tempest-VolumesListTestJSON-1198716789 None] Lock "cinder-quobyte-05ebd836-bb3a-4d36-a298-7bcd5fe6cb17" released by "delete_volume" :: held 1.180s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:25:32 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-d102bd91-190f-4ac4-879c-270d43d24e7c tempest-VolumesListTestJSON-1198716789 None] Created reservations ['6498d1d4-8173-4640-93b3-704573e8f467', '814ffac9-b90c-4a0c-8e15-8001fc8c1e9e', '715e4e93-b4ad-4360-928b-3a0aabf08d66', '4bc24b61-094f-41e8-8ce4-61ef97652124'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:25:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d102bd91-190f-4ac4-879c-270d43d24e7c tempest-VolumesListTestJSON-1198716789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d102bd91-190f-4ac4-879c-270d43d24e7c tempest-VolumesListTestJSON-1198716789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:32 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-d102bd91-190f-4ac4-879c-270d43d24e7c tempest-VolumesListTestJSON-1198716789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:25:32 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-d102bd91-190f-4ac4-879c-270d43d24e7c tempest-VolumesListTestJSON-1198716789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:25:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d102bd91-190f-4ac4-879c-270d43d24e7c tempest-VolumesListTestJSON-1198716789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d102bd91-190f-4ac4-879c-270d43d24e7c tempest-VolumesListTestJSON-1198716789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:32 devstack sudo[97513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:25:32 devstack sudo[97513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:32 devstack sudo[97513]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d102bd91-190f-4ac4-879c-270d43d24e7c tempest-VolumesListTestJSON-1198716789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.345s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:32 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-d102bd91-190f-4ac4-879c-270d43d24e7c tempest-VolumesListTestJSON-1198716789 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:25:32 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-d102bd91-190f-4ac4-879c-270d43d24e7c tempest-VolumesListTestJSON-1198716789 None] Deleted volume successfully. Nov 03 20:25:32 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d102bd91-190f-4ac4-879c-270d43d24e7c tempest-VolumesListTestJSON-1198716789 None] Lock "cinder-05ebd836-bb3a-4d36-a298-7bcd5fe6cb17-delete_volume" released by "delete_volume" :: held 1.924s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:25:32 devstack sudo[97461]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-df368e2a-4e0d-4b34-986b-d0ff8214b5cc" returned: 0 in 7.251s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:32 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Image conversion details: src /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027, size 1024.00 MB, duration 7.25 sec, destination /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-df368e2a-4e0d-4b34-986b-d0ff8214b5cc {{(pid=87248) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:25:32 devstack cinder-volume[87248]: INFO cinder.image.image_utils [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Converted 1024.00 MB image at 141.21 MB/s Nov 03 20:25:32 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-df368e2a-4e0d-4b34-986b-d0ff8214b5cc is being set with open permissions: ugo+rw Nov 03 20:25:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-df368e2a-4e0d-4b34-986b-d0ff8214b5cc {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:32 devstack sudo[97516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-df368e2a-4e0d-4b34-986b-d0ff8214b5cc Nov 03 20:25:32 devstack sudo[97516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:33 devstack sudo[97516]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-df368e2a-4e0d-4b34-986b-d0ff8214b5cc" returned: 0 in 0.237s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:33 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Lock "cinder-quobyte-df368e2a-4e0d-4b34-986b-d0ff8214b5cc" released by "_copy_volume_from_snapshot" :: held 8.386s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:25:33 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Acquiring lock "cinder-quobyte-31f24dd9-acdd-4e29-bb69-345fa8455510" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:25:33 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Lock "cinder-quobyte-31f24dd9-acdd-4e29-bb69-345fa8455510" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:25:33 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Deleting offline snapshot 31f24dd9-acdd-4e29-bb69-345fa8455510 of volume 0b9afc5f-8b43-4f86-a425-2953b02d7027 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:25:33 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] snapshot_file for this snap is: volume-0b9afc5f-8b43-4f86-a425-2953b02d7027.31f24dd9-acdd-4e29-bb69-345fa8455510 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:25:33 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc43815-7476-4456-a2b6-e503efba240d]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:25:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027.31f24dd9-acdd-4e29-bb69-345fa8455510 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:33 devstack sudo[97519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027.31f24dd9-acdd-4e29-bb69-345fa8455510 Nov 03 20:25:33 devstack sudo[97519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:33 devstack sudo[97519]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027.31f24dd9-acdd-4e29-bb69-345fa8455510" returned: 0 in 0.366s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:33 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b9afc5f-8b43-4f86-a425-2953b02d7027(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:25:33 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[98de0eca-03af-40d8-85e6-f4670b0da4b9]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:25:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:33 devstack sudo[97524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027 Nov 03 20:25:33 devstack sudo[97524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:34 devstack sudo[97524]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027" returned: 0 in 0.572s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027.31f24dd9-acdd-4e29-bb69-345fa8455510 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:34 devstack sudo[97529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027.31f24dd9-acdd-4e29-bb69-345fa8455510 Nov 03 20:25:34 devstack sudo[97529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:34 devstack sudo[97529]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027.31f24dd9-acdd-4e29-bb69-345fa8455510" returned: 0 in 0.379s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027.31f24dd9-acdd-4e29-bb69-345fa8455510 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:34 devstack sudo[97534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027.31f24dd9-acdd-4e29-bb69-345fa8455510 Nov 03 20:25:34 devstack sudo[97534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:34 devstack sudo[97534]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027.31f24dd9-acdd-4e29-bb69-345fa8455510" returned: 0 in 0.270s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:34 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Lock "cinder-quobyte-31f24dd9-acdd-4e29-bb69-345fa8455510" released by "_delete_snapshot" :: held 1.708s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:25:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.437s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-5743216c-21f5-44c3-883e-44039018dedc tempest-VolumesGetTest-644387191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.035s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:34 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-5743216c-21f5-44c3-883e-44039018dedc tempest-VolumesGetTest-644387191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:25:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1316142555',display_name='tempest-VolumesGetTest-Volume-1422541644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=271a4d94-235e-4887-b6ac-9610b3f42534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ab0e227a82349bc909b7d4688755960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:25:23Z,use_quota=True,user_id='46e27afb1f9e4540be79dd576cbaaaeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:25:34 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-5743216c-21f5-44c3-883e-44039018dedc tempest-VolumesGetTest-644387191 None] Creating volume 271a4d94-235e-4887-b6ac-9610b3f42534 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:25:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-5743216c-21f5-44c3-883e-44039018dedc tempest-VolumesGetTest-644387191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-5743216c-21f5-44c3-883e-44039018dedc tempest-VolumesGetTest-644387191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:34 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-5743216c-21f5-44c3-883e-44039018dedc tempest-VolumesGetTest-644387191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:25:34 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-5743216c-21f5-44c3-883e-44039018dedc tempest-VolumesGetTest-644387191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:25:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-5743216c-21f5-44c3-883e-44039018dedc tempest-VolumesGetTest-644387191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:34 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-5743216c-21f5-44c3-883e-44039018dedc tempest-VolumesGetTest-644387191 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:25:34 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-5743216c-21f5-44c3-883e-44039018dedc tempest-VolumesGetTest-644387191 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:25:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5743216c-21f5-44c3-883e-44039018dedc tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-271a4d94-235e-4887-b6ac-9610b3f42534 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:34 devstack sudo[97537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-271a4d94-235e-4887-b6ac-9610b3f42534 1073741824 Nov 03 20:25:34 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d402cf72-31a3-4961-ac42-6da1b4f83c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df368e2a-4e0d-4b34-986b-d0ff8214b5cc', 'volume_size': 2, 'source_volid': '0b9afc5f-8b43-4f86-a425-2953b02d7027', 'source_volstatus': 'available'}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:34 devstack sudo[97537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:34 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f1501fb-bb8d-4c8f-8e71-4d09de7aac95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:35 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Volume volume-df368e2a-4e0d-4b34-986b-d0ff8214b5cc (df368e2a-4e0d-4b34-986b-d0ff8214b5cc): created successfully Nov 03 20:25:35 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f1501fb-bb8d-4c8f-8e71-4d09de7aac95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:35 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Flow 'volume_create_manager' (f34ea4e1-e16c-4075-a67b-225bd59cca6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:35 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-fc32329a-82ac-4aa3-8b4e-b752b290565b tempest-VolumesCloneTest-1896973397 None] Created volume successfully. Nov 03 20:25:35 devstack sudo[97537]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5743216c-21f5-44c3-883e-44039018dedc tempest-VolumesGetTest-644387191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-271a4d94-235e-4887-b6ac-9610b3f42534 1073741824" returned: 0 in 0.477s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5743216c-21f5-44c3-883e-44039018dedc tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-271a4d94-235e-4887-b6ac-9610b3f42534 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:35 devstack sudo[97543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-271a4d94-235e-4887-b6ac-9610b3f42534 Nov 03 20:25:35 devstack sudo[97543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:35 devstack sudo[97543]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5743216c-21f5-44c3-883e-44039018dedc tempest-VolumesGetTest-644387191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-271a4d94-235e-4887-b6ac-9610b3f42534" returned: 0 in 0.262s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:35 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-5743216c-21f5-44c3-883e-44039018dedc tempest-VolumesGetTest-644387191 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:25:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-5743216c-21f5-44c3-883e-44039018dedc tempest-VolumesGetTest-644387191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c93ac464-7645-4d25-a6da-ebdebb9cc608 tempest-AttachVolumeTestJSON-1951495544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.374s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:35 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c93ac464-7645-4d25-a6da-ebdebb9cc608 tempest-AttachVolumeTestJSON-1951495544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1197200828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc7e0e9f-b845-4406-b203-01af3e2a7b80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='079eb8d6ee6d4ce2afd949bf58276a24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:25:28Z,use_quota=True,user_id='47bae0c200dd4f588e92d432b5755d05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:25:35 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-c93ac464-7645-4d25-a6da-ebdebb9cc608 tempest-AttachVolumeTestJSON-1951495544 None] Creating volume dc7e0e9f-b845-4406-b203-01af3e2a7b80 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:25:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c93ac464-7645-4d25-a6da-ebdebb9cc608 tempest-AttachVolumeTestJSON-1951495544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c93ac464-7645-4d25-a6da-ebdebb9cc608 tempest-AttachVolumeTestJSON-1951495544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:35 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c93ac464-7645-4d25-a6da-ebdebb9cc608 tempest-AttachVolumeTestJSON-1951495544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:25:35 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c93ac464-7645-4d25-a6da-ebdebb9cc608 tempest-AttachVolumeTestJSON-1951495544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:25:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c93ac464-7645-4d25-a6da-ebdebb9cc608 tempest-AttachVolumeTestJSON-1951495544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:35 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c93ac464-7645-4d25-a6da-ebdebb9cc608 tempest-AttachVolumeTestJSON-1951495544 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:25:35 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-c93ac464-7645-4d25-a6da-ebdebb9cc608 tempest-AttachVolumeTestJSON-1951495544 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:25:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c93ac464-7645-4d25-a6da-ebdebb9cc608 tempest-AttachVolumeTestJSON-1951495544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-dc7e0e9f-b845-4406-b203-01af3e2a7b80 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:35 devstack sudo[97546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-dc7e0e9f-b845-4406-b203-01af3e2a7b80 1073741824 Nov 03 20:25:35 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5743216c-21f5-44c3-883e-44039018dedc tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f3ed33f-958c-45e8-8fee-87a37170af36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-271a4d94-235e-4887-b6ac-9610b3f42534', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:35 devstack sudo[97546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:35 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5743216c-21f5-44c3-883e-44039018dedc tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5158d04c-ed5b-46c0-933d-b8e761e4b207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:35 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-5743216c-21f5-44c3-883e-44039018dedc tempest-VolumesGetTest-644387191 None] Volume volume-271a4d94-235e-4887-b6ac-9610b3f42534 (271a4d94-235e-4887-b6ac-9610b3f42534): created successfully Nov 03 20:25:35 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5743216c-21f5-44c3-883e-44039018dedc tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5158d04c-ed5b-46c0-933d-b8e761e4b207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:35 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5743216c-21f5-44c3-883e-44039018dedc tempest-VolumesGetTest-644387191 None] Flow 'volume_create_manager' (3e42b071-d16c-45ff-8a15-2fb42b0d81dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:35 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-5743216c-21f5-44c3-883e-44039018dedc tempest-VolumesGetTest-644387191 None] Created volume successfully. Nov 03 20:25:36 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2917a118-77e9-463c-9dbd-6d5dba29f14d tempest-VolumesGetTest-644387191 None] Acquiring lock "cinder-271a4d94-235e-4887-b6ac-9610b3f42534-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:25:36 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2917a118-77e9-463c-9dbd-6d5dba29f14d tempest-VolumesGetTest-644387191 None] Lock "cinder-271a4d94-235e-4887-b6ac-9610b3f42534-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:25:36 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2917a118-77e9-463c-9dbd-6d5dba29f14d tempest-VolumesGetTest-644387191 None] Acquiring lock "cinder-quobyte-271a4d94-235e-4887-b6ac-9610b3f42534" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:25:36 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2917a118-77e9-463c-9dbd-6d5dba29f14d tempest-VolumesGetTest-644387191 None] Lock "cinder-quobyte-271a4d94-235e-4887-b6ac-9610b3f42534" acquired by "delete_volume" :: waited 0.024s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:25:36 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c336091-3e25-4725-b5db-fd1c4f155846]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:25:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2917a118-77e9-463c-9dbd-6d5dba29f14d tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-271a4d94-235e-4887-b6ac-9610b3f42534 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:36 devstack sudo[97546]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c93ac464-7645-4d25-a6da-ebdebb9cc608 tempest-AttachVolumeTestJSON-1951495544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-dc7e0e9f-b845-4406-b203-01af3e2a7b80 1073741824" returned: 0 in 0.626s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:36 devstack sudo[97552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-271a4d94-235e-4887-b6ac-9610b3f42534 Nov 03 20:25:36 devstack sudo[97552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c93ac464-7645-4d25-a6da-ebdebb9cc608 tempest-AttachVolumeTestJSON-1951495544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-dc7e0e9f-b845-4406-b203-01af3e2a7b80 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:36 devstack sudo[97554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-dc7e0e9f-b845-4406-b203-01af3e2a7b80 Nov 03 20:25:36 devstack sudo[97554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:36 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b29d5e98-eaac-411f-a437-03235827f7ef tempest-VolumesCloneTest-1896973397 None] Acquiring lock "cinder-df368e2a-4e0d-4b34-986b-d0ff8214b5cc-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:25:36 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b29d5e98-eaac-411f-a437-03235827f7ef tempest-VolumesCloneTest-1896973397 None] Lock "cinder-df368e2a-4e0d-4b34-986b-d0ff8214b5cc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:25:36 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b29d5e98-eaac-411f-a437-03235827f7ef tempest-VolumesCloneTest-1896973397 None] Acquiring lock "cinder-quobyte-df368e2a-4e0d-4b34-986b-d0ff8214b5cc" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:25:36 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b29d5e98-eaac-411f-a437-03235827f7ef tempest-VolumesCloneTest-1896973397 None] Lock "cinder-quobyte-df368e2a-4e0d-4b34-986b-d0ff8214b5cc" acquired by "delete_volume" :: waited 0.027s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:25:36 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30bb03c-92e8-40c8-b300-98b429309a79]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:25:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b29d5e98-eaac-411f-a437-03235827f7ef tempest-VolumesCloneTest-1896973397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-df368e2a-4e0d-4b34-986b-d0ff8214b5cc {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:36 devstack sudo[97552]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2917a118-77e9-463c-9dbd-6d5dba29f14d tempest-VolumesGetTest-644387191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-271a4d94-235e-4887-b6ac-9610b3f42534" returned: 0 in 0.432s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2917a118-77e9-463c-9dbd-6d5dba29f14d tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-271a4d94-235e-4887-b6ac-9610b3f42534 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:36 devstack sudo[97560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-271a4d94-235e-4887-b6ac-9610b3f42534 Nov 03 20:25:36 devstack sudo[97560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:36 devstack sudo[97559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-df368e2a-4e0d-4b34-986b-d0ff8214b5cc Nov 03 20:25:36 devstack sudo[97559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:36 devstack sudo[97554]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c93ac464-7645-4d25-a6da-ebdebb9cc608 tempest-AttachVolumeTestJSON-1951495544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-dc7e0e9f-b845-4406-b203-01af3e2a7b80" returned: 0 in 0.361s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:36 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c93ac464-7645-4d25-a6da-ebdebb9cc608 tempest-AttachVolumeTestJSON-1951495544 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:25:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c93ac464-7645-4d25-a6da-ebdebb9cc608 tempest-AttachVolumeTestJSON-1951495544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:36 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c93ac464-7645-4d25-a6da-ebdebb9cc608 tempest-AttachVolumeTestJSON-1951495544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (488badfb-1daf-4332-b8d9-9f25c4012356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc7e0e9f-b845-4406-b203-01af3e2a7b80', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:36 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c93ac464-7645-4d25-a6da-ebdebb9cc608 tempest-AttachVolumeTestJSON-1951495544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0ff1f98-cf52-4130-84ba-d4037da340e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:36 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-c93ac464-7645-4d25-a6da-ebdebb9cc608 tempest-AttachVolumeTestJSON-1951495544 None] Volume volume-dc7e0e9f-b845-4406-b203-01af3e2a7b80 (dc7e0e9f-b845-4406-b203-01af3e2a7b80): created successfully Nov 03 20:25:36 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c93ac464-7645-4d25-a6da-ebdebb9cc608 tempest-AttachVolumeTestJSON-1951495544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0ff1f98-cf52-4130-84ba-d4037da340e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:36 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c93ac464-7645-4d25-a6da-ebdebb9cc608 tempest-AttachVolumeTestJSON-1951495544 None] Flow 'volume_create_manager' (2534694e-91a3-4548-837b-ffb1e96c8688) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:36 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-c93ac464-7645-4d25-a6da-ebdebb9cc608 tempest-AttachVolumeTestJSON-1951495544 None] Created volume successfully. Nov 03 20:25:37 devstack sudo[97560]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2917a118-77e9-463c-9dbd-6d5dba29f14d tempest-VolumesGetTest-644387191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-271a4d94-235e-4887-b6ac-9610b3f42534" returned: 0 in 0.315s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2917a118-77e9-463c-9dbd-6d5dba29f14d tempest-VolumesGetTest-644387191 None] Lock "cinder-quobyte-271a4d94-235e-4887-b6ac-9610b3f42534" released by "delete_volume" :: held 0.811s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:25:37 devstack sudo[97559]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b29d5e98-eaac-411f-a437-03235827f7ef tempest-VolumesCloneTest-1896973397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-df368e2a-4e0d-4b34-986b-d0ff8214b5cc" returned: 0 in 0.433s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b29d5e98-eaac-411f-a437-03235827f7ef tempest-VolumesCloneTest-1896973397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-df368e2a-4e0d-4b34-986b-d0ff8214b5cc {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:37 devstack sudo[97568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-df368e2a-4e0d-4b34-986b-d0ff8214b5cc Nov 03 20:25:37 devstack sudo[97568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-2917a118-77e9-463c-9dbd-6d5dba29f14d tempest-VolumesGetTest-644387191 None] Created reservations ['d889041b-2e27-48e6-ac24-c1c74ae18113', 'd9579524-3d87-4132-8caa-fc2b83a6395e', '6e62082b-7c37-46a2-ac5b-c8066a04499a', '1e1eb5c2-477a-4cc6-97e9-a3f48053732e'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8278b41-ede6-41f8-a0a6-fb7f52a7623f tempest-VolumesSnapshotListTestJSON-1038731148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c8278b41-ede6-41f8-a0a6-fb7f52a7623f tempest-VolumesSnapshotListTestJSON-1038731148 None] Flow 'volume_create_manager' (21fd0f63-be89-414f-99f1-1a2200925e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c8278b41-ede6-41f8-a0a6-fb7f52a7623f tempest-VolumesSnapshotListTestJSON-1038731148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c13455f6-c3c0-4965-b6e5-c72e04aed3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c8278b41-ede6-41f8-a0a6-fb7f52a7623f tempest-VolumesSnapshotListTestJSON-1038731148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c13455f6-c3c0-4965-b6e5-c72e04aed3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1268841325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69e0df1a-2f6d-4906-994b-3f77cf715b47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25355d2546234fa0bda70db011a0bca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:25:37Z,use_quota=True,user_id='5fe9c2d6f8ed4ea28df2ee1a6f9d4c25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c8278b41-ede6-41f8-a0a6-fb7f52a7623f tempest-VolumesSnapshotListTestJSON-1038731148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c34843a6-04f4-4d0d-89dd-918ccd1a0a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c8278b41-ede6-41f8-a0a6-fb7f52a7623f tempest-VolumesSnapshotListTestJSON-1038731148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c34843a6-04f4-4d0d-89dd-918ccd1a0a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c8278b41-ede6-41f8-a0a6-fb7f52a7623f tempest-VolumesSnapshotListTestJSON-1038731148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e2d2924-8b07-41fc-9970-42ca00184c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c8278b41-ede6-41f8-a0a6-fb7f52a7623f tempest-VolumesSnapshotListTestJSON-1038731148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e2d2924-8b07-41fc-9970-42ca00184c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69e0df1a-2f6d-4906-994b-3f77cf715b47', 'volume_name': 'volume-69e0df1a-2f6d-4906-994b-3f77cf715b47', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c8278b41-ede6-41f8-a0a6-fb7f52a7623f tempest-VolumesSnapshotListTestJSON-1038731148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b34a1a7-82db-4322-a094-61422c75740e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c8278b41-ede6-41f8-a0a6-fb7f52a7623f tempest-VolumesSnapshotListTestJSON-1038731148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b34a1a7-82db-4322-a094-61422c75740e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c8278b41-ede6-41f8-a0a6-fb7f52a7623f tempest-VolumesSnapshotListTestJSON-1038731148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b1ec92-3e81-4116-a2b6-b0797a0cd3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:37 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-c8278b41-ede6-41f8-a0a6-fb7f52a7623f tempest-VolumesSnapshotListTestJSON-1038731148 None] Volume 69e0df1a-2f6d-4906-994b-3f77cf715b47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69e0df1a-2f6d-4906-994b-3f77cf715b47', 'volume_size': 1} Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c8278b41-ede6-41f8-a0a6-fb7f52a7623f tempest-VolumesSnapshotListTestJSON-1038731148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c8278b41-ede6-41f8-a0a6-fb7f52a7623f tempest-VolumesSnapshotListTestJSON-1038731148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c8278b41-ede6-41f8-a0a6-fb7f52a7623f tempest-VolumesSnapshotListTestJSON-1038731148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1268841325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69e0df1a-2f6d-4906-994b-3f77cf715b47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25355d2546234fa0bda70db011a0bca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:25:37Z,use_quota=True,user_id='5fe9c2d6f8ed4ea28df2ee1a6f9d4c25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-c8278b41-ede6-41f8-a0a6-fb7f52a7623f tempest-VolumesSnapshotListTestJSON-1038731148 None] Creating volume 69e0df1a-2f6d-4906-994b-3f77cf715b47 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c8278b41-ede6-41f8-a0a6-fb7f52a7623f tempest-VolumesSnapshotListTestJSON-1038731148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c8278b41-ede6-41f8-a0a6-fb7f52a7623f tempest-VolumesSnapshotListTestJSON-1038731148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c8278b41-ede6-41f8-a0a6-fb7f52a7623f tempest-VolumesSnapshotListTestJSON-1038731148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c8278b41-ede6-41f8-a0a6-fb7f52a7623f tempest-VolumesSnapshotListTestJSON-1038731148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c8278b41-ede6-41f8-a0a6-fb7f52a7623f tempest-VolumesSnapshotListTestJSON-1038731148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c8278b41-ede6-41f8-a0a6-fb7f52a7623f tempest-VolumesSnapshotListTestJSON-1038731148 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:25:37 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-c8278b41-ede6-41f8-a0a6-fb7f52a7623f tempest-VolumesSnapshotListTestJSON-1038731148 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c8278b41-ede6-41f8-a0a6-fb7f52a7623f tempest-VolumesSnapshotListTestJSON-1038731148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2917a118-77e9-463c-9dbd-6d5dba29f14d tempest-VolumesGetTest-644387191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2917a118-77e9-463c-9dbd-6d5dba29f14d tempest-VolumesGetTest-644387191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2917a118-77e9-463c-9dbd-6d5dba29f14d tempest-VolumesGetTest-644387191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:25:37 devstack sudo[97571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47 1073741824 Nov 03 20:25:37 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2917a118-77e9-463c-9dbd-6d5dba29f14d tempest-VolumesGetTest-644387191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2917a118-77e9-463c-9dbd-6d5dba29f14d tempest-VolumesGetTest-644387191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2917a118-77e9-463c-9dbd-6d5dba29f14d tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:37 devstack sudo[97568]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b29d5e98-eaac-411f-a437-03235827f7ef tempest-VolumesCloneTest-1896973397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-df368e2a-4e0d-4b34-986b-d0ff8214b5cc" returned: 0 in 0.308s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6f6b5795-0c79-45e8-bae6-bafd5cc45699 tempest-VolumesGetTest-644387191 None] Acquiring lock "cinder-f2f9b069-1ff9-4b71-913c-f4159b05882d-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:25:37 devstack sudo[97573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:25:37 devstack sudo[97573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b29d5e98-eaac-411f-a437-03235827f7ef tempest-VolumesCloneTest-1896973397 None] Lock "cinder-quobyte-df368e2a-4e0d-4b34-986b-d0ff8214b5cc" released by "delete_volume" :: held 0.816s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6f6b5795-0c79-45e8-bae6-bafd5cc45699 tempest-VolumesGetTest-644387191 None] Lock "cinder-f2f9b069-1ff9-4b71-913c-f4159b05882d-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6f6b5795-0c79-45e8-bae6-bafd5cc45699 tempest-VolumesGetTest-644387191 None] Acquiring lock "cinder-quobyte-f2f9b069-1ff9-4b71-913c-f4159b05882d" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-b29d5e98-eaac-411f-a437-03235827f7ef tempest-VolumesCloneTest-1896973397 None] Created reservations ['decc84c5-30e9-4a48-bd24-0d0be465f9b8', '3c41e532-7ef4-4fdc-929f-072539c5082a', '188da910-9d47-4ff8-8ab9-d04b5f9293d2', '179e89d3-63c5-4957-9644-1abb126b02ea'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6f6b5795-0c79-45e8-bae6-bafd5cc45699 tempest-VolumesGetTest-644387191 None] Lock "cinder-quobyte-f2f9b069-1ff9-4b71-913c-f4159b05882d" acquired by "delete_volume" :: waited 0.027s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[89927a96-87c5-42fa-b0e7-76c74ac24a3b]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6f6b5795-0c79-45e8-bae6-bafd5cc45699 tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2f9b069-1ff9-4b71-913c-f4159b05882d {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b29d5e98-eaac-411f-a437-03235827f7ef tempest-VolumesCloneTest-1896973397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b29d5e98-eaac-411f-a437-03235827f7ef tempest-VolumesCloneTest-1896973397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-b29d5e98-eaac-411f-a437-03235827f7ef tempest-VolumesCloneTest-1896973397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-b29d5e98-eaac-411f-a437-03235827f7ef tempest-VolumesCloneTest-1896973397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b29d5e98-eaac-411f-a437-03235827f7ef tempest-VolumesCloneTest-1896973397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b29d5e98-eaac-411f-a437-03235827f7ef tempest-VolumesCloneTest-1896973397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:37 devstack sudo[97580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:25:37 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:37 devstack sudo[97573]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2917a118-77e9-463c-9dbd-6d5dba29f14d tempest-VolumesGetTest-644387191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.338s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-2917a118-77e9-463c-9dbd-6d5dba29f14d tempest-VolumesGetTest-644387191 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:25:37 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-2917a118-77e9-463c-9dbd-6d5dba29f14d tempest-VolumesGetTest-644387191 None] Deleted volume successfully. Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2917a118-77e9-463c-9dbd-6d5dba29f14d tempest-VolumesGetTest-644387191 None] Lock "cinder-271a4d94-235e-4887-b6ac-9610b3f42534-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:25:37 devstack sudo[97575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2f9b069-1ff9-4b71-913c-f4159b05882d Nov 03 20:25:37 devstack sudo[97575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a09b8311-ecaa-46c7-acb0-761ea3b855c5 tempest-VolumesCloneTest-1896973397 None] Acquiring lock "cinder-0b9afc5f-8b43-4f86-a425-2953b02d7027-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a09b8311-ecaa-46c7-acb0-761ea3b855c5 tempest-VolumesCloneTest-1896973397 None] Lock "cinder-0b9afc5f-8b43-4f86-a425-2953b02d7027-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a09b8311-ecaa-46c7-acb0-761ea3b855c5 tempest-VolumesCloneTest-1896973397 None] Acquiring lock "cinder-quobyte-0b9afc5f-8b43-4f86-a425-2953b02d7027" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:25:37 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c8278b41-ede6-41f8-a0a6-fb7f52a7623f tempest-VolumesSnapshotListTestJSON-1038731148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47 1073741824" returned: 0 in 0.633s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:37 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a09b8311-ecaa-46c7-acb0-761ea3b855c5 tempest-VolumesCloneTest-1896973397 None] Lock "cinder-quobyte-0b9afc5f-8b43-4f86-a425-2953b02d7027" acquired by "delete_volume" :: waited 0.023s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:25:38 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde19470-2430-44fe-a6ab-eeba38282200]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:25:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a09b8311-ecaa-46c7-acb0-761ea3b855c5 tempest-VolumesCloneTest-1896973397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:38 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b29d5e98-eaac-411f-a437-03235827f7ef tempest-VolumesCloneTest-1896973397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.420s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:38 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-b29d5e98-eaac-411f-a437-03235827f7ef tempest-VolumesCloneTest-1896973397 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:25:38 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-b29d5e98-eaac-411f-a437-03235827f7ef tempest-VolumesCloneTest-1896973397 None] Deleted volume successfully. Nov 03 20:25:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c8278b41-ede6-41f8-a0a6-fb7f52a7623f tempest-VolumesSnapshotListTestJSON-1038731148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:38 devstack sudo[97592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47 Nov 03 20:25:38 devstack sudo[97592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:38 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b29d5e98-eaac-411f-a437-03235827f7ef tempest-VolumesCloneTest-1896973397 None] Lock "cinder-df368e2a-4e0d-4b34-986b-d0ff8214b5cc-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:25:38 devstack sudo[97587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027 Nov 03 20:25:38 devstack sudo[97587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:38 devstack sudo[97575]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6f6b5795-0c79-45e8-bae6-bafd5cc45699 tempest-VolumesGetTest-644387191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2f9b069-1ff9-4b71-913c-f4159b05882d" returned: 0 in 0.657s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6f6b5795-0c79-45e8-bae6-bafd5cc45699 tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2f9b069-1ff9-4b71-913c-f4159b05882d {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:38 devstack sudo[97596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2f9b069-1ff9-4b71-913c-f4159b05882d Nov 03 20:25:38 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:38 devstack sudo[97592]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c8278b41-ede6-41f8-a0a6-fb7f52a7623f tempest-VolumesSnapshotListTestJSON-1038731148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47" returned: 0 in 0.332s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:38 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c8278b41-ede6-41f8-a0a6-fb7f52a7623f tempest-VolumesSnapshotListTestJSON-1038731148 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:25:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c8278b41-ede6-41f8-a0a6-fb7f52a7623f tempest-VolumesSnapshotListTestJSON-1038731148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c8278b41-ede6-41f8-a0a6-fb7f52a7623f tempest-VolumesSnapshotListTestJSON-1038731148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b1ec92-3e81-4116-a2b6-b0797a0cd3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69e0df1a-2f6d-4906-994b-3f77cf715b47', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c8278b41-ede6-41f8-a0a6-fb7f52a7623f tempest-VolumesSnapshotListTestJSON-1038731148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d40ef356-e4f4-42d0-874f-074cc7747a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:38 devstack sudo[97587]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a09b8311-ecaa-46c7-acb0-761ea3b855c5 tempest-VolumesCloneTest-1896973397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027" returned: 0 in 0.458s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a09b8311-ecaa-46c7-acb0-761ea3b855c5 tempest-VolumesCloneTest-1896973397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:38 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-c8278b41-ede6-41f8-a0a6-fb7f52a7623f tempest-VolumesSnapshotListTestJSON-1038731148 None] Volume volume-69e0df1a-2f6d-4906-994b-3f77cf715b47 (69e0df1a-2f6d-4906-994b-3f77cf715b47): created successfully Nov 03 20:25:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c8278b41-ede6-41f8-a0a6-fb7f52a7623f tempest-VolumesSnapshotListTestJSON-1038731148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d40ef356-e4f4-42d0-874f-074cc7747a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c8278b41-ede6-41f8-a0a6-fb7f52a7623f tempest-VolumesSnapshotListTestJSON-1038731148 None] Flow 'volume_create_manager' (21fd0f63-be89-414f-99f1-1a2200925e7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:38 devstack sudo[97604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027 Nov 03 20:25:38 devstack sudo[97604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:38 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-c8278b41-ede6-41f8-a0a6-fb7f52a7623f tempest-VolumesSnapshotListTestJSON-1038731148 None] Created volume successfully. Nov 03 20:25:38 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6f6b5795-0c79-45e8-bae6-bafd5cc45699 tempest-VolumesGetTest-644387191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2f9b069-1ff9-4b71-913c-f4159b05882d" returned: 0 in 0.339s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:38 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6f6b5795-0c79-45e8-bae6-bafd5cc45699 tempest-VolumesGetTest-644387191 None] Lock "cinder-quobyte-f2f9b069-1ff9-4b71-913c-f4159b05882d" released by "delete_volume" :: held 1.050s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:25:38 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-6f6b5795-0c79-45e8-bae6-bafd5cc45699 tempest-VolumesGetTest-644387191 None] Created reservations ['44f3d990-6b37-4f3b-9262-6d67ec225dc4', 'acfe5298-de0f-4716-9899-f09978f5191b', 'da4f43f1-4bf5-4cfb-8aff-1b21822b5c54', 'ba4f9369-97bd-456e-9237-609a53b57b68'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:25:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6f6b5795-0c79-45e8-bae6-bafd5cc45699 tempest-VolumesGetTest-644387191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6f6b5795-0c79-45e8-bae6-bafd5cc45699 tempest-VolumesGetTest-644387191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:38 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-6f6b5795-0c79-45e8-bae6-bafd5cc45699 tempest-VolumesGetTest-644387191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:25:38 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-6f6b5795-0c79-45e8-bae6-bafd5cc45699 tempest-VolumesGetTest-644387191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:25:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6f6b5795-0c79-45e8-bae6-bafd5cc45699 tempest-VolumesGetTest-644387191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6f6b5795-0c79-45e8-bae6-bafd5cc45699 tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:38 devstack sudo[97607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:25:38 devstack sudo[97607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:38 devstack sudo[97604]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a09b8311-ecaa-46c7-acb0-761ea3b855c5 tempest-VolumesCloneTest-1896973397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0b9afc5f-8b43-4f86-a425-2953b02d7027" returned: 0 in 0.345s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:38 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a09b8311-ecaa-46c7-acb0-761ea3b855c5 tempest-VolumesCloneTest-1896973397 None] Lock "cinder-quobyte-0b9afc5f-8b43-4f86-a425-2953b02d7027" released by "delete_volume" :: held 0.890s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:25:38 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-a09b8311-ecaa-46c7-acb0-761ea3b855c5 tempest-VolumesCloneTest-1896973397 None] Created reservations ['a20a8942-15ac-44c7-b66e-373a3f0c5045', '1ebd6a2a-8a8b-4b75-bf9e-765a905dfb3a', 'beef88f4-baba-4cfd-997f-484f2fe523ce', '8d6169fe-bd53-4ed7-b9f1-4269f391d082'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:25:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a09b8311-ecaa-46c7-acb0-761ea3b855c5 tempest-VolumesCloneTest-1896973397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a09b8311-ecaa-46c7-acb0-761ea3b855c5 tempest-VolumesCloneTest-1896973397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:38 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a09b8311-ecaa-46c7-acb0-761ea3b855c5 tempest-VolumesCloneTest-1896973397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:25:39 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a09b8311-ecaa-46c7-acb0-761ea3b855c5 tempest-VolumesCloneTest-1896973397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:25:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a09b8311-ecaa-46c7-acb0-761ea3b855c5 tempest-VolumesCloneTest-1896973397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a09b8311-ecaa-46c7-acb0-761ea3b855c5 tempest-VolumesCloneTest-1896973397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:39 devstack sudo[97619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:25:39 devstack sudo[97619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:39 devstack sudo[97607]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-c381e3e0-5f51-45e1-9ba5-3885fcd4c94f req-9100f728-7445-441e-abbe-98f2f2b4a17f tempest-AttachVolumeTestJSON-1951495544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-c381e3e0-5f51-45e1-9ba5-3885fcd4c94f req-9100f728-7445-441e-abbe-98f2f2b4a17f tempest-AttachVolumeTestJSON-1951495544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6f6b5795-0c79-45e8-bae6-bafd5cc45699 tempest-VolumesGetTest-644387191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.350s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:39 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-6f6b5795-0c79-45e8-bae6-bafd5cc45699 tempest-VolumesGetTest-644387191 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:25:39 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-6f6b5795-0c79-45e8-bae6-bafd5cc45699 tempest-VolumesGetTest-644387191 None] Deleted volume successfully. Nov 03 20:25:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-c381e3e0-5f51-45e1-9ba5-3885fcd4c94f req-9100f728-7445-441e-abbe-98f2f2b4a17f tempest-AttachVolumeTestJSON-1951495544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:39 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6f6b5795-0c79-45e8-bae6-bafd5cc45699 tempest-VolumesGetTest-644387191 None] Lock "cinder-f2f9b069-1ff9-4b71-913c-f4159b05882d-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:25:39 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-c381e3e0-5f51-45e1-9ba5-3885fcd4c94f req-9100f728-7445-441e-abbe-98f2f2b4a17f tempest-AttachVolumeTestJSON-1951495544 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8', 'name': 'volume-dc7e0e9f-b845-4406-b203-01af3e2a7b80', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1dc24c07-2fb2-447a-9ca9-016f405259ec', 'enforce_multipath': True} {{(pid=87248) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 20:25:39 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-c381e3e0-5f51-45e1-9ba5-3885fcd4c94f req-9100f728-7445-441e-abbe-98f2f2b4a17f tempest-AttachVolumeTestJSON-1951495544 None] attachment_update completed successfully. Nov 03 20:25:39 devstack sudo[97619]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a09b8311-ecaa-46c7-acb0-761ea3b855c5 tempest-VolumesCloneTest-1896973397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.381s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:39 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-a09b8311-ecaa-46c7-acb0-761ea3b855c5 tempest-VolumesCloneTest-1896973397 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:25:39 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-a09b8311-ecaa-46c7-acb0-761ea3b855c5 tempest-VolumesCloneTest-1896973397 None] Deleted volume successfully. Nov 03 20:25:39 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a09b8311-ecaa-46c7-acb0-761ea3b855c5 tempest-VolumesCloneTest-1896973397 None] Lock "cinder-0b9afc5f-8b43-4f86-a425-2953b02d7027-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:25:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f2c0730b-eeb3-4ae9-9a45-82dd6d57fb86 tempest-VolumesSnapshotListTestJSON-1038731148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f2c0730b-eeb3-4ae9-9a45-82dd6d57fb86 tempest-VolumesSnapshotListTestJSON-1038731148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:39 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-f2c0730b-eeb3-4ae9-9a45-82dd6d57fb86 tempest-VolumesSnapshotListTestJSON-1038731148 None] Creating offline snapshot 8f3d584a-d0ae-4ee7-8ab3-b028e7c142b1 of volume 69e0df1a-2f6d-4906-994b-3f77cf715b47 {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:25:39 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[013a88fa-7789-4203-9550-af8535f55566]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:25:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f2c0730b-eeb3-4ae9-9a45-82dd6d57fb86 tempest-VolumesSnapshotListTestJSON-1038731148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:39 devstack sudo[98035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47 Nov 03 20:25:39 devstack sudo[98035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:40 devstack sudo[98035]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f2c0730b-eeb3-4ae9-9a45-82dd6d57fb86 tempest-VolumesSnapshotListTestJSON-1038731148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47" returned: 0 in 0.622s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f2c0730b-eeb3-4ae9-9a45-82dd6d57fb86 tempest-VolumesSnapshotListTestJSON-1038731148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.8f3d584a-d0ae-4ee7-8ab3-b028e7c142b1 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:40 devstack sudo[98042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.8f3d584a-d0ae-4ee7-8ab3-b028e7c142b1 1G Nov 03 20:25:40 devstack sudo[98042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:40 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec8dc5c6-d0d4-49f5-a06d-e505e494ae6c tempest-VolumesGetTest-644387191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:25:40 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ec8dc5c6-d0d4-49f5-a06d-e505e494ae6c tempest-VolumesGetTest-644387191 None] Flow 'volume_create_manager' (04479a21-d660-437a-9eae-11e3fded21b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:40 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ec8dc5c6-d0d4-49f5-a06d-e505e494ae6c tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4bcd73c-f2bf-4dd7-b81a-a29fb71fa8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:40 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ec8dc5c6-d0d4-49f5-a06d-e505e494ae6c tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4bcd73c-f2bf-4dd7-b81a-a29fb71fa8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1584508225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=289329bf-ccf6-4487-b24e-575064a00d1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ab0e227a82349bc909b7d4688755960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:25:40Z,use_quota=True,user_id='46e27afb1f9e4540be79dd576cbaaaeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:40 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ec8dc5c6-d0d4-49f5-a06d-e505e494ae6c tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2da823da-6a3b-4953-b67c-1defa573a789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:40 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ec8dc5c6-d0d4-49f5-a06d-e505e494ae6c tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2da823da-6a3b-4953-b67c-1defa573a789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:40 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ec8dc5c6-d0d4-49f5-a06d-e505e494ae6c tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24cebf1d-3063-494c-a89d-9ce1092fe0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:40 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ec8dc5c6-d0d4-49f5-a06d-e505e494ae6c tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24cebf1d-3063-494c-a89d-9ce1092fe0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '289329bf-ccf6-4487-b24e-575064a00d1e', 'volume_name': 'volume-289329bf-ccf6-4487-b24e-575064a00d1e', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:40 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ec8dc5c6-d0d4-49f5-a06d-e505e494ae6c tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b1ec3e1-8683-4245-91f8-54329643752b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:40 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ec8dc5c6-d0d4-49f5-a06d-e505e494ae6c tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b1ec3e1-8683-4245-91f8-54329643752b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:40 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ec8dc5c6-d0d4-49f5-a06d-e505e494ae6c tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce076ca8-a4da-437f-8324-2697b44e97b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:40 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-ec8dc5c6-d0d4-49f5-a06d-e505e494ae6c tempest-VolumesGetTest-644387191 None] Volume 289329bf-ccf6-4487-b24e-575064a00d1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-289329bf-ccf6-4487-b24e-575064a00d1e', 'volume_size': 1} Nov 03 20:25:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ec8dc5c6-d0d4-49f5-a06d-e505e494ae6c tempest-VolumesGetTest-644387191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:40 devstack sudo[98042]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f2c0730b-eeb3-4ae9-9a45-82dd6d57fb86 tempest-VolumesSnapshotListTestJSON-1038731148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.8f3d584a-d0ae-4ee7-8ab3-b028e7c142b1 1G" returned: 0 in 0.470s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f2c0730b-eeb3-4ae9-9a45-82dd6d57fb86 tempest-VolumesSnapshotListTestJSON-1038731148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69e0df1a-2f6d-4906-994b-3f77cf715b47 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.8f3d584a-d0ae-4ee7-8ab3-b028e7c142b1 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:40 devstack sudo[98049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69e0df1a-2f6d-4906-994b-3f77cf715b47 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.8f3d584a-d0ae-4ee7-8ab3-b028e7c142b1 Nov 03 20:25:40 devstack sudo[98049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:41 devstack sudo[98049]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f2c0730b-eeb3-4ae9-9a45-82dd6d57fb86 tempest-VolumesSnapshotListTestJSON-1038731148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69e0df1a-2f6d-4906-994b-3f77cf715b47 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.8f3d584a-d0ae-4ee7-8ab3-b028e7c142b1" returned: 0 in 0.342s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:41 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-f2c0730b-eeb3-4ae9-9a45-82dd6d57fb86 tempest-VolumesSnapshotListTestJSON-1038731148 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.8f3d584a-d0ae-4ee7-8ab3-b028e7c142b1 is being set with open permissions: ugo+rw Nov 03 20:25:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f2c0730b-eeb3-4ae9-9a45-82dd6d57fb86 tempest-VolumesSnapshotListTestJSON-1038731148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.8f3d584a-d0ae-4ee7-8ab3-b028e7c142b1 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:41 devstack sudo[98054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.8f3d584a-d0ae-4ee7-8ab3-b028e7c142b1 Nov 03 20:25:41 devstack sudo[98054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:41 devstack sudo[98054]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f2c0730b-eeb3-4ae9-9a45-82dd6d57fb86 tempest-VolumesSnapshotListTestJSON-1038731148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.8f3d584a-d0ae-4ee7-8ab3-b028e7c142b1" returned: 0 in 0.288s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f2c0730b-eeb3-4ae9-9a45-82dd6d57fb86 tempest-VolumesSnapshotListTestJSON-1038731148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:41 devstack sudo[98057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.info Nov 03 20:25:41 devstack sudo[98057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:41 devstack sudo[98057]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f2c0730b-eeb3-4ae9-9a45-82dd6d57fb86 tempest-VolumesSnapshotListTestJSON-1038731148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.info" returned: 0 in 0.313s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:41 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-f2c0730b-eeb3-4ae9-9a45-82dd6d57fb86 tempest-VolumesSnapshotListTestJSON-1038731148 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.info is being set with open permissions: ugo+rw Nov 03 20:25:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f2c0730b-eeb3-4ae9-9a45-82dd6d57fb86 tempest-VolumesSnapshotListTestJSON-1038731148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:41 devstack sudo[98061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.info Nov 03 20:25:41 devstack sudo[98061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:41 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-65b3b82d-2243-4b30-a791-0517964c61dc tempest-AttachVolumeTestJSON-1951495544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:25:41 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-65b3b82d-2243-4b30-a791-0517964c61dc tempest-AttachVolumeTestJSON-1951495544 None] Flow 'volume_create_manager' (c0a69537-08a1-4e20-a484-e03bec9f58fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:41 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-65b3b82d-2243-4b30-a791-0517964c61dc tempest-AttachVolumeTestJSON-1951495544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa8cf99a-2891-4653-b299-bb911f483687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:41 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-65b3b82d-2243-4b30-a791-0517964c61dc tempest-AttachVolumeTestJSON-1951495544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa8cf99a-2891-4653-b299-bb911f483687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-654372384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a707e24-2d0e-4b07-a72f-6490f2ee3872,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='079eb8d6ee6d4ce2afd949bf58276a24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:25:42Z,use_quota=True,user_id='47bae0c200dd4f588e92d432b5755d05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:41 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-65b3b82d-2243-4b30-a791-0517964c61dc tempest-AttachVolumeTestJSON-1951495544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b0bfa97-49f1-4cb8-b3d4-3cbf1e90bd4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:41 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-65b3b82d-2243-4b30-a791-0517964c61dc tempest-AttachVolumeTestJSON-1951495544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b0bfa97-49f1-4cb8-b3d4-3cbf1e90bd4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:41 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-65b3b82d-2243-4b30-a791-0517964c61dc tempest-AttachVolumeTestJSON-1951495544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f995f1b7-3aeb-40bc-8f97-3e00b83f14b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:41 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-65b3b82d-2243-4b30-a791-0517964c61dc tempest-AttachVolumeTestJSON-1951495544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f995f1b7-3aeb-40bc-8f97-3e00b83f14b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a707e24-2d0e-4b07-a72f-6490f2ee3872', 'volume_name': 'volume-4a707e24-2d0e-4b07-a72f-6490f2ee3872', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:41 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-65b3b82d-2243-4b30-a791-0517964c61dc tempest-AttachVolumeTestJSON-1951495544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c361bfd4-37d1-4e36-9879-fe576deb3aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:41 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-65b3b82d-2243-4b30-a791-0517964c61dc tempest-AttachVolumeTestJSON-1951495544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c361bfd4-37d1-4e36-9879-fe576deb3aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:41 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-65b3b82d-2243-4b30-a791-0517964c61dc tempest-AttachVolumeTestJSON-1951495544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aee07617-6ecc-44a4-ae85-bc51ba573a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:41 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-65b3b82d-2243-4b30-a791-0517964c61dc tempest-AttachVolumeTestJSON-1951495544 None] Volume 4a707e24-2d0e-4b07-a72f-6490f2ee3872: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a707e24-2d0e-4b07-a72f-6490f2ee3872', 'volume_size': 1} Nov 03 20:25:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-65b3b82d-2243-4b30-a791-0517964c61dc tempest-AttachVolumeTestJSON-1951495544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:42 devstack sudo[98061]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f2c0730b-eeb3-4ae9-9a45-82dd6d57fb86 tempest-VolumesSnapshotListTestJSON-1038731148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.info" returned: 0 in 0.267s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f2c0730b-eeb3-4ae9-9a45-82dd6d57fb86 tempest-VolumesSnapshotListTestJSON-1038731148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.431s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ec8dc5c6-d0d4-49f5-a06d-e505e494ae6c tempest-VolumesGetTest-644387191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.498s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:42 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-ec8dc5c6-d0d4-49f5-a06d-e505e494ae6c tempest-VolumesGetTest-644387191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1584508225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=289329bf-ccf6-4487-b24e-575064a00d1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ab0e227a82349bc909b7d4688755960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:25:40Z,use_quota=True,user_id='46e27afb1f9e4540be79dd576cbaaaeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:25:42 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-ec8dc5c6-d0d4-49f5-a06d-e505e494ae6c tempest-VolumesGetTest-644387191 None] Creating volume 289329bf-ccf6-4487-b24e-575064a00d1e {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:25:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ec8dc5c6-d0d4-49f5-a06d-e505e494ae6c tempest-VolumesGetTest-644387191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ec8dc5c6-d0d4-49f5-a06d-e505e494ae6c tempest-VolumesGetTest-644387191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:42 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-ec8dc5c6-d0d4-49f5-a06d-e505e494ae6c tempest-VolumesGetTest-644387191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:25:42 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-ec8dc5c6-d0d4-49f5-a06d-e505e494ae6c tempest-VolumesGetTest-644387191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:25:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ec8dc5c6-d0d4-49f5-a06d-e505e494ae6c tempest-VolumesGetTest-644387191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:42 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-ec8dc5c6-d0d4-49f5-a06d-e505e494ae6c tempest-VolumesGetTest-644387191 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:25:42 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-ec8dc5c6-d0d4-49f5-a06d-e505e494ae6c tempest-VolumesGetTest-644387191 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:25:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ec8dc5c6-d0d4-49f5-a06d-e505e494ae6c tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:42 devstack sudo[98064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e 1073741824 Nov 03 20:25:42 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:42 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-f2c0730b-eeb3-4ae9-9a45-82dd6d57fb86 tempest-VolumesSnapshotListTestJSON-1038731148 None] Create snapshot completed successfully Nov 03 20:25:42 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ec8dc5c6-d0d4-49f5-a06d-e505e494ae6c tempest-VolumesGetTest-644387191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e 1073741824" returned: 0 in 0.500s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ec8dc5c6-d0d4-49f5-a06d-e505e494ae6c tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:42 devstack sudo[98070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e Nov 03 20:25:42 devstack sudo[98070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:42 devstack sudo[98070]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ec8dc5c6-d0d4-49f5-a06d-e505e494ae6c tempest-VolumesGetTest-644387191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e" returned: 0 in 0.295s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:42 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-ec8dc5c6-d0d4-49f5-a06d-e505e494ae6c tempest-VolumesGetTest-644387191 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:25:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ec8dc5c6-d0d4-49f5-a06d-e505e494ae6c tempest-VolumesGetTest-644387191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-65b3b82d-2243-4b30-a791-0517964c61dc tempest-AttachVolumeTestJSON-1951495544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.963s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:42 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-65b3b82d-2243-4b30-a791-0517964c61dc tempest-AttachVolumeTestJSON-1951495544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-654372384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a707e24-2d0e-4b07-a72f-6490f2ee3872,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='079eb8d6ee6d4ce2afd949bf58276a24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:25:42Z,use_quota=True,user_id='47bae0c200dd4f588e92d432b5755d05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:25:42 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-65b3b82d-2243-4b30-a791-0517964c61dc tempest-AttachVolumeTestJSON-1951495544 None] Creating volume 4a707e24-2d0e-4b07-a72f-6490f2ee3872 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:25:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-65b3b82d-2243-4b30-a791-0517964c61dc tempest-AttachVolumeTestJSON-1951495544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-65b3b82d-2243-4b30-a791-0517964c61dc tempest-AttachVolumeTestJSON-1951495544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:42 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-65b3b82d-2243-4b30-a791-0517964c61dc tempest-AttachVolumeTestJSON-1951495544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:25:42 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-65b3b82d-2243-4b30-a791-0517964c61dc tempest-AttachVolumeTestJSON-1951495544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:25:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-65b3b82d-2243-4b30-a791-0517964c61dc tempest-AttachVolumeTestJSON-1951495544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:42 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-65b3b82d-2243-4b30-a791-0517964c61dc tempest-AttachVolumeTestJSON-1951495544 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:25:42 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-65b3b82d-2243-4b30-a791-0517964c61dc tempest-AttachVolumeTestJSON-1951495544 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:25:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-65b3b82d-2243-4b30-a791-0517964c61dc tempest-AttachVolumeTestJSON-1951495544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4a707e24-2d0e-4b07-a72f-6490f2ee3872 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:42 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ec8dc5c6-d0d4-49f5-a06d-e505e494ae6c tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce076ca8-a4da-437f-8324-2697b44e97b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-289329bf-ccf6-4487-b24e-575064a00d1e', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:42 devstack sudo[98073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4a707e24-2d0e-4b07-a72f-6490f2ee3872 1073741824 Nov 03 20:25:42 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ec8dc5c6-d0d4-49f5-a06d-e505e494ae6c tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2a5e402-6fa0-41df-ac02-28a200ccb320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:42 devstack sudo[98073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:42 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-ec8dc5c6-d0d4-49f5-a06d-e505e494ae6c tempest-VolumesGetTest-644387191 None] Volume volume-289329bf-ccf6-4487-b24e-575064a00d1e (289329bf-ccf6-4487-b24e-575064a00d1e): created successfully Nov 03 20:25:42 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ec8dc5c6-d0d4-49f5-a06d-e505e494ae6c tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2a5e402-6fa0-41df-ac02-28a200ccb320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:42 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ec8dc5c6-d0d4-49f5-a06d-e505e494ae6c tempest-VolumesGetTest-644387191 None] Flow 'volume_create_manager' (04479a21-d660-437a-9eae-11e3fded21b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:43 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-ec8dc5c6-d0d4-49f5-a06d-e505e494ae6c tempest-VolumesGetTest-644387191 None] Created volume successfully. Nov 03 20:25:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-307f2e3a-5905-49b7-8e01-753bfb1ea293 tempest-VolumesSnapshotListTestJSON-1038731148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:43 devstack sudo[98073]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-65b3b82d-2243-4b30-a791-0517964c61dc tempest-AttachVolumeTestJSON-1951495544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4a707e24-2d0e-4b07-a72f-6490f2ee3872 1073741824" returned: 0 in 0.510s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-65b3b82d-2243-4b30-a791-0517964c61dc tempest-AttachVolumeTestJSON-1951495544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4a707e24-2d0e-4b07-a72f-6490f2ee3872 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:43 devstack sudo[98079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4a707e24-2d0e-4b07-a72f-6490f2ee3872 Nov 03 20:25:43 devstack sudo[98079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:43 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:25:43 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Flow 'volume_create_manager' (7b6bbb4c-5320-4d0f-851f-92668ac14081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:43 devstack sudo[98079]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:43 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (439830c6-f960-499b-bb92-14cc2c747634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-65b3b82d-2243-4b30-a791-0517964c61dc tempest-AttachVolumeTestJSON-1951495544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4a707e24-2d0e-4b07-a72f-6490f2ee3872" returned: 0 in 0.319s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:43 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-65b3b82d-2243-4b30-a791-0517964c61dc tempest-AttachVolumeTestJSON-1951495544 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:25:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-65b3b82d-2243-4b30-a791-0517964c61dc tempest-AttachVolumeTestJSON-1951495544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-307f2e3a-5905-49b7-8e01-753bfb1ea293 tempest-VolumesSnapshotListTestJSON-1038731148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.759s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:43 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (439830c6-f960-499b-bb92-14cc2c747634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1584911466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a50297eb-0d12-4df8-9bc5-ed3632f6ec07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adb52225a5964afdb123ac33d6adac3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:25:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:25:44Z,use_quota=True,user_id='e0e31ab52b75419c97290f633834ebdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:43 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdaf9ab5-8ca2-45cc-be93-80d6b0024440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:43 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdaf9ab5-8ca2-45cc-be93-80d6b0024440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:43 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82945a64-7741-448f-95f0-2ba1ec06864f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:43 devstack cinder-volume[87248]: DEBUG cinder.image.glance [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Creating Keystone auth plugin from conf {{(pid=87248) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 20:25:43 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-65b3b82d-2243-4b30-a791-0517964c61dc tempest-AttachVolumeTestJSON-1951495544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aee07617-6ecc-44a4-ae85-bc51ba573a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a707e24-2d0e-4b07-a72f-6490f2ee3872', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:43 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-65b3b82d-2243-4b30-a791-0517964c61dc tempest-AttachVolumeTestJSON-1951495544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45c7e094-4721-45d7-8eee-1163ab09c5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:43 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-307f2e3a-5905-49b7-8e01-753bfb1ea293 tempest-VolumesSnapshotListTestJSON-1038731148 None] Creating offline snapshot 10728121-8310-40d0-bcfd-c0a779e7bd8f of volume 69e0df1a-2f6d-4906-994b-3f77cf715b47 {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:25:43 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-65b3b82d-2243-4b30-a791-0517964c61dc tempest-AttachVolumeTestJSON-1951495544 None] Volume volume-4a707e24-2d0e-4b07-a72f-6490f2ee3872 (4a707e24-2d0e-4b07-a72f-6490f2ee3872): created successfully Nov 03 20:25:43 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-65b3b82d-2243-4b30-a791-0517964c61dc tempest-AttachVolumeTestJSON-1951495544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45c7e094-4721-45d7-8eee-1163ab09c5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:43 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-65b3b82d-2243-4b30-a791-0517964c61dc tempest-AttachVolumeTestJSON-1951495544 None] Flow 'volume_create_manager' (c0a69537-08a1-4e20-a484-e03bec9f58fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:43 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[beacfb7e-428e-4661-9093-db1f30ef8da9]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:25:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-307f2e3a-5905-49b7-8e01-753bfb1ea293 tempest-VolumesSnapshotListTestJSON-1038731148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.8f3d584a-d0ae-4ee7-8ab3-b028e7c142b1 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:43 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-65b3b82d-2243-4b30-a791-0517964c61dc tempest-AttachVolumeTestJSON-1951495544 None] Created volume successfully. Nov 03 20:25:44 devstack sudo[98082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.8f3d584a-d0ae-4ee7-8ab3-b028e7c142b1 Nov 03 20:25:44 devstack sudo[98082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:44 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82945a64-7741-448f-95f0-2ba1ec06864f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a50297eb-0d12-4df8-9bc5-ed3632f6ec07', 'volume_name': 'volume-a50297eb-0d12-4df8-9bc5-ed3632f6ec07', 'volume_size': 1, 'image_id': '346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a647f64245a54dad95167f6d04c75eaa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'created_at': datetime.datetime(2026, 11, 3, 19, 11, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 11, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/346de059-5b9a-438e-a6dd-24e9fc9a1ee3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:44 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a0ebbff-a17e-44ec-a8a4-21663bef5632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:44 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a0ebbff-a17e-44ec-a8a4-21663bef5632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:44 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59ed91f0-b3b2-442f-a68d-37f12a2e6e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:44 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Volume a50297eb-0d12-4df8-9bc5-ed3632f6ec07: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a50297eb-0d12-4df8-9bc5-ed3632f6ec07', 'volume_size': 1, 'image_id': '346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a647f64245a54dad95167f6d04c75eaa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'created_at': datetime.datetime(2026, 11, 3, 19, 11, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 11, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/346de059-5b9a-438e-a6dd-24e9fc9a1ee3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 20:25:44 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Trying to clone a50297eb-0d12-4df8-9bc5-ed3632f6ec07 from image 346de059-5b9a-438e-a6dd-24e9fc9a1ee3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'metadata': {}}]). {{(pid=87248) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 20:25:44 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:25:44 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Flow 'volume_create_manager' (3fd6d54d-dc1c-4b57-8406-3bd9c925a0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:44 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f82c2f9-e2e3-4ae8-bb07-58b815e02a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:44 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f82c2f9-e2e3-4ae8-bb07-58b815e02a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1433570117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f33c481-2f9c-4b29-b42f-da5c7a792e87,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7ab0e227a82349bc909b7d4688755960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:25:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=289329bf-ccf6-4487-b24e-575064a00d1e,status='creating',terminated_at=None,updated_at=2026-11-03T19:25:44Z,use_quota=True,user_id='46e27afb1f9e4540be79dd576cbaaaeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:44 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abef9ba9-202d-4618-8950-ddfa37349f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:44 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abef9ba9-202d-4618-8950-ddfa37349f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:44 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9e4128f-3e25-47d5-ab70-e4d104ce5736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:44 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9e4128f-3e25-47d5-ab70-e4d104ce5736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '5f33c481-2f9c-4b29-b42f-da5c7a792e87', 'volume_name': 'volume-5f33c481-2f9c-4b29-b42f-da5c7a792e87', 'volume_size': 1, 'source_volid': '289329bf-ccf6-4487-b24e-575064a00d1e', 'source_volstatus': 'available'}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:44 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82b933a7-069b-493e-a1b8-63cc5cd82b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:44 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82b933a7-069b-493e-a1b8-63cc5cd82b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:44 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1ff2243-ab9a-4ede-9c11-ce76e34c99be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:44 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Volume 5f33c481-2f9c-4b29-b42f-da5c7a792e87: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-5f33c481-2f9c-4b29-b42f-da5c7a792e87', 'volume_size': 1, 'source_volid': '289329bf-ccf6-4487-b24e-575064a00d1e', 'source_volstatus': 'available'} Nov 03 20:25:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:44 devstack sudo[98082]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-307f2e3a-5905-49b7-8e01-753bfb1ea293 tempest-VolumesSnapshotListTestJSON-1038731148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.8f3d584a-d0ae-4ee7-8ab3-b028e7c142b1" returned: 0 in 0.473s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:44 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-307f2e3a-5905-49b7-8e01-753bfb1ea293 tempest-VolumesSnapshotListTestJSON-1038731148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69e0df1a-2f6d-4906-994b-3f77cf715b47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:25:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-307f2e3a-5905-49b7-8e01-753bfb1ea293 tempest-VolumesSnapshotListTestJSON-1038731148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.8f3d584a-d0ae-4ee7-8ab3-b028e7c142b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.10728121-8310-40d0-bcfd-c0a779e7bd8f 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:44 devstack sudo[98087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.8f3d584a-d0ae-4ee7-8ab3-b028e7c142b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.10728121-8310-40d0-bcfd-c0a779e7bd8f 1G Nov 03 20:25:44 devstack sudo[98087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:44 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_bgf0mb_kdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87248) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 20:25:44 devstack cinder-volume[87248]: INFO cinder.image.image_utils [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Image download 20.69 MB at 20.69 MB/s Nov 03 20:25:44 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8acdf88-2d7f-4b8b-8196-8e092616b473]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:25:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_bgf0mb_kdevstack@QuobyteHD {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:44 devstack sudo[98090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_bgf0mb_kdevstack@QuobyteHD Nov 03 20:25:44 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:44 devstack sudo[98087]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-307f2e3a-5905-49b7-8e01-753bfb1ea293 tempest-VolumesSnapshotListTestJSON-1038731148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.8f3d584a-d0ae-4ee7-8ab3-b028e7c142b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.10728121-8310-40d0-bcfd-c0a779e7bd8f 1G" returned: 0 in 0.443s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-307f2e3a-5905-49b7-8e01-753bfb1ea293 tempest-VolumesSnapshotListTestJSON-1038731148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.8f3d584a-d0ae-4ee7-8ab3-b028e7c142b1 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.10728121-8310-40d0-bcfd-c0a779e7bd8f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:44 devstack sudo[98096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.8f3d584a-d0ae-4ee7-8ab3-b028e7c142b1 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.10728121-8310-40d0-bcfd-c0a779e7bd8f Nov 03 20:25:44 devstack sudo[98096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:44 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_bgf0mb_kdevstack@QuobyteHD" returned: 0 in 0.364s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:44 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Temporary image 346de059-5b9a-438e-a6dd-24e9fc9a1ee3 is fetched for user e0e31ab52b75419c97290f633834ebdc. {{(pid=87248) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 20:25:45 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e6e7c5-2ce7-4f18-a8f3-2d2bb2bdbe63]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:25:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_bgf0mb_kdevstack@QuobyteHD {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:45 devstack sudo[98101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_bgf0mb_kdevstack@QuobyteHD Nov 03 20:25:45 devstack sudo[98101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:45 devstack sudo[98096]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-307f2e3a-5905-49b7-8e01-753bfb1ea293 tempest-VolumesSnapshotListTestJSON-1038731148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.8f3d584a-d0ae-4ee7-8ab3-b028e7c142b1 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.10728121-8310-40d0-bcfd-c0a779e7bd8f" returned: 0 in 0.363s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:45 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-307f2e3a-5905-49b7-8e01-753bfb1ea293 tempest-VolumesSnapshotListTestJSON-1038731148 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.10728121-8310-40d0-bcfd-c0a779e7bd8f is being set with open permissions: ugo+rw Nov 03 20:25:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-307f2e3a-5905-49b7-8e01-753bfb1ea293 tempest-VolumesSnapshotListTestJSON-1038731148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.10728121-8310-40d0-bcfd-c0a779e7bd8f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:45 devstack sudo[98111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.10728121-8310-40d0-bcfd-c0a779e7bd8f Nov 03 20:25:45 devstack sudo[98111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:45 devstack sudo[98101]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_bgf0mb_kdevstack@QuobyteHD" returned: 0 in 0.368s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:45 devstack sudo[98111]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-307f2e3a-5905-49b7-8e01-753bfb1ea293 tempest-VolumesSnapshotListTestJSON-1038731148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.10728121-8310-40d0-bcfd-c0a779e7bd8f" returned: 0 in 0.284s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-307f2e3a-5905-49b7-8e01-753bfb1ea293 tempest-VolumesSnapshotListTestJSON-1038731148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.755s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.209s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:45 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Cloning volume 289329bf-ccf6-4487-b24e-575064a00d1e to volume 5f33c481-2f9c-4b29-b42f-da5c7a792e87 Nov 03 20:25:45 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-307f2e3a-5905-49b7-8e01-753bfb1ea293 tempest-VolumesSnapshotListTestJSON-1038731148 None] Create snapshot completed successfully Nov 03 20:25:45 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Creating offline snapshot fdebfde0-c676-4e25-b591-f7e6db601879 of volume 289329bf-ccf6-4487-b24e-575064a00d1e {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:25:45 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f832525-4a02-44a8-bc4b-87fa6f15080d]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:25:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:45 devstack sudo[98117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e Nov 03 20:25:45 devstack sudo[98117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:45 devstack sudo[98117]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e" returned: 0 in 0.390s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e.fdebfde0-c676-4e25-b591-f7e6db601879 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:46 devstack sudo[98132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e.fdebfde0-c676-4e25-b591-f7e6db601879 1G Nov 03 20:25:46 devstack sudo[98132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-e5242060-b179-43e2-8526-66d293cc74c9 req-6c17a1e8-d469-41be-8091-1ef0d5d6e10c tempest-AttachVolumeTestJSON-1951495544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a14b0672-636f-4243-ae86-e140783fcf67 tempest-VolumesSnapshotListTestJSON-1038731148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:46 devstack sudo[98132]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e.fdebfde0-c676-4e25-b591-f7e6db601879 1G" returned: 0 in 0.432s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-289329bf-ccf6-4487-b24e-575064a00d1e -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e.fdebfde0-c676-4e25-b591-f7e6db601879 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:46 devstack sudo[98137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-289329bf-ccf6-4487-b24e-575064a00d1e -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e.fdebfde0-c676-4e25-b591-f7e6db601879 Nov 03 20:25:46 devstack sudo[98137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:46 devstack sudo[98137]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-289329bf-ccf6-4487-b24e-575064a00d1e -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e.fdebfde0-c676-4e25-b591-f7e6db601879" returned: 0 in 0.294s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:46 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e.fdebfde0-c676-4e25-b591-f7e6db601879 is being set with open permissions: ugo+rw Nov 03 20:25:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e.fdebfde0-c676-4e25-b591-f7e6db601879 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:46 devstack sudo[98142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e.fdebfde0-c676-4e25-b591-f7e6db601879 Nov 03 20:25:46 devstack sudo[98142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:46 devstack sudo[98142]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e.fdebfde0-c676-4e25-b591-f7e6db601879" returned: 0 in 0.249s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:47 devstack sudo[98145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e.info Nov 03 20:25:47 devstack sudo[98145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:47 devstack sudo[98145]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e.info" returned: 0 in 0.252s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:47 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e.info is being set with open permissions: ugo+rw Nov 03 20:25:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:47 devstack sudo[98148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e.info Nov 03 20:25:47 devstack sudo[98148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:47 devstack sudo[98148]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e.info" returned: 0 in 0.235s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:47 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Acquiring lock "cinder-quobyte-5f33c481-2f9c-4b29-b42f-da5c7a792e87" by "_copy_volume_from_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:25:47 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Lock "cinder-quobyte-5f33c481-2f9c-4b29-b42f-da5c7a792e87" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:25:47 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] snapshot: fdebfde0-c676-4e25-b591-f7e6db601879, volume: 5f33c481-2f9c-4b29-b42f-da5c7a792e87, {{(pid=87248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 20:25:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:47 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:25:47 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:25:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:47 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1ab825-c0f3-4440-bc7a-a993cab875be]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:25:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e.fdebfde0-c676-4e25-b591-f7e6db601879 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:47 devstack sudo[98151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e.fdebfde0-c676-4e25-b591-f7e6db601879 Nov 03 20:25:47 devstack sudo[98151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:47 devstack sudo[98151]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e.fdebfde0-c676-4e25-b591-f7e6db601879" returned: 0 in 0.365s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:47 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-289329bf-ccf6-4487-b24e-575064a00d1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:25:47 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[c945af56-f02d-4a63-9738-350ca0770f34]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:25:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:48 devstack sudo[98156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e Nov 03 20:25:48 devstack sudo[98156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:48 devstack sudo[98156]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e" returned: 0 in 0.362s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:48 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e {{(pid=87248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 20:25:48 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Creating direct copy from snapshot {{(pid=87248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 20:25:48 devstack cinder-volume[87248]: DEBUG cinder.utils [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Path /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5f33c481-2f9c-4b29-b42f-da5c7a792e87 not found in is_blk_device check {{(pid=87248) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 20:25:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5f33c481-2f9c-4b29-b42f-da5c7a792e87 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:48 devstack sudo[98161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5f33c481-2f9c-4b29-b42f-da5c7a792e87 Nov 03 20:25:48 devstack sudo[98161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:54 devstack sudo[98161]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5f33c481-2f9c-4b29-b42f-da5c7a792e87" returned: 0 in 5.937s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:54 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Image conversion details: src /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e, size 1024.00 MB, duration 5.94 sec, destination /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5f33c481-2f9c-4b29-b42f-da5c7a792e87 {{(pid=87248) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:25:54 devstack cinder-volume[87248]: INFO cinder.image.image_utils [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Converted 1024.00 MB image at 172.45 MB/s Nov 03 20:25:54 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5f33c481-2f9c-4b29-b42f-da5c7a792e87 is being set with open permissions: ugo+rw Nov 03 20:25:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5f33c481-2f9c-4b29-b42f-da5c7a792e87 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:54 devstack sudo[98174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5f33c481-2f9c-4b29-b42f-da5c7a792e87 Nov 03 20:25:54 devstack sudo[98174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:54 devstack sudo[98174]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5f33c481-2f9c-4b29-b42f-da5c7a792e87" returned: 0 in 0.241s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:54 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Lock "cinder-quobyte-5f33c481-2f9c-4b29-b42f-da5c7a792e87" released by "_copy_volume_from_snapshot" :: held 6.968s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:25:54 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Acquiring lock "cinder-quobyte-fdebfde0-c676-4e25-b591-f7e6db601879" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:25:54 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Lock "cinder-quobyte-fdebfde0-c676-4e25-b591-f7e6db601879" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:25:54 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Deleting offline snapshot fdebfde0-c676-4e25-b591-f7e6db601879 of volume 289329bf-ccf6-4487-b24e-575064a00d1e {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:25:54 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] snapshot_file for this snap is: volume-289329bf-ccf6-4487-b24e-575064a00d1e.fdebfde0-c676-4e25-b591-f7e6db601879 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:25:54 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[35737598-fdf6-4ede-8eee-7d639e614b32]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:25:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e.fdebfde0-c676-4e25-b591-f7e6db601879 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:54 devstack sudo[98177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e.fdebfde0-c676-4e25-b591-f7e6db601879 Nov 03 20:25:54 devstack sudo[98177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:54 devstack sudo[98177]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e.fdebfde0-c676-4e25-b591-f7e6db601879" returned: 0 in 0.347s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:54 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-289329bf-ccf6-4487-b24e-575064a00d1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:25:54 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[a563444d-3d53-4297-9f97-fca28fda31be]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:25:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:55 devstack sudo[98182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e Nov 03 20:25:55 devstack sudo[98182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:55 devstack sudo[98182]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e" returned: 0 in 0.516s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e.fdebfde0-c676-4e25-b591-f7e6db601879 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:55 devstack sudo[98187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e.fdebfde0-c676-4e25-b591-f7e6db601879 Nov 03 20:25:55 devstack sudo[98187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:55 devstack sudo[98187]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e.fdebfde0-c676-4e25-b591-f7e6db601879" returned: 0 in 0.317s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e.fdebfde0-c676-4e25-b591-f7e6db601879 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:55 devstack sudo[98192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e.fdebfde0-c676-4e25-b591-f7e6db601879 Nov 03 20:25:55 devstack sudo[98192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:56 devstack sudo[98192]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e.fdebfde0-c676-4e25-b591-f7e6db601879" returned: 0 in 0.252s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:56 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Lock "cinder-quobyte-fdebfde0-c676-4e25-b591-f7e6db601879" released by "_delete_snapshot" :: held 1.531s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:25:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.560s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.710s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:56 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1584911466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a50297eb-0d12-4df8-9bc5-ed3632f6ec07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adb52225a5964afdb123ac33d6adac3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:25:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:25:44Z,use_quota=True,user_id='e0e31ab52b75419c97290f633834ebdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:25:56 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Creating volume a50297eb-0d12-4df8-9bc5-ed3632f6ec07 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:25:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:56 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:25:56 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:25:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:56 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:25:56 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:25:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-a50297eb-0d12-4df8-9bc5-ed3632f6ec07 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:56 devstack sudo[98195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-a50297eb-0d12-4df8-9bc5-ed3632f6ec07 1073741824 Nov 03 20:25:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1ff2243-ab9a-4ede-9c11-ce76e34c99be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f33c481-2f9c-4b29-b42f-da5c7a792e87', 'volume_size': 1, 'source_volid': '289329bf-ccf6-4487-b24e-575064a00d1e', 'source_volstatus': 'available'}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:56 devstack sudo[98195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afacfe0a-e74c-4cfd-ad40-b1e4d5cc33dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:56 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Volume volume-5f33c481-2f9c-4b29-b42f-da5c7a792e87 (5f33c481-2f9c-4b29-b42f-da5c7a792e87): created successfully Nov 03 20:25:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afacfe0a-e74c-4cfd-ad40-b1e4d5cc33dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Flow 'volume_create_manager' (3fd6d54d-dc1c-4b57-8406-3bd9c925a0eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:56 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-37ab826a-11ed-4cc8-85ff-5cd2a912fc0b tempest-VolumesGetTest-644387191 None] Created volume successfully. Nov 03 20:25:56 devstack sudo[98195]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-a50297eb-0d12-4df8-9bc5-ed3632f6ec07 1073741824" returned: 0 in 0.400s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-a50297eb-0d12-4df8-9bc5-ed3632f6ec07 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:56 devstack sudo[98200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-a50297eb-0d12-4df8-9bc5-ed3632f6ec07 Nov 03 20:25:56 devstack sudo[98200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:56 devstack sudo[98200]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-a50297eb-0d12-4df8-9bc5-ed3632f6ec07" returned: 0 in 0.244s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:56 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:25:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-e5242060-b179-43e2-8526-66d293cc74c9 req-6c17a1e8-d469-41be-8091-1ef0d5d6e10c tempest-AttachVolumeTestJSON-1951495544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.768s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-e5242060-b179-43e2-8526-66d293cc74c9 req-6c17a1e8-d469-41be-8091-1ef0d5d6e10c tempest-AttachVolumeTestJSON-1951495544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a14b0672-636f-4243-ae86-e140783fcf67 tempest-VolumesSnapshotListTestJSON-1038731148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.441s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:56 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-a14b0672-636f-4243-ae86-e140783fcf67 tempest-VolumesSnapshotListTestJSON-1038731148 None] Creating offline snapshot 92f512ef-d0cd-4b8f-a4a3-6ea975adf18e of volume 69e0df1a-2f6d-4906-994b-3f77cf715b47 {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:25:56 devstack cinder-volume[87248]: DEBUG cinder.volume.volume_utils [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Attempting download of 346de059-5b9a-438e-a6dd-24e9fc9a1ee3 ((None, [{'url': 'file:///opt/stack/data/glance/images/346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'metadata': {}}])) to volume a50297eb-0d12-4df8-9bc5-ed3632f6ec07. {{(pid=87248) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 20:25:56 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[3999254b-df5b-4503-9d8b-036d8374f80f]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:25:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-e5242060-b179-43e2-8526-66d293cc74c9 req-6c17a1e8-d469-41be-8091-1ef0d5d6e10c tempest-AttachVolumeTestJSON-1951495544 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8', 'name': 'volume-4a707e24-2d0e-4b07-a72f-6490f2ee3872', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3027aea6-40e2-40b3-9a5c-9507b306202f', 'enforce_multipath': True} {{(pid=87248) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 20:25:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a14b0672-636f-4243-ae86-e140783fcf67 tempest-VolumesSnapshotListTestJSON-1038731148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.10728121-8310-40d0-bcfd-c0a779e7bd8f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:56 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[02eb98a5-957d-44cf-ba71-d8dc1f7c536c]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:25:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_yxpgpr9w {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:57 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-e5242060-b179-43e2-8526-66d293cc74c9 req-6c17a1e8-d469-41be-8091-1ef0d5d6e10c tempest-AttachVolumeTestJSON-1951495544 None] attachment_update completed successfully. Nov 03 20:25:57 devstack sudo[98203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.10728121-8310-40d0-bcfd-c0a779e7bd8f Nov 03 20:25:57 devstack sudo[98203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:57 devstack sudo[98204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_yxpgpr9w Nov 03 20:25:57 devstack sudo[98204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:57 devstack sudo[98204]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_yxpgpr9w" returned: 0 in 0.456s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_yxpgpr9w {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:57 devstack sudo[98203]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a14b0672-636f-4243-ae86-e140783fcf67 tempest-VolumesSnapshotListTestJSON-1038731148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.10728121-8310-40d0-bcfd-c0a779e7bd8f" returned: 0 in 0.577s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:57 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-a14b0672-636f-4243-ae86-e140783fcf67 tempest-VolumesSnapshotListTestJSON-1038731148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69e0df1a-2f6d-4906-994b-3f77cf715b47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:25:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a14b0672-636f-4243-ae86-e140783fcf67 tempest-VolumesSnapshotListTestJSON-1038731148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.10728121-8310-40d0-bcfd-c0a779e7bd8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.92f512ef-d0cd-4b8f-a4a3-6ea975adf18e 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:57 devstack sudo[98216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.10728121-8310-40d0-bcfd-c0a779e7bd8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.92f512ef-d0cd-4b8f-a4a3-6ea975adf18e 1G Nov 03 20:25:57 devstack sudo[98216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:57 devstack sudo[98215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_yxpgpr9w Nov 03 20:25:57 devstack sudo[98215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:57 devstack sudo[98215]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_yxpgpr9w" returned: 1 in 0.425s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_yxpgpr9w' failed. Not Retrying. {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 20:25:57 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00f6597-a95e-4ffd-b878-15c13680c5b8]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:25:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_bgf0mb_kdevstack@QuobyteHD {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:57 devstack sudo[98223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_bgf0mb_kdevstack@QuobyteHD Nov 03 20:25:57 devstack sudo[98223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:58 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-c138eb7c-7286-47a3-b593-bc3ab4badf31 tempest-VolumesGetTest-644387191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:25:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c138eb7c-7286-47a3-b593-bc3ab4badf31 tempest-VolumesGetTest-644387191 None] Flow 'volume_create_manager' (3e98f45f-8420-4964-b02a-799aca45d692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c138eb7c-7286-47a3-b593-bc3ab4badf31 tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e01043a6-f7b7-4eab-a4c9-3d70febb9c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c138eb7c-7286-47a3-b593-bc3ab4badf31 tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e01043a6-f7b7-4eab-a4c9-3d70febb9c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:25:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-890151268',display_name='tempest-VolumesGetTest-Volume-1727273482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1028f617-f59c-45e0-bb95-4222cef66192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ab0e227a82349bc909b7d4688755960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:25:58Z,use_quota=True,user_id='46e27afb1f9e4540be79dd576cbaaaeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c138eb7c-7286-47a3-b593-bc3ab4badf31 tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa5344cf-9deb-46a6-bff3-f85339794de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c138eb7c-7286-47a3-b593-bc3ab4badf31 tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa5344cf-9deb-46a6-bff3-f85339794de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c138eb7c-7286-47a3-b593-bc3ab4badf31 tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13935c30-2d1b-4fe1-97c4-c698a16e39e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c138eb7c-7286-47a3-b593-bc3ab4badf31 tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13935c30-2d1b-4fe1-97c4-c698a16e39e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1028f617-f59c-45e0-bb95-4222cef66192', 'volume_name': 'volume-1028f617-f59c-45e0-bb95-4222cef66192', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c138eb7c-7286-47a3-b593-bc3ab4badf31 tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebee1f1d-e3fe-47fe-ad8b-4e218d0ef824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c138eb7c-7286-47a3-b593-bc3ab4badf31 tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebee1f1d-e3fe-47fe-ad8b-4e218d0ef824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c138eb7c-7286-47a3-b593-bc3ab4badf31 tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28a22170-1715-40ff-b874-11e8a07a3562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:58 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-c138eb7c-7286-47a3-b593-bc3ab4badf31 tempest-VolumesGetTest-644387191 None] Volume 1028f617-f59c-45e0-bb95-4222cef66192: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1028f617-f59c-45e0-bb95-4222cef66192', 'volume_size': 1} Nov 03 20:25:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c138eb7c-7286-47a3-b593-bc3ab4badf31 tempest-VolumesGetTest-644387191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:58 devstack sudo[98216]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a14b0672-636f-4243-ae86-e140783fcf67 tempest-VolumesSnapshotListTestJSON-1038731148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.10728121-8310-40d0-bcfd-c0a779e7bd8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.92f512ef-d0cd-4b8f-a4a3-6ea975adf18e 1G" returned: 0 in 0.754s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a14b0672-636f-4243-ae86-e140783fcf67 tempest-VolumesSnapshotListTestJSON-1038731148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.10728121-8310-40d0-bcfd-c0a779e7bd8f -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.92f512ef-d0cd-4b8f-a4a3-6ea975adf18e {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:58 devstack sudo[98233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.10728121-8310-40d0-bcfd-c0a779e7bd8f -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.92f512ef-d0cd-4b8f-a4a3-6ea975adf18e Nov 03 20:25:58 devstack sudo[98233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:58 devstack sudo[98223]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_bgf0mb_kdevstack@QuobyteHD" returned: 0 in 0.433s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:58 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] 346de059-5b9a-438e-a6dd-24e9fc9a1ee3 was qcow2, converting to qcow2 {{(pid=87248) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 20:25:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_bgf0mb_kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-a50297eb-0d12-4df8-9bc5-ed3632f6ec07 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:58 devstack sudo[98235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_bgf0mb_kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-a50297eb-0d12-4df8-9bc5-ed3632f6ec07 Nov 03 20:25:58 devstack sudo[98235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:58 devstack sudo[98233]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a14b0672-636f-4243-ae86-e140783fcf67 tempest-VolumesSnapshotListTestJSON-1038731148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.10728121-8310-40d0-bcfd-c0a779e7bd8f -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.92f512ef-d0cd-4b8f-a4a3-6ea975adf18e" returned: 0 in 0.346s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:58 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-a14b0672-636f-4243-ae86-e140783fcf67 tempest-VolumesSnapshotListTestJSON-1038731148 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.92f512ef-d0cd-4b8f-a4a3-6ea975adf18e is being set with open permissions: ugo+rw Nov 03 20:25:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a14b0672-636f-4243-ae86-e140783fcf67 tempest-VolumesSnapshotListTestJSON-1038731148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.92f512ef-d0cd-4b8f-a4a3-6ea975adf18e {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:58 devstack sudo[98244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.92f512ef-d0cd-4b8f-a4a3-6ea975adf18e Nov 03 20:25:58 devstack sudo[98244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:58 devstack sudo[98244]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a14b0672-636f-4243-ae86-e140783fcf67 tempest-VolumesSnapshotListTestJSON-1038731148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.92f512ef-d0cd-4b8f-a4a3-6ea975adf18e" returned: 0 in 0.304s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a14b0672-636f-4243-ae86-e140783fcf67 tempest-VolumesSnapshotListTestJSON-1038731148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.109s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c138eb7c-7286-47a3-b593-bc3ab4badf31 tempest-VolumesGetTest-644387191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.790s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:58 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c138eb7c-7286-47a3-b593-bc3ab4badf31 tempest-VolumesGetTest-644387191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:25:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-890151268',display_name='tempest-VolumesGetTest-Volume-1727273482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1028f617-f59c-45e0-bb95-4222cef66192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ab0e227a82349bc909b7d4688755960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:25:58Z,use_quota=True,user_id='46e27afb1f9e4540be79dd576cbaaaeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:25:58 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-c138eb7c-7286-47a3-b593-bc3ab4badf31 tempest-VolumesGetTest-644387191 None] Creating volume 1028f617-f59c-45e0-bb95-4222cef66192 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:25:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c138eb7c-7286-47a3-b593-bc3ab4badf31 tempest-VolumesGetTest-644387191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:25:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c138eb7c-7286-47a3-b593-bc3ab4badf31 tempest-VolumesGetTest-644387191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:25:58 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c138eb7c-7286-47a3-b593-bc3ab4badf31 tempest-VolumesGetTest-644387191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:25:58 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c138eb7c-7286-47a3-b593-bc3ab4badf31 tempest-VolumesGetTest-644387191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:25:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c138eb7c-7286-47a3-b593-bc3ab4badf31 tempest-VolumesGetTest-644387191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:58 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c138eb7c-7286-47a3-b593-bc3ab4badf31 tempest-VolumesGetTest-644387191 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:25:58 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-c138eb7c-7286-47a3-b593-bc3ab4badf31 tempest-VolumesGetTest-644387191 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:25:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c138eb7c-7286-47a3-b593-bc3ab4badf31 tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1028f617-f59c-45e0-bb95-4222cef66192 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:58 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-4bf24373-7de6-43ee-b9ed-bc1f8a9eb60d req-edcaede8-2fa9-414b-a958-2d4ed1ad4218 tempest-AttachVolumeTestJSON-1951495544 None] Terminate volume connection completed successfully. Nov 03 20:25:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-4bf24373-7de6-43ee-b9ed-bc1f8a9eb60d req-edcaede8-2fa9-414b-a958-2d4ed1ad4218 tempest-AttachVolumeTestJSON-1951495544 None] Deleting attachment 1dc24c07-2fb2-447a-9ca9-016f405259ec. {{(pid=87248) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 20:25:58 devstack sudo[98251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1028f617-f59c-45e0-bb95-4222cef66192 1073741824 Nov 03 20:25:58 devstack sudo[98251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:58 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-a14b0672-636f-4243-ae86-e140783fcf67 tempest-VolumesSnapshotListTestJSON-1038731148 None] Create snapshot completed successfully Nov 03 20:25:59 devstack sudo[98251]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c138eb7c-7286-47a3-b593-bc3ab4badf31 tempest-VolumesGetTest-644387191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1028f617-f59c-45e0-bb95-4222cef66192 1073741824" returned: 0 in 0.596s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c138eb7c-7286-47a3-b593-bc3ab4badf31 tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1028f617-f59c-45e0-bb95-4222cef66192 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:25:59 devstack sudo[98281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1028f617-f59c-45e0-bb95-4222cef66192 Nov 03 20:25:59 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:25:59 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root Nov 03 20:25:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c138eb7c-7286-47a3-b593-bc3ab4badf31 tempest-VolumesGetTest-644387191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1028f617-f59c-45e0-bb95-4222cef66192" returned: 0 in 0.315s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:25:59 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c138eb7c-7286-47a3-b593-bc3ab4badf31 tempest-VolumesGetTest-644387191 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:25:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c138eb7c-7286-47a3-b593-bc3ab4badf31 tempest-VolumesGetTest-644387191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:25:59 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c138eb7c-7286-47a3-b593-bc3ab4badf31 tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28a22170-1715-40ff-b874-11e8a07a3562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1028f617-f59c-45e0-bb95-4222cef66192', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:59 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c138eb7c-7286-47a3-b593-bc3ab4badf31 tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb8b0e38-c423-4bdb-aa79-21938fbf89a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:25:59 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-c138eb7c-7286-47a3-b593-bc3ab4badf31 tempest-VolumesGetTest-644387191 None] Volume volume-1028f617-f59c-45e0-bb95-4222cef66192 (1028f617-f59c-45e0-bb95-4222cef66192): created successfully Nov 03 20:25:59 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c138eb7c-7286-47a3-b593-bc3ab4badf31 tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb8b0e38-c423-4bdb-aa79-21938fbf89a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:25:59 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c138eb7c-7286-47a3-b593-bc3ab4badf31 tempest-VolumesGetTest-644387191 None] Flow 'volume_create_manager' (3e98f45f-8420-4964-b02a-799aca45d692) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:25:59 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-c138eb7c-7286-47a3-b593-bc3ab4badf31 tempest-VolumesGetTest-644387191 None] Created volume successfully. Nov 03 20:26:00 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-5f437695-9597-42a7-a09f-a9f91047dc69 tempest-VolumesSnapshotListTestJSON-1038731148 None] Acquiring lock "cinder-92f512ef-d0cd-4b8f-a4a3-6ea975adf18e-delete_snapshot" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:00 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-18b6dcb3-18d9-40df-b4d3-f0978edfa623 tempest-VolumesGetTest-644387191 None] Acquiring lock "cinder-1028f617-f59c-45e0-bb95-4222cef66192-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:00 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-5f437695-9597-42a7-a09f-a9f91047dc69 tempest-VolumesSnapshotListTestJSON-1038731148 None] Lock "cinder-92f512ef-d0cd-4b8f-a4a3-6ea975adf18e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:00 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-5f437695-9597-42a7-a09f-a9f91047dc69 tempest-VolumesSnapshotListTestJSON-1038731148 None] Acquiring lock "cinder-quobyte-69e0df1a-2f6d-4906-994b-3f77cf715b47" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:00 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-18b6dcb3-18d9-40df-b4d3-f0978edfa623 tempest-VolumesGetTest-644387191 None] Lock "cinder-1028f617-f59c-45e0-bb95-4222cef66192-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:00 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-5f437695-9597-42a7-a09f-a9f91047dc69 tempest-VolumesSnapshotListTestJSON-1038731148 None] Lock "cinder-quobyte-69e0df1a-2f6d-4906-994b-3f77cf715b47" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:00 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-5f437695-9597-42a7-a09f-a9f91047dc69 tempest-VolumesSnapshotListTestJSON-1038731148 None] Acquiring lock "cinder-quobyte-92f512ef-d0cd-4b8f-a4a3-6ea975adf18e" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:00 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-5f437695-9597-42a7-a09f-a9f91047dc69 tempest-VolumesSnapshotListTestJSON-1038731148 None] Lock "cinder-quobyte-92f512ef-d0cd-4b8f-a4a3-6ea975adf18e" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:00 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-5f437695-9597-42a7-a09f-a9f91047dc69 tempest-VolumesSnapshotListTestJSON-1038731148 None] Deleting offline snapshot 92f512ef-d0cd-4b8f-a4a3-6ea975adf18e of volume 69e0df1a-2f6d-4906-994b-3f77cf715b47 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:26:00 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-5f437695-9597-42a7-a09f-a9f91047dc69 tempest-VolumesSnapshotListTestJSON-1038731148 None] snapshot_file for this snap is: volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.92f512ef-d0cd-4b8f-a4a3-6ea975adf18e {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:26:00 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-18b6dcb3-18d9-40df-b4d3-f0978edfa623 tempest-VolumesGetTest-644387191 None] Acquiring lock "cinder-quobyte-1028f617-f59c-45e0-bb95-4222cef66192" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:00 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf8b805-0dbc-44d4-98e0-bb3fdec9b5f6]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5f437695-9597-42a7-a09f-a9f91047dc69 tempest-VolumesSnapshotListTestJSON-1038731148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.92f512ef-d0cd-4b8f-a4a3-6ea975adf18e {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:00 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-18b6dcb3-18d9-40df-b4d3-f0978edfa623 tempest-VolumesGetTest-644387191 None] Lock "cinder-quobyte-1028f617-f59c-45e0-bb95-4222cef66192" acquired by "delete_volume" :: waited 0.049s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:00 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1cc5a9-a4d3-4c4f-850d-a523ae08250e]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-18b6dcb3-18d9-40df-b4d3-f0978edfa623 tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1028f617-f59c-45e0-bb95-4222cef66192 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:00 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-95d51bfe-1ab2-405b-8e14-53d261552938 req-bdeb2563-41e7-464a-9ab9-7e38fb133a51 tempest-AttachVolumeTestJSON-1951495544 None] Terminate volume connection completed successfully. Nov 03 20:26:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-95d51bfe-1ab2-405b-8e14-53d261552938 req-bdeb2563-41e7-464a-9ab9-7e38fb133a51 tempest-AttachVolumeTestJSON-1951495544 None] Deleting attachment 3027aea6-40e2-40b3-9a5c-9507b306202f. {{(pid=87248) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 20:26:00 devstack sudo[98235]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_bgf0mb_kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-a50297eb-0d12-4df8-9bc5-ed3632f6ec07" returned: 0 in 2.365s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:00 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_bgf0mb_kdevstack@QuobyteHD, size 112.00 MB, duration 2.37 sec, destination /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-a50297eb-0d12-4df8-9bc5-ed3632f6ec07 {{(pid=87248) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:26:00 devstack cinder-volume[87248]: INFO cinder.image.image_utils [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Converted 112.00 MB image at 47.33 MB/s Nov 03 20:26:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-a50297eb-0d12-4df8-9bc5-ed3632f6ec07 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:00 devstack sudo[98288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.92f512ef-d0cd-4b8f-a4a3-6ea975adf18e Nov 03 20:26:00 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:00 devstack sudo[98290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-a50297eb-0d12-4df8-9bc5-ed3632f6ec07 1G Nov 03 20:26:00 devstack sudo[98290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:00 devstack sudo[98289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1028f617-f59c-45e0-bb95-4222cef66192 Nov 03 20:26:00 devstack sudo[98289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:00 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5f437695-9597-42a7-a09f-a9f91047dc69 tempest-VolumesSnapshotListTestJSON-1038731148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.92f512ef-d0cd-4b8f-a4a3-6ea975adf18e" returned: 0 in 0.460s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:00 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-5f437695-9597-42a7-a09f-a9f91047dc69 tempest-VolumesSnapshotListTestJSON-1038731148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69e0df1a-2f6d-4906-994b-3f77cf715b47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:26:00 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[806b5d47-83e9-443c-9f16-12248ab50154]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5f437695-9597-42a7-a09f-a9f91047dc69 tempest-VolumesSnapshotListTestJSON-1038731148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.10728121-8310-40d0-bcfd-c0a779e7bd8f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:01 devstack sudo[98290]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-a50297eb-0d12-4df8-9bc5-ed3632f6ec07 1G" returned: 0 in 0.385s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:01 devstack cinder-volume[87248]: DEBUG cinder.volume.volume_utils [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Downloaded image 346de059-5b9a-438e-a6dd-24e9fc9a1ee3 ((None, [{'url': 'file:///opt/stack/data/glance/images/346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'metadata': {}}])) to volume a50297eb-0d12-4df8-9bc5-ed3632f6ec07 successfully. {{(pid=87248) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 20:26:01 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Temporary image 346de059-5b9a-438e-a6dd-24e9fc9a1ee3 for user e0e31ab52b75419c97290f633834ebdc is deleted. {{(pid=87248) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 20:26:01 devstack cinder-volume[87248]: DEBUG cinder.volume.volume_utils [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Marking volume a50297eb-0d12-4df8-9bc5-ed3632f6ec07 as bootable. {{(pid=87248) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 20:26:01 devstack sudo[98289]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-18b6dcb3-18d9-40df-b4d3-f0978edfa623 tempest-VolumesGetTest-644387191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1028f617-f59c-45e0-bb95-4222cef66192" returned: 0 in 0.454s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-18b6dcb3-18d9-40df-b4d3-f0978edfa623 tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1028f617-f59c-45e0-bb95-4222cef66192 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:01 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Copying metadata from image 346de059-5b9a-438e-a6dd-24e9fc9a1ee3 to a50297eb-0d12-4df8-9bc5-ed3632f6ec07. {{(pid=87248) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 20:26:01 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Creating volume glance metadata for volume a50297eb-0d12-4df8-9bc5-ed3632f6ec07 backed by image 346de059-5b9a-438e-a6dd-24e9fc9a1ee3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87248) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 20:26:01 devstack sudo[98305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1028f617-f59c-45e0-bb95-4222cef66192 Nov 03 20:26:01 devstack sudo[98305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:01 devstack sudo[98304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.10728121-8310-40d0-bcfd-c0a779e7bd8f Nov 03 20:26:01 devstack sudo[98304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59ed91f0-b3b2-442f-a68d-37f12a2e6e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a50297eb-0d12-4df8-9bc5-ed3632f6ec07', 'volume_size': 1, 'image_id': '346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a647f64245a54dad95167f6d04c75eaa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'created_at': datetime.datetime(2026, 11, 3, 19, 11, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 11, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/346de059-5b9a-438e-a6dd-24e9fc9a1ee3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3263e6e2-fc4d-4d1b-821c-cc21d0bf1333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:01 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Volume volume-a50297eb-0d12-4df8-9bc5-ed3632f6ec07 (a50297eb-0d12-4df8-9bc5-ed3632f6ec07): created successfully Nov 03 20:26:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3263e6e2-fc4d-4d1b-821c-cc21d0bf1333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Flow 'volume_create_manager' (7b6bbb4c-5320-4d0f-851f-92668ac14081) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:26:01 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-f1be2788-899b-4361-9505-4d00248672a1 tempest-VolumesExtendTest-1483889950 None] Created volume successfully. Nov 03 20:26:01 devstack sudo[98305]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-18b6dcb3-18d9-40df-b4d3-f0978edfa623 tempest-VolumesGetTest-644387191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1028f617-f59c-45e0-bb95-4222cef66192" returned: 0 in 0.294s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:01 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-18b6dcb3-18d9-40df-b4d3-f0978edfa623 tempest-VolumesGetTest-644387191 None] Lock "cinder-quobyte-1028f617-f59c-45e0-bb95-4222cef66192" released by "delete_volume" :: held 0.826s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:01 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-18b6dcb3-18d9-40df-b4d3-f0978edfa623 tempest-VolumesGetTest-644387191 None] Created reservations ['735b0093-3941-4a95-a524-1e54349429d9', '4cc4f206-3776-4655-b55e-769974127201', '4c8b9395-b8b0-41c9-aaaf-a2e820ad90cd', '1a84db72-c842-4614-89c9-280c6be06a09'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:26:01 devstack sudo[98304]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5f437695-9597-42a7-a09f-a9f91047dc69 tempest-VolumesSnapshotListTestJSON-1038731148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.10728121-8310-40d0-bcfd-c0a779e7bd8f" returned: 0 in 0.453s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:01 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-5f437695-9597-42a7-a09f-a9f91047dc69 tempest-VolumesSnapshotListTestJSON-1038731148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69e0df1a-2f6d-4906-994b-3f77cf715b47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:26:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5f437695-9597-42a7-a09f-a9f91047dc69 tempest-VolumesSnapshotListTestJSON-1038731148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.92f512ef-d0cd-4b8f-a4a3-6ea975adf18e {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:01 devstack sudo[98312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.92f512ef-d0cd-4b8f-a4a3-6ea975adf18e Nov 03 20:26:01 devstack sudo[98312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-18b6dcb3-18d9-40df-b4d3-f0978edfa623 tempest-VolumesGetTest-644387191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-18b6dcb3-18d9-40df-b4d3-f0978edfa623 tempest-VolumesGetTest-644387191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:01 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-18b6dcb3-18d9-40df-b4d3-f0978edfa623 tempest-VolumesGetTest-644387191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:26:01 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-18b6dcb3-18d9-40df-b4d3-f0978edfa623 tempest-VolumesGetTest-644387191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:26:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-18b6dcb3-18d9-40df-b4d3-f0978edfa623 tempest-VolumesGetTest-644387191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-18b6dcb3-18d9-40df-b4d3-f0978edfa623 tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:01 devstack sudo[98314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:26:01 devstack sudo[98314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:01 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-394a0354-f756-43cd-929c-9a0b78f08da9 tempest-VolumesGetTest-644387191 None] Acquiring lock "cinder-5f33c481-2f9c-4b29-b42f-da5c7a792e87-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:01 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-394a0354-f756-43cd-929c-9a0b78f08da9 tempest-VolumesGetTest-644387191 None] Lock "cinder-5f33c481-2f9c-4b29-b42f-da5c7a792e87-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:01 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-394a0354-f756-43cd-929c-9a0b78f08da9 tempest-VolumesGetTest-644387191 None] Acquiring lock "cinder-quobyte-5f33c481-2f9c-4b29-b42f-da5c7a792e87" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:01 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-394a0354-f756-43cd-929c-9a0b78f08da9 tempest-VolumesGetTest-644387191 None] Lock "cinder-quobyte-5f33c481-2f9c-4b29-b42f-da5c7a792e87" acquired by "delete_volume" :: waited 0.029s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:01 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d67915-e35f-4dba-98ca-e520da7ae38d]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-394a0354-f756-43cd-929c-9a0b78f08da9 tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5f33c481-2f9c-4b29-b42f-da5c7a792e87 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:01 devstack sudo[98314]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-18b6dcb3-18d9-40df-b4d3-f0978edfa623 tempest-VolumesGetTest-644387191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.309s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:01 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-18b6dcb3-18d9-40df-b4d3-f0978edfa623 tempest-VolumesGetTest-644387191 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:26:01 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-18b6dcb3-18d9-40df-b4d3-f0978edfa623 tempest-VolumesGetTest-644387191 None] Deleted volume successfully. Nov 03 20:26:01 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-18b6dcb3-18d9-40df-b4d3-f0978edfa623 tempest-VolumesGetTest-644387191 None] Lock "cinder-1028f617-f59c-45e0-bb95-4222cef66192-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:01 devstack sudo[98328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5f33c481-2f9c-4b29-b42f-da5c7a792e87 Nov 03 20:26:01 devstack sudo[98328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:02 devstack sudo[98312]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5f437695-9597-42a7-a09f-a9f91047dc69 tempest-VolumesSnapshotListTestJSON-1038731148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.92f512ef-d0cd-4b8f-a4a3-6ea975adf18e" returned: 0 in 0.591s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5f437695-9597-42a7-a09f-a9f91047dc69 tempest-VolumesSnapshotListTestJSON-1038731148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.92f512ef-d0cd-4b8f-a4a3-6ea975adf18e {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:02 devstack sudo[98331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.92f512ef-d0cd-4b8f-a4a3-6ea975adf18e Nov 03 20:26:02 devstack sudo[98331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e1448350-357d-482f-9e08-853effd8508b tempest-VolumesExtendTest-1483889950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e1448350-357d-482f-9e08-853effd8508b tempest-VolumesExtendTest-1483889950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:02 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[558fdb70-07df-433d-8b1a-abe2279ae036]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e1448350-357d-482f-9e08-853effd8508b tempest-VolumesExtendTest-1483889950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-a50297eb-0d12-4df8-9bc5-ed3632f6ec07 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:02 devstack sudo[98328]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-394a0354-f756-43cd-929c-9a0b78f08da9 tempest-VolumesGetTest-644387191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5f33c481-2f9c-4b29-b42f-da5c7a792e87" returned: 0 in 0.539s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-394a0354-f756-43cd-929c-9a0b78f08da9 tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5f33c481-2f9c-4b29-b42f-da5c7a792e87 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:02 devstack sudo[98341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5f33c481-2f9c-4b29-b42f-da5c7a792e87 Nov 03 20:26:02 devstack sudo[98341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:02 devstack sudo[98340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-a50297eb-0d12-4df8-9bc5-ed3632f6ec07 Nov 03 20:26:02 devstack sudo[98340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:02 devstack sudo[98331]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5f437695-9597-42a7-a09f-a9f91047dc69 tempest-VolumesSnapshotListTestJSON-1038731148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.92f512ef-d0cd-4b8f-a4a3-6ea975adf18e" returned: 0 in 0.689s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:02 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-5f437695-9597-42a7-a09f-a9f91047dc69 tempest-VolumesSnapshotListTestJSON-1038731148 None] Lock "cinder-quobyte-92f512ef-d0cd-4b8f-a4a3-6ea975adf18e" released by "_delete_snapshot" :: held 2.335s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:02 devstack sudo[98341]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:02 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-5f437695-9597-42a7-a09f-a9f91047dc69 tempest-VolumesSnapshotListTestJSON-1038731148 None] Lock "cinder-quobyte-69e0df1a-2f6d-4906-994b-3f77cf715b47" released by "delete_snapshot" :: held 2.395s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-394a0354-f756-43cd-929c-9a0b78f08da9 tempest-VolumesGetTest-644387191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5f33c481-2f9c-4b29-b42f-da5c7a792e87" returned: 0 in 0.462s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:02 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-394a0354-f756-43cd-929c-9a0b78f08da9 tempest-VolumesGetTest-644387191 None] Lock "cinder-quobyte-5f33c481-2f9c-4b29-b42f-da5c7a792e87" released by "delete_volume" :: held 1.061s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:02 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-5f437695-9597-42a7-a09f-a9f91047dc69 tempest-VolumesSnapshotListTestJSON-1038731148 None] Created reservations ['8bc87852-bee6-4fc4-b3d9-1b8d49198f55', 'd838d7b4-717e-4d53-89ba-4dd0243ffb59', '6453b44b-dd83-4640-a2ab-344a7bd17bf2', 'a1f6f197-1c92-4b41-b47c-05e05f2f7ff7'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:26:02 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-394a0354-f756-43cd-929c-9a0b78f08da9 tempest-VolumesGetTest-644387191 None] Created reservations ['4501ce22-88ce-4d1d-a770-a8e86581d523', '06ecdb98-be12-4501-8c29-e4d46cd3f146', 'fb12962d-9712-41d8-83a6-1c29ae2c113f', '264638d9-e855-4e1a-8bad-d8b5dd9ad1e7'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:26:02 devstack sudo[98340]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e1448350-357d-482f-9e08-853effd8508b tempest-VolumesExtendTest-1483889950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-a50297eb-0d12-4df8-9bc5-ed3632f6ec07" returned: 0 in 0.706s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e1448350-357d-482f-9e08-853effd8508b tempest-VolumesExtendTest-1483889950 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-a50297eb-0d12-4df8-9bc5-ed3632f6ec07 2G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-394a0354-f756-43cd-929c-9a0b78f08da9 tempest-VolumesGetTest-644387191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-394a0354-f756-43cd-929c-9a0b78f08da9 tempest-VolumesGetTest-644387191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:03 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-394a0354-f756-43cd-929c-9a0b78f08da9 tempest-VolumesGetTest-644387191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:26:03 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-394a0354-f756-43cd-929c-9a0b78f08da9 tempest-VolumesGetTest-644387191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:26:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-394a0354-f756-43cd-929c-9a0b78f08da9 tempest-VolumesGetTest-644387191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-394a0354-f756-43cd-929c-9a0b78f08da9 tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:03 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-5f437695-9597-42a7-a09f-a9f91047dc69 tempest-VolumesSnapshotListTestJSON-1038731148 None] Delete snapshot completed successfully. Nov 03 20:26:03 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-5f437695-9597-42a7-a09f-a9f91047dc69 tempest-VolumesSnapshotListTestJSON-1038731148 None] Lock "cinder-92f512ef-d0cd-4b8f-a4a3-6ea975adf18e-delete_snapshot" released by "delete_snapshot" :: held 2.761s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:03 devstack sudo[98369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:26:03 devstack sudo[98369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e1448350-357d-482f-9e08-853effd8508b tempest-VolumesExtendTest-1483889950 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-a50297eb-0d12-4df8-9bc5-ed3632f6ec07 2G" returned: 0 in 0.173s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e1448350-357d-482f-9e08-853effd8508b tempest-VolumesExtendTest-1483889950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.921s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:03 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-e1448350-357d-482f-9e08-853effd8508b tempest-VolumesExtendTest-1483889950 None] Extend volume completed successfully. Nov 03 20:26:03 devstack sudo[98369]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-394a0354-f756-43cd-929c-9a0b78f08da9 tempest-VolumesGetTest-644387191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.350s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:03 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-394a0354-f756-43cd-929c-9a0b78f08da9 tempest-VolumesGetTest-644387191 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:26:03 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-394a0354-f756-43cd-929c-9a0b78f08da9 tempest-VolumesGetTest-644387191 None] Deleted volume successfully. Nov 03 20:26:03 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-394a0354-f756-43cd-929c-9a0b78f08da9 tempest-VolumesGetTest-644387191 None] Lock "cinder-5f33c481-2f9c-4b29-b42f-da5c7a792e87-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:03 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-07950001-f42b-4811-a8e4-e64f0a2a2c0a tempest-VolumesSnapshotListTestJSON-1038731148 None] Acquiring lock "cinder-10728121-8310-40d0-bcfd-c0a779e7bd8f-delete_snapshot" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:03 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-07950001-f42b-4811-a8e4-e64f0a2a2c0a tempest-VolumesSnapshotListTestJSON-1038731148 None] Lock "cinder-10728121-8310-40d0-bcfd-c0a779e7bd8f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:03 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-07950001-f42b-4811-a8e4-e64f0a2a2c0a tempest-VolumesSnapshotListTestJSON-1038731148 None] Acquiring lock "cinder-quobyte-69e0df1a-2f6d-4906-994b-3f77cf715b47" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:03 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-bd69e05f-5796-4c24-b527-60bd18c3cac7 tempest-VolumesExtendTest-1483889950 None] Acquiring lock "cinder-a50297eb-0d12-4df8-9bc5-ed3632f6ec07-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:03 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-07950001-f42b-4811-a8e4-e64f0a2a2c0a tempest-VolumesSnapshotListTestJSON-1038731148 None] Lock "cinder-quobyte-69e0df1a-2f6d-4906-994b-3f77cf715b47" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:03 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-07950001-f42b-4811-a8e4-e64f0a2a2c0a tempest-VolumesSnapshotListTestJSON-1038731148 None] Acquiring lock "cinder-quobyte-10728121-8310-40d0-bcfd-c0a779e7bd8f" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:03 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-bd69e05f-5796-4c24-b527-60bd18c3cac7 tempest-VolumesExtendTest-1483889950 None] Lock "cinder-a50297eb-0d12-4df8-9bc5-ed3632f6ec07-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:03 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-07950001-f42b-4811-a8e4-e64f0a2a2c0a tempest-VolumesSnapshotListTestJSON-1038731148 None] Lock "cinder-quobyte-10728121-8310-40d0-bcfd-c0a779e7bd8f" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:03 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-07950001-f42b-4811-a8e4-e64f0a2a2c0a tempest-VolumesSnapshotListTestJSON-1038731148 None] Deleting offline snapshot 10728121-8310-40d0-bcfd-c0a779e7bd8f of volume 69e0df1a-2f6d-4906-994b-3f77cf715b47 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:26:03 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-07950001-f42b-4811-a8e4-e64f0a2a2c0a tempest-VolumesSnapshotListTestJSON-1038731148 None] snapshot_file for this snap is: volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.10728121-8310-40d0-bcfd-c0a779e7bd8f {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:26:03 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-bd69e05f-5796-4c24-b527-60bd18c3cac7 tempest-VolumesExtendTest-1483889950 None] Acquiring lock "cinder-quobyte-a50297eb-0d12-4df8-9bc5-ed3632f6ec07" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:03 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc340e4-48c3-4ee3-894a-bfcf7f873230]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-07950001-f42b-4811-a8e4-e64f0a2a2c0a tempest-VolumesSnapshotListTestJSON-1038731148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.10728121-8310-40d0-bcfd-c0a779e7bd8f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:03 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-bd69e05f-5796-4c24-b527-60bd18c3cac7 tempest-VolumesExtendTest-1483889950 None] Lock "cinder-quobyte-a50297eb-0d12-4df8-9bc5-ed3632f6ec07" acquired by "delete_volume" :: waited 0.046s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:03 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[1640db2f-fb26-463b-8b27-7f43f31c0068]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-bd69e05f-5796-4c24-b527-60bd18c3cac7 tempest-VolumesExtendTest-1483889950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-a50297eb-0d12-4df8-9bc5-ed3632f6ec07 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:04 devstack sudo[98389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.10728121-8310-40d0-bcfd-c0a779e7bd8f Nov 03 20:26:04 devstack sudo[98389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:04 devstack sudo[98410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-a50297eb-0d12-4df8-9bc5-ed3632f6ec07 Nov 03 20:26:04 devstack sudo[98410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:04 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ce0cc7e6-8536-461b-9c78-68aa5d371820 tempest-VolumesGetTest-644387191 None] Acquiring lock "cinder-289329bf-ccf6-4487-b24e-575064a00d1e-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:04 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ce0cc7e6-8536-461b-9c78-68aa5d371820 tempest-VolumesGetTest-644387191 None] Lock "cinder-289329bf-ccf6-4487-b24e-575064a00d1e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:04 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ce0cc7e6-8536-461b-9c78-68aa5d371820 tempest-VolumesGetTest-644387191 None] Acquiring lock "cinder-quobyte-289329bf-ccf6-4487-b24e-575064a00d1e" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:04 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ce0cc7e6-8536-461b-9c78-68aa5d371820 tempest-VolumesGetTest-644387191 None] Lock "cinder-quobyte-289329bf-ccf6-4487-b24e-575064a00d1e" acquired by "delete_volume" :: waited 0.019s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:04 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[024de857-094a-4b0b-9cdd-7be80069dd62]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ce0cc7e6-8536-461b-9c78-68aa5d371820 tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:04 devstack sudo[98414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e Nov 03 20:26:04 devstack sudo[98414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:04 devstack sudo[98410]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-bd69e05f-5796-4c24-b527-60bd18c3cac7 tempest-VolumesExtendTest-1483889950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-a50297eb-0d12-4df8-9bc5-ed3632f6ec07" returned: 0 in 0.501s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-bd69e05f-5796-4c24-b527-60bd18c3cac7 tempest-VolumesExtendTest-1483889950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-a50297eb-0d12-4df8-9bc5-ed3632f6ec07 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:04 devstack sudo[98423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-a50297eb-0d12-4df8-9bc5-ed3632f6ec07 Nov 03 20:26:04 devstack sudo[98423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:04 devstack sudo[98389]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-07950001-f42b-4811-a8e4-e64f0a2a2c0a tempest-VolumesSnapshotListTestJSON-1038731148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.10728121-8310-40d0-bcfd-c0a779e7bd8f" returned: 0 in 0.718s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:04 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-07950001-f42b-4811-a8e4-e64f0a2a2c0a tempest-VolumesSnapshotListTestJSON-1038731148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69e0df1a-2f6d-4906-994b-3f77cf715b47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:26:04 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca4657d-55f5-46f0-8880-476615b29458]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-07950001-f42b-4811-a8e4-e64f0a2a2c0a tempest-VolumesSnapshotListTestJSON-1038731148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.8f3d584a-d0ae-4ee7-8ab3-b028e7c142b1 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:04 devstack sudo[98426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.8f3d584a-d0ae-4ee7-8ab3-b028e7c142b1 Nov 03 20:26:04 devstack sudo[98426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:04 devstack sudo[98414]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ce0cc7e6-8536-461b-9c78-68aa5d371820 tempest-VolumesGetTest-644387191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e" returned: 0 in 0.504s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ce0cc7e6-8536-461b-9c78-68aa5d371820 tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:04 devstack sudo[98433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e Nov 03 20:26:04 devstack sudo[98433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:04 devstack sudo[98423]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-bd69e05f-5796-4c24-b527-60bd18c3cac7 tempest-VolumesExtendTest-1483889950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-a50297eb-0d12-4df8-9bc5-ed3632f6ec07" returned: 0 in 0.431s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:04 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-bd69e05f-5796-4c24-b527-60bd18c3cac7 tempest-VolumesExtendTest-1483889950 None] Lock "cinder-quobyte-a50297eb-0d12-4df8-9bc5-ed3632f6ec07" released by "delete_volume" :: held 1.025s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:04 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-bd69e05f-5796-4c24-b527-60bd18c3cac7 tempest-VolumesExtendTest-1483889950 None] Created reservations ['a62e8cb6-a6b9-4431-b462-a77e85062259', 'c6297dc5-5d61-4d26-b607-194cb4649383', '71f1ef29-6171-4a59-a523-9379fc263889', '94fdf0a1-3b4d-45b9-8562-668a67fcc34a'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:26:05 devstack sudo[98433]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ce0cc7e6-8536-461b-9c78-68aa5d371820 tempest-VolumesGetTest-644387191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-289329bf-ccf6-4487-b24e-575064a00d1e" returned: 0 in 0.335s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:05 devstack sudo[98426]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-07950001-f42b-4811-a8e4-e64f0a2a2c0a tempest-VolumesSnapshotListTestJSON-1038731148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.8f3d584a-d0ae-4ee7-8ab3-b028e7c142b1" returned: 0 in 0.560s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:05 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-07950001-f42b-4811-a8e4-e64f0a2a2c0a tempest-VolumesSnapshotListTestJSON-1038731148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69e0df1a-2f6d-4906-994b-3f77cf715b47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:26:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-07950001-f42b-4811-a8e4-e64f0a2a2c0a tempest-VolumesSnapshotListTestJSON-1038731148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.10728121-8310-40d0-bcfd-c0a779e7bd8f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:05 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ce0cc7e6-8536-461b-9c78-68aa5d371820 tempest-VolumesGetTest-644387191 None] Lock "cinder-quobyte-289329bf-ccf6-4487-b24e-575064a00d1e" released by "delete_volume" :: held 0.950s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-bd69e05f-5796-4c24-b527-60bd18c3cac7 tempest-VolumesExtendTest-1483889950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-bd69e05f-5796-4c24-b527-60bd18c3cac7 tempest-VolumesExtendTest-1483889950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:05 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-bd69e05f-5796-4c24-b527-60bd18c3cac7 tempest-VolumesExtendTest-1483889950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:26:05 devstack sudo[98440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.10728121-8310-40d0-bcfd-c0a779e7bd8f Nov 03 20:26:05 devstack sudo[98440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:05 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-bd69e05f-5796-4c24-b527-60bd18c3cac7 tempest-VolumesExtendTest-1483889950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:26:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-bd69e05f-5796-4c24-b527-60bd18c3cac7 tempest-VolumesExtendTest-1483889950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-bd69e05f-5796-4c24-b527-60bd18c3cac7 tempest-VolumesExtendTest-1483889950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:05 devstack sudo[98442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:26:05 devstack sudo[98442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:05 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-ce0cc7e6-8536-461b-9c78-68aa5d371820 tempest-VolumesGetTest-644387191 None] Created reservations ['cb551f6a-1b29-4ffc-85a5-e74573a3d9cb', '51eec3a8-4e3b-4dff-a9d1-bdf380338d11', '60582eb9-0992-462c-8e4d-2bda78ab0cdf', '726b61e8-a2f3-4f34-a736-77ad1fa5b665'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:26:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ce0cc7e6-8536-461b-9c78-68aa5d371820 tempest-VolumesGetTest-644387191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ce0cc7e6-8536-461b-9c78-68aa5d371820 tempest-VolumesGetTest-644387191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:05 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-ce0cc7e6-8536-461b-9c78-68aa5d371820 tempest-VolumesGetTest-644387191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:26:05 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-ce0cc7e6-8536-461b-9c78-68aa5d371820 tempest-VolumesGetTest-644387191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:26:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ce0cc7e6-8536-461b-9c78-68aa5d371820 tempest-VolumesGetTest-644387191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ce0cc7e6-8536-461b-9c78-68aa5d371820 tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:05 devstack sudo[98446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:26:05 devstack sudo[98446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:05 devstack sudo[98442]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-bd69e05f-5796-4c24-b527-60bd18c3cac7 tempest-VolumesExtendTest-1483889950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.345s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:05 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-bd69e05f-5796-4c24-b527-60bd18c3cac7 tempest-VolumesExtendTest-1483889950 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:26:05 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-bd69e05f-5796-4c24-b527-60bd18c3cac7 tempest-VolumesExtendTest-1483889950 None] Deleted volume successfully. Nov 03 20:26:05 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-bd69e05f-5796-4c24-b527-60bd18c3cac7 tempest-VolumesExtendTest-1483889950 None] Lock "cinder-a50297eb-0d12-4df8-9bc5-ed3632f6ec07-delete_volume" released by "delete_volume" :: held 1.831s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:05 devstack sudo[98440]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-07950001-f42b-4811-a8e4-e64f0a2a2c0a tempest-VolumesSnapshotListTestJSON-1038731148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.10728121-8310-40d0-bcfd-c0a779e7bd8f" returned: 0 in 0.438s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-07950001-f42b-4811-a8e4-e64f0a2a2c0a tempest-VolumesSnapshotListTestJSON-1038731148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.10728121-8310-40d0-bcfd-c0a779e7bd8f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:05 devstack sudo[98451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.10728121-8310-40d0-bcfd-c0a779e7bd8f Nov 03 20:26:05 devstack sudo[98451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:05 devstack sudo[98446]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ce0cc7e6-8536-461b-9c78-68aa5d371820 tempest-VolumesGetTest-644387191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.265s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:05 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-ce0cc7e6-8536-461b-9c78-68aa5d371820 tempest-VolumesGetTest-644387191 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:26:05 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-ce0cc7e6-8536-461b-9c78-68aa5d371820 tempest-VolumesGetTest-644387191 None] Deleted volume successfully. Nov 03 20:26:05 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ce0cc7e6-8536-461b-9c78-68aa5d371820 tempest-VolumesGetTest-644387191 None] Lock "cinder-289329bf-ccf6-4487-b24e-575064a00d1e-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:05 devstack sudo[98451]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-07950001-f42b-4811-a8e4-e64f0a2a2c0a tempest-VolumesSnapshotListTestJSON-1038731148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.10728121-8310-40d0-bcfd-c0a779e7bd8f" returned: 0 in 0.273s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:05 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-07950001-f42b-4811-a8e4-e64f0a2a2c0a tempest-VolumesSnapshotListTestJSON-1038731148 None] Lock "cinder-quobyte-10728121-8310-40d0-bcfd-c0a779e7bd8f" released by "_delete_snapshot" :: held 2.123s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:05 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-07950001-f42b-4811-a8e4-e64f0a2a2c0a tempest-VolumesSnapshotListTestJSON-1038731148 None] Lock "cinder-quobyte-69e0df1a-2f6d-4906-994b-3f77cf715b47" released by "delete_snapshot" :: held 2.173s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:05 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-07950001-f42b-4811-a8e4-e64f0a2a2c0a tempest-VolumesSnapshotListTestJSON-1038731148 None] Created reservations ['a3efc4c5-473c-4532-b511-a06e76511f71', 'ae7ebd95-f4ac-414f-b598-01e040a4c0ba', 'cb423d41-fc86-4dac-b63c-d2e916f2625f', '0e4ee736-297b-459c-9e72-85fb3baa815a'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:26:06 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-07950001-f42b-4811-a8e4-e64f0a2a2c0a tempest-VolumesSnapshotListTestJSON-1038731148 None] Delete snapshot completed successfully. Nov 03 20:26:06 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-07950001-f42b-4811-a8e4-e64f0a2a2c0a tempest-VolumesSnapshotListTestJSON-1038731148 None] Lock "cinder-10728121-8310-40d0-bcfd-c0a779e7bd8f-delete_snapshot" released by "delete_snapshot" :: held 2.345s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:06 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-e53691a6-c20f-4544-9063-2f5d4edf9af6 tempest-VolumesExtendTest-1483889950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:26:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e53691a6-c20f-4544-9063-2f5d4edf9af6 tempest-VolumesExtendTest-1483889950 None] Flow 'volume_create_manager' (ef09af64-9001-4676-980d-15e980d32b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:26:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e53691a6-c20f-4544-9063-2f5d4edf9af6 tempest-VolumesExtendTest-1483889950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42f0b732-db64-41f0-9ccc-8f1efd61d642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e53691a6-c20f-4544-9063-2f5d4edf9af6 tempest-VolumesExtendTest-1483889950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42f0b732-db64-41f0-9ccc-8f1efd61d642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1320676697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddc8823c-5291-45bc-aacb-a54e9f367a81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adb52225a5964afdb123ac33d6adac3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:26:06Z,use_quota=True,user_id='e0e31ab52b75419c97290f633834ebdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e53691a6-c20f-4544-9063-2f5d4edf9af6 tempest-VolumesExtendTest-1483889950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77484b88-9fa3-4b6f-af8e-fd6e9327a3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e53691a6-c20f-4544-9063-2f5d4edf9af6 tempest-VolumesExtendTest-1483889950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77484b88-9fa3-4b6f-af8e-fd6e9327a3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e53691a6-c20f-4544-9063-2f5d4edf9af6 tempest-VolumesExtendTest-1483889950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (690ed932-383f-49dc-ab8b-144384a5ce39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e53691a6-c20f-4544-9063-2f5d4edf9af6 tempest-VolumesExtendTest-1483889950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (690ed932-383f-49dc-ab8b-144384a5ce39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddc8823c-5291-45bc-aacb-a54e9f367a81', 'volume_name': 'volume-ddc8823c-5291-45bc-aacb-a54e9f367a81', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e53691a6-c20f-4544-9063-2f5d4edf9af6 tempest-VolumesExtendTest-1483889950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eb250a8-3a3a-40f8-a09d-1b9d6e197c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e53691a6-c20f-4544-9063-2f5d4edf9af6 tempest-VolumesExtendTest-1483889950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eb250a8-3a3a-40f8-a09d-1b9d6e197c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e53691a6-c20f-4544-9063-2f5d4edf9af6 tempest-VolumesExtendTest-1483889950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0591558-b71b-4f11-88fa-36a951ac14de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:06 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-e53691a6-c20f-4544-9063-2f5d4edf9af6 tempest-VolumesExtendTest-1483889950 None] Volume ddc8823c-5291-45bc-aacb-a54e9f367a81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddc8823c-5291-45bc-aacb-a54e9f367a81', 'volume_size': 1} Nov 03 20:26:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e53691a6-c20f-4544-9063-2f5d4edf9af6 tempest-VolumesExtendTest-1483889950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e53691a6-c20f-4544-9063-2f5d4edf9af6 tempest-VolumesExtendTest-1483889950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e53691a6-c20f-4544-9063-2f5d4edf9af6 tempest-VolumesExtendTest-1483889950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1320676697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddc8823c-5291-45bc-aacb-a54e9f367a81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adb52225a5964afdb123ac33d6adac3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:26:06Z,use_quota=True,user_id='e0e31ab52b75419c97290f633834ebdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:26:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-e53691a6-c20f-4544-9063-2f5d4edf9af6 tempest-VolumesExtendTest-1483889950 None] Creating volume ddc8823c-5291-45bc-aacb-a54e9f367a81 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:26:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e53691a6-c20f-4544-9063-2f5d4edf9af6 tempest-VolumesExtendTest-1483889950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e53691a6-c20f-4544-9063-2f5d4edf9af6 tempest-VolumesExtendTest-1483889950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e53691a6-c20f-4544-9063-2f5d4edf9af6 tempest-VolumesExtendTest-1483889950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:26:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e53691a6-c20f-4544-9063-2f5d4edf9af6 tempest-VolumesExtendTest-1483889950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:26:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e53691a6-c20f-4544-9063-2f5d4edf9af6 tempest-VolumesExtendTest-1483889950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e53691a6-c20f-4544-9063-2f5d4edf9af6 tempest-VolumesExtendTest-1483889950 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:26:06 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-e53691a6-c20f-4544-9063-2f5d4edf9af6 tempest-VolumesExtendTest-1483889950 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:26:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e53691a6-c20f-4544-9063-2f5d4edf9af6 tempest-VolumesExtendTest-1483889950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:06 devstack sudo[98455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81 1073741824 Nov 03 20:26:06 devstack sudo[98455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:06 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d3f78363-2fe8-40f8-b6ec-07431d55595c tempest-VolumesSnapshotListTestJSON-1038731148 None] Acquiring lock "cinder-8f3d584a-d0ae-4ee7-8ab3-b028e7c142b1-delete_snapshot" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:06 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d3f78363-2fe8-40f8-b6ec-07431d55595c tempest-VolumesSnapshotListTestJSON-1038731148 None] Lock "cinder-8f3d584a-d0ae-4ee7-8ab3-b028e7c142b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:06 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d3f78363-2fe8-40f8-b6ec-07431d55595c tempest-VolumesSnapshotListTestJSON-1038731148 None] Acquiring lock "cinder-quobyte-69e0df1a-2f6d-4906-994b-3f77cf715b47" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:06 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d3f78363-2fe8-40f8-b6ec-07431d55595c tempest-VolumesSnapshotListTestJSON-1038731148 None] Lock "cinder-quobyte-69e0df1a-2f6d-4906-994b-3f77cf715b47" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:06 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d3f78363-2fe8-40f8-b6ec-07431d55595c tempest-VolumesSnapshotListTestJSON-1038731148 None] Acquiring lock "cinder-quobyte-8f3d584a-d0ae-4ee7-8ab3-b028e7c142b1" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:06 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d3f78363-2fe8-40f8-b6ec-07431d55595c tempest-VolumesSnapshotListTestJSON-1038731148 None] Lock "cinder-quobyte-8f3d584a-d0ae-4ee7-8ab3-b028e7c142b1" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-d3f78363-2fe8-40f8-b6ec-07431d55595c tempest-VolumesSnapshotListTestJSON-1038731148 None] Deleting offline snapshot 8f3d584a-d0ae-4ee7-8ab3-b028e7c142b1 of volume 69e0df1a-2f6d-4906-994b-3f77cf715b47 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:26:07 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-d3f78363-2fe8-40f8-b6ec-07431d55595c tempest-VolumesSnapshotListTestJSON-1038731148 None] snapshot_file for this snap is: volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.8f3d584a-d0ae-4ee7-8ab3-b028e7c142b1 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:26:07 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09455be-6b8f-4d90-83a9-85e92ff14559]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d3f78363-2fe8-40f8-b6ec-07431d55595c tempest-VolumesSnapshotListTestJSON-1038731148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.8f3d584a-d0ae-4ee7-8ab3-b028e7c142b1 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:07 devstack sudo[98460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.8f3d584a-d0ae-4ee7-8ab3-b028e7c142b1 Nov 03 20:26:07 devstack sudo[98460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:07 devstack sudo[98455]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e53691a6-c20f-4544-9063-2f5d4edf9af6 tempest-VolumesExtendTest-1483889950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81 1073741824" returned: 0 in 0.663s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e53691a6-c20f-4544-9063-2f5d4edf9af6 tempest-VolumesExtendTest-1483889950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:07 devstack sudo[98462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81 Nov 03 20:26:07 devstack sudo[98462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:07 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:26:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Flow 'volume_create_manager' (cc6544b8-fa3a-4f12-908e-373a4c3f89a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:26:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46cbfc05-fceb-4b6d-b35a-002a9662ac9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46cbfc05-fceb-4b6d-b35a-002a9662ac9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-803584951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f94a57ed-2eaf-441b-a0fb-a83f660d4225,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7ab0e227a82349bc909b7d4688755960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:26:07Z,use_quota=True,user_id='46e27afb1f9e4540be79dd576cbaaaeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6c94137-0d89-431b-a7cc-4b16119c1f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6c94137-0d89-431b-a7cc-4b16119c1f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (574b85c7-033e-4812-a728-53feaf52cc17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:07 devstack cinder-volume[87248]: DEBUG cinder.image.glance [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Creating Keystone auth plugin from conf {{(pid=87248) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 20:26:07 devstack sudo[98460]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d3f78363-2fe8-40f8-b6ec-07431d55595c tempest-VolumesSnapshotListTestJSON-1038731148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.8f3d584a-d0ae-4ee7-8ab3-b028e7c142b1" returned: 0 in 0.530s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:07 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-d3f78363-2fe8-40f8-b6ec-07431d55595c tempest-VolumesSnapshotListTestJSON-1038731148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69e0df1a-2f6d-4906-994b-3f77cf715b47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:26:07 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9e3d4548-b227-48f9-bc19-b5d687ef5320 tempest-AttachVolumeTestJSON-1951495544 None] Acquiring lock "cinder-4a707e24-2d0e-4b07-a72f-6490f2ee3872-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:07 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb014c5-6f31-45f2-9492-0830f807a9f8]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d3f78363-2fe8-40f8-b6ec-07431d55595c tempest-VolumesSnapshotListTestJSON-1038731148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:07 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9e3d4548-b227-48f9-bc19-b5d687ef5320 tempest-AttachVolumeTestJSON-1951495544 None] Lock "cinder-4a707e24-2d0e-4b07-a72f-6490f2ee3872-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:07 devstack sudo[98462]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e53691a6-c20f-4544-9063-2f5d4edf9af6 tempest-VolumesExtendTest-1483889950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81" returned: 0 in 0.380s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:07 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e53691a6-c20f-4544-9063-2f5d4edf9af6 tempest-VolumesExtendTest-1483889950 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:26:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e53691a6-c20f-4544-9063-2f5d4edf9af6 tempest-VolumesExtendTest-1483889950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e53691a6-c20f-4544-9063-2f5d4edf9af6 tempest-VolumesExtendTest-1483889950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0591558-b71b-4f11-88fa-36a951ac14de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddc8823c-5291-45bc-aacb-a54e9f367a81', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e53691a6-c20f-4544-9063-2f5d4edf9af6 tempest-VolumesExtendTest-1483889950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0061292-17ce-470a-89da-a99c02c2a743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:07 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9e3d4548-b227-48f9-bc19-b5d687ef5320 tempest-AttachVolumeTestJSON-1951495544 None] Acquiring lock "cinder-quobyte-4a707e24-2d0e-4b07-a72f-6490f2ee3872" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:07 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-e53691a6-c20f-4544-9063-2f5d4edf9af6 tempest-VolumesExtendTest-1483889950 None] Volume volume-ddc8823c-5291-45bc-aacb-a54e9f367a81 (ddc8823c-5291-45bc-aacb-a54e9f367a81): created successfully Nov 03 20:26:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e53691a6-c20f-4544-9063-2f5d4edf9af6 tempest-VolumesExtendTest-1483889950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0061292-17ce-470a-89da-a99c02c2a743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e53691a6-c20f-4544-9063-2f5d4edf9af6 tempest-VolumesExtendTest-1483889950 None] Flow 'volume_create_manager' (ef09af64-9001-4676-980d-15e980d32b2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:26:07 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9e3d4548-b227-48f9-bc19-b5d687ef5320 tempest-AttachVolumeTestJSON-1951495544 None] Lock "cinder-quobyte-4a707e24-2d0e-4b07-a72f-6490f2ee3872" acquired by "delete_volume" :: waited 0.032s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:07 devstack sudo[98472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47 Nov 03 20:26:07 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:07 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-e53691a6-c20f-4544-9063-2f5d4edf9af6 tempest-VolumesExtendTest-1483889950 None] Created volume successfully. Nov 03 20:26:07 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[af501029-aa68-4d3e-b3f9-9198482e0edd]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9e3d4548-b227-48f9-bc19-b5d687ef5320 tempest-AttachVolumeTestJSON-1951495544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4a707e24-2d0e-4b07-a72f-6490f2ee3872 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (574b85c7-033e-4812-a728-53feaf52cc17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f94a57ed-2eaf-441b-a0fb-a83f660d4225', 'volume_name': 'volume-f94a57ed-2eaf-441b-a0fb-a83f660d4225', 'volume_size': 1, 'image_id': '346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a647f64245a54dad95167f6d04c75eaa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'created_at': datetime.datetime(2026, 11, 3, 19, 11, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 11, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/346de059-5b9a-438e-a6dd-24e9fc9a1ee3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5b8a9e5-03d4-4384-973c-5c83bfc60321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5b8a9e5-03d4-4384-973c-5c83bfc60321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4b643ef-a3fb-4772-a2c6-88c0b2d3879f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:07 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Volume f94a57ed-2eaf-441b-a0fb-a83f660d4225: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f94a57ed-2eaf-441b-a0fb-a83f660d4225', 'volume_size': 1, 'image_id': '346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a647f64245a54dad95167f6d04c75eaa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'created_at': datetime.datetime(2026, 11, 3, 19, 11, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 11, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/346de059-5b9a-438e-a6dd-24e9fc9a1ee3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 20:26:07 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Trying to clone f94a57ed-2eaf-441b-a0fb-a83f660d4225 from image 346de059-5b9a-438e-a6dd-24e9fc9a1ee3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'metadata': {}}]). {{(pid=87248) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 20:26:07 devstack sudo[98474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4a707e24-2d0e-4b07-a72f-6490f2ee3872 Nov 03 20:26:07 devstack sudo[98474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:08 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d3f78363-2fe8-40f8-b6ec-07431d55595c tempest-VolumesSnapshotListTestJSON-1038731148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47" returned: 0 in 0.464s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d3f78363-2fe8-40f8-b6ec-07431d55595c tempest-VolumesSnapshotListTestJSON-1038731148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.8f3d584a-d0ae-4ee7-8ab3-b028e7c142b1 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:08 devstack sudo[98479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.8f3d584a-d0ae-4ee7-8ab3-b028e7c142b1 Nov 03 20:26:08 devstack sudo[98479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:08 devstack sudo[98474]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9e3d4548-b227-48f9-bc19-b5d687ef5320 tempest-AttachVolumeTestJSON-1951495544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4a707e24-2d0e-4b07-a72f-6490f2ee3872" returned: 0 in 0.517s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9e3d4548-b227-48f9-bc19-b5d687ef5320 tempest-AttachVolumeTestJSON-1951495544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4a707e24-2d0e-4b07-a72f-6490f2ee3872 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:08 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_hvb55pq4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87248) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 20:26:08 devstack cinder-volume[87248]: INFO cinder.image.image_utils [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Image download 20.69 MB at 20.69 MB/s Nov 03 20:26:08 devstack sudo[98485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4a707e24-2d0e-4b07-a72f-6490f2ee3872 Nov 03 20:26:08 devstack sudo[98485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:08 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b0aad1-77a2-45c0-b9c3-5e1c344e35c1]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_hvb55pq4devstack@QuobyteHD {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:08 devstack sudo[98489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_hvb55pq4devstack@QuobyteHD Nov 03 20:26:08 devstack sudo[98489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:08 devstack sudo[98479]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d3f78363-2fe8-40f8-b6ec-07431d55595c tempest-VolumesSnapshotListTestJSON-1038731148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.8f3d584a-d0ae-4ee7-8ab3-b028e7c142b1" returned: 0 in 0.459s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d3f78363-2fe8-40f8-b6ec-07431d55595c tempest-VolumesSnapshotListTestJSON-1038731148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.8f3d584a-d0ae-4ee7-8ab3-b028e7c142b1 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:08 devstack sudo[98493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.8f3d584a-d0ae-4ee7-8ab3-b028e7c142b1 Nov 03 20:26:08 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:08 devstack sudo[98485]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9e3d4548-b227-48f9-bc19-b5d687ef5320 tempest-AttachVolumeTestJSON-1951495544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4a707e24-2d0e-4b07-a72f-6490f2ee3872" returned: 0 in 0.281s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:08 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9e3d4548-b227-48f9-bc19-b5d687ef5320 tempest-AttachVolumeTestJSON-1951495544 None] Lock "cinder-quobyte-4a707e24-2d0e-4b07-a72f-6490f2ee3872" released by "delete_volume" :: held 0.860s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:08 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-9e3d4548-b227-48f9-bc19-b5d687ef5320 tempest-AttachVolumeTestJSON-1951495544 None] Created reservations ['9c65ffb2-c1bb-4503-ad30-852537564081', 'a4a19c6a-1296-4a09-aff7-1d4fd9a63a74', '8f0a96b4-3534-4ef7-8371-3895310523a2', '4d4039f2-7eff-4929-b71d-333317197229'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:26:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-9e3d4548-b227-48f9-bc19-b5d687ef5320 tempest-AttachVolumeTestJSON-1951495544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-9e3d4548-b227-48f9-bc19-b5d687ef5320 tempest-AttachVolumeTestJSON-1951495544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:08 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-9e3d4548-b227-48f9-bc19-b5d687ef5320 tempest-AttachVolumeTestJSON-1951495544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:26:08 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-9e3d4548-b227-48f9-bc19-b5d687ef5320 tempest-AttachVolumeTestJSON-1951495544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:26:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-9e3d4548-b227-48f9-bc19-b5d687ef5320 tempest-AttachVolumeTestJSON-1951495544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9e3d4548-b227-48f9-bc19-b5d687ef5320 tempest-AttachVolumeTestJSON-1951495544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:08 devstack sudo[98495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:26:08 devstack sudo[98495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:08 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d3f78363-2fe8-40f8-b6ec-07431d55595c tempest-VolumesSnapshotListTestJSON-1038731148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47.8f3d584a-d0ae-4ee7-8ab3-b028e7c142b1" returned: 0 in 0.317s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e0536c6b-c4dd-490e-aa99-177951f12bd9 tempest-VolumesExtendTest-1483889950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e0536c6b-c4dd-490e-aa99-177951f12bd9 tempest-VolumesExtendTest-1483889950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:08 devstack sudo[98489]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_hvb55pq4devstack@QuobyteHD" returned: 0 in 0.506s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:08 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-e0536c6b-c4dd-490e-aa99-177951f12bd9 tempest-VolumesExtendTest-1483889950 None] Creating offline snapshot 4fbb6b79-88a7-4775-b873-c912449f8277 of volume ddc8823c-5291-45bc-aacb-a54e9f367a81 {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:26:08 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Temporary image 346de059-5b9a-438e-a6dd-24e9fc9a1ee3 is fetched for user 46e27afb1f9e4540be79dd576cbaaaeb. {{(pid=87248) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 20:26:08 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[57617f42-9172-47b4-8114-cfb2cee307ae]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e0536c6b-c4dd-490e-aa99-177951f12bd9 tempest-VolumesExtendTest-1483889950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:08 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d3f78363-2fe8-40f8-b6ec-07431d55595c tempest-VolumesSnapshotListTestJSON-1038731148 None] Lock "cinder-quobyte-8f3d584a-d0ae-4ee7-8ab3-b028e7c142b1" released by "_delete_snapshot" :: held 1.993s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:08 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d3f78363-2fe8-40f8-b6ec-07431d55595c tempest-VolumesSnapshotListTestJSON-1038731148 None] Lock "cinder-quobyte-69e0df1a-2f6d-4906-994b-3f77cf715b47" released by "delete_snapshot" :: held 2.033s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:09 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[611d51ac-d120-41bc-8a94-60bec30cda75]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_hvb55pq4devstack@QuobyteHD {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:09 devstack sudo[98502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81 Nov 03 20:26:09 devstack sudo[98502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:09 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-d3f78363-2fe8-40f8-b6ec-07431d55595c tempest-VolumesSnapshotListTestJSON-1038731148 None] Created reservations ['9be84b6f-3002-4946-9156-87d692b32091', '63430d07-2198-48ca-a51e-7d6e4cdf6987', 'ee2e4006-8955-4767-8aa2-60f21cb7f5eb', 'dc3daf4b-762f-488c-bbf9-ec6d3800f406'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:26:09 devstack sudo[98495]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9e3d4548-b227-48f9-bc19-b5d687ef5320 tempest-AttachVolumeTestJSON-1951495544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.330s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:09 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-9e3d4548-b227-48f9-bc19-b5d687ef5320 tempest-AttachVolumeTestJSON-1951495544 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:26:09 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-9e3d4548-b227-48f9-bc19-b5d687ef5320 tempest-AttachVolumeTestJSON-1951495544 None] Deleted volume successfully. Nov 03 20:26:09 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9e3d4548-b227-48f9-bc19-b5d687ef5320 tempest-AttachVolumeTestJSON-1951495544 None] Lock "cinder-4a707e24-2d0e-4b07-a72f-6490f2ee3872-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:09 devstack sudo[98503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_hvb55pq4devstack@QuobyteHD Nov 03 20:26:09 devstack sudo[98503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:09 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-d3f78363-2fe8-40f8-b6ec-07431d55595c tempest-VolumesSnapshotListTestJSON-1038731148 None] Delete snapshot completed successfully. Nov 03 20:26:09 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d3f78363-2fe8-40f8-b6ec-07431d55595c tempest-VolumesSnapshotListTestJSON-1038731148 None] Lock "cinder-8f3d584a-d0ae-4ee7-8ab3-b028e7c142b1-delete_snapshot" released by "delete_snapshot" :: held 2.321s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:09 devstack sudo[98503]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_hvb55pq4devstack@QuobyteHD" returned: 0 in 0.393s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:09 devstack sudo[98502]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e0536c6b-c4dd-490e-aa99-177951f12bd9 tempest-VolumesExtendTest-1483889950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81" returned: 0 in 0.482s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e0536c6b-c4dd-490e-aa99-177951f12bd9 tempest-VolumesExtendTest-1483889950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81.4fbb6b79-88a7-4775-b873-c912449f8277 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:09 devstack sudo[98513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81.4fbb6b79-88a7-4775-b873-c912449f8277 1G Nov 03 20:26:09 devstack sudo[98513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:09 devstack sudo[98513]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e0536c6b-c4dd-490e-aa99-177951f12bd9 tempest-VolumesExtendTest-1483889950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81.4fbb6b79-88a7-4775-b873-c912449f8277 1G" returned: 0 in 0.410s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e0536c6b-c4dd-490e-aa99-177951f12bd9 tempest-VolumesExtendTest-1483889950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddc8823c-5291-45bc-aacb-a54e9f367a81 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81.4fbb6b79-88a7-4775-b873-c912449f8277 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:09 devstack sudo[98519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddc8823c-5291-45bc-aacb-a54e9f367a81 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81.4fbb6b79-88a7-4775-b873-c912449f8277 Nov 03 20:26:09 devstack sudo[98519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:09 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-14f4e0d1-b793-4c0c-9932-c92031514198 tempest-AttachVolumeTestJSON-1951495544 None] Acquiring lock "cinder-dc7e0e9f-b845-4406-b203-01af3e2a7b80-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:09 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-14f4e0d1-b793-4c0c-9932-c92031514198 tempest-AttachVolumeTestJSON-1951495544 None] Lock "cinder-dc7e0e9f-b845-4406-b203-01af3e2a7b80-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:09 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-14f4e0d1-b793-4c0c-9932-c92031514198 tempest-AttachVolumeTestJSON-1951495544 None] Acquiring lock "cinder-quobyte-dc7e0e9f-b845-4406-b203-01af3e2a7b80" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:09 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-14f4e0d1-b793-4c0c-9932-c92031514198 tempest-AttachVolumeTestJSON-1951495544 None] Lock "cinder-quobyte-dc7e0e9f-b845-4406-b203-01af3e2a7b80" acquired by "delete_volume" :: waited 0.018s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:10 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[234d2da9-30a7-4fc1-b997-7d36d33c9aef]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-14f4e0d1-b793-4c0c-9932-c92031514198 tempest-AttachVolumeTestJSON-1951495544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-dc7e0e9f-b845-4406-b203-01af3e2a7b80 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:10 devstack sudo[98521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-dc7e0e9f-b845-4406-b203-01af3e2a7b80 Nov 03 20:26:10 devstack sudo[98521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:10 devstack sudo[98519]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e0536c6b-c4dd-490e-aa99-177951f12bd9 tempest-VolumesExtendTest-1483889950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddc8823c-5291-45bc-aacb-a54e9f367a81 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81.4fbb6b79-88a7-4775-b873-c912449f8277" returned: 0 in 0.324s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:10 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-e0536c6b-c4dd-490e-aa99-177951f12bd9 tempest-VolumesExtendTest-1483889950 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81.4fbb6b79-88a7-4775-b873-c912449f8277 is being set with open permissions: ugo+rw Nov 03 20:26:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e0536c6b-c4dd-490e-aa99-177951f12bd9 tempest-VolumesExtendTest-1483889950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81.4fbb6b79-88a7-4775-b873-c912449f8277 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:10 devstack sudo[98526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81.4fbb6b79-88a7-4775-b873-c912449f8277 Nov 03 20:26:10 devstack sudo[98526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:10 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-24840766-1847-47f8-9caf-121b9ffb58e5 tempest-VolumesSnapshotListTestJSON-1038731148 None] Acquiring lock "cinder-69e0df1a-2f6d-4906-994b-3f77cf715b47-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:10 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-24840766-1847-47f8-9caf-121b9ffb58e5 tempest-VolumesSnapshotListTestJSON-1038731148 None] Lock "cinder-69e0df1a-2f6d-4906-994b-3f77cf715b47-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:10 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-24840766-1847-47f8-9caf-121b9ffb58e5 tempest-VolumesSnapshotListTestJSON-1038731148 None] Acquiring lock "cinder-quobyte-69e0df1a-2f6d-4906-994b-3f77cf715b47" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:10 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-24840766-1847-47f8-9caf-121b9ffb58e5 tempest-VolumesSnapshotListTestJSON-1038731148 None] Lock "cinder-quobyte-69e0df1a-2f6d-4906-994b-3f77cf715b47" acquired by "delete_volume" :: waited 0.022s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:10 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffa4355-6867-4b28-b66a-e2f2aede2430]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-24840766-1847-47f8-9caf-121b9ffb58e5 tempest-VolumesSnapshotListTestJSON-1038731148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:10 devstack sudo[98521]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-14f4e0d1-b793-4c0c-9932-c92031514198 tempest-AttachVolumeTestJSON-1951495544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-dc7e0e9f-b845-4406-b203-01af3e2a7b80" returned: 0 in 0.445s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-14f4e0d1-b793-4c0c-9932-c92031514198 tempest-AttachVolumeTestJSON-1951495544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-dc7e0e9f-b845-4406-b203-01af3e2a7b80 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:10 devstack sudo[98528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47 Nov 03 20:26:10 devstack sudo[98528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:10 devstack sudo[98526]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e0536c6b-c4dd-490e-aa99-177951f12bd9 tempest-VolumesExtendTest-1483889950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81.4fbb6b79-88a7-4775-b873-c912449f8277" returned: 0 in 0.305s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:10 devstack sudo[98533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-dc7e0e9f-b845-4406-b203-01af3e2a7b80 Nov 03 20:26:10 devstack sudo[98533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e0536c6b-c4dd-490e-aa99-177951f12bd9 tempest-VolumesExtendTest-1483889950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:10 devstack sudo[98536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81.info Nov 03 20:26:10 devstack sudo[98536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:10 devstack sudo[98533]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-14f4e0d1-b793-4c0c-9932-c92031514198 tempest-AttachVolumeTestJSON-1951495544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-dc7e0e9f-b845-4406-b203-01af3e2a7b80" returned: 0 in 0.264s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:10 devstack sudo[98528]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-24840766-1847-47f8-9caf-121b9ffb58e5 tempest-VolumesSnapshotListTestJSON-1038731148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47" returned: 0 in 0.387s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-24840766-1847-47f8-9caf-121b9ffb58e5 tempest-VolumesSnapshotListTestJSON-1038731148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:10 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-14f4e0d1-b793-4c0c-9932-c92031514198 tempest-AttachVolumeTestJSON-1951495544 None] Lock "cinder-quobyte-dc7e0e9f-b845-4406-b203-01af3e2a7b80" released by "delete_volume" :: held 0.768s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:10 devstack sudo[98543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47 Nov 03 20:26:10 devstack sudo[98543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:10 devstack sudo[98536]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e0536c6b-c4dd-490e-aa99-177951f12bd9 tempest-VolumesExtendTest-1483889950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81.info" returned: 0 in 0.274s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:10 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-e0536c6b-c4dd-490e-aa99-177951f12bd9 tempest-VolumesExtendTest-1483889950 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81.info is being set with open permissions: ugo+rw Nov 03 20:26:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e0536c6b-c4dd-490e-aa99-177951f12bd9 tempest-VolumesExtendTest-1483889950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:10 devstack sudo[98545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81.info Nov 03 20:26:10 devstack sudo[98545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:10 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-14f4e0d1-b793-4c0c-9932-c92031514198 tempest-AttachVolumeTestJSON-1951495544 None] Created reservations ['79ff3639-6b4e-4ce8-8a06-225923cec6fe', '7d6cad60-f608-4006-90a6-a8d7fe985860', '940bf9fc-e9de-4702-accf-58184f0046f9', '28612b4f-567b-4f63-b2de-1de60efcaca9'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:26:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-14f4e0d1-b793-4c0c-9932-c92031514198 tempest-AttachVolumeTestJSON-1951495544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-14f4e0d1-b793-4c0c-9932-c92031514198 tempest-AttachVolumeTestJSON-1951495544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:10 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-14f4e0d1-b793-4c0c-9932-c92031514198 tempest-AttachVolumeTestJSON-1951495544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:26:10 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-14f4e0d1-b793-4c0c-9932-c92031514198 tempest-AttachVolumeTestJSON-1951495544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:26:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-14f4e0d1-b793-4c0c-9932-c92031514198 tempest-AttachVolumeTestJSON-1951495544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-14f4e0d1-b793-4c0c-9932-c92031514198 tempest-AttachVolumeTestJSON-1951495544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:10 devstack sudo[98547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:26:10 devstack sudo[98547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:11 devstack sudo[98543]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-24840766-1847-47f8-9caf-121b9ffb58e5 tempest-VolumesSnapshotListTestJSON-1038731148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-69e0df1a-2f6d-4906-994b-3f77cf715b47" returned: 0 in 0.268s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:11 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-24840766-1847-47f8-9caf-121b9ffb58e5 tempest-VolumesSnapshotListTestJSON-1038731148 None] Lock "cinder-quobyte-69e0df1a-2f6d-4906-994b-3f77cf715b47" released by "delete_volume" :: held 0.737s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:11 devstack sudo[98545]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e0536c6b-c4dd-490e-aa99-177951f12bd9 tempest-VolumesExtendTest-1483889950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81.info" returned: 0 in 0.275s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e0536c6b-c4dd-490e-aa99-177951f12bd9 tempest-VolumesExtendTest-1483889950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.207s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.680s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:11 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-803584951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f94a57ed-2eaf-441b-a0fb-a83f660d4225,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7ab0e227a82349bc909b7d4688755960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:26:07Z,use_quota=True,user_id='46e27afb1f9e4540be79dd576cbaaaeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:26:11 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Creating volume f94a57ed-2eaf-441b-a0fb-a83f660d4225 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:26:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:11 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:26:11 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:26:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:11 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:26:11 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:26:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f94a57ed-2eaf-441b-a0fb-a83f660d4225 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:11 devstack sudo[98551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f94a57ed-2eaf-441b-a0fb-a83f660d4225 1073741824 Nov 03 20:26:11 devstack sudo[98551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:11 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-e0536c6b-c4dd-490e-aa99-177951f12bd9 tempest-VolumesExtendTest-1483889950 None] Create snapshot completed successfully Nov 03 20:26:11 devstack sudo[98547]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-14f4e0d1-b793-4c0c-9932-c92031514198 tempest-AttachVolumeTestJSON-1951495544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.280s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:11 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-14f4e0d1-b793-4c0c-9932-c92031514198 tempest-AttachVolumeTestJSON-1951495544 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:26:11 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-24840766-1847-47f8-9caf-121b9ffb58e5 tempest-VolumesSnapshotListTestJSON-1038731148 None] Created reservations ['e3b8ec66-a1ee-44ef-bb58-75b6dadadae7', '13232312-f739-4b9b-aa4d-75e4e4177533', '220d2b05-1f66-4e92-a9bf-e071fce8f14c', '9fbb6952-17f3-4aec-8995-b13309b7bb57'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:26:11 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-14f4e0d1-b793-4c0c-9932-c92031514198 tempest-AttachVolumeTestJSON-1951495544 None] Deleted volume successfully. Nov 03 20:26:11 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-11484232-36cc-44a8-9f5d-626fa6cb36e4 tempest-AttachVolumeTestJSON-1951495544 None] Acquiring lock "cinder-2e48f714-0749-4cfc-9c06-c173ab5a97e3-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:11 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-14f4e0d1-b793-4c0c-9932-c92031514198 tempest-AttachVolumeTestJSON-1951495544 None] Lock "cinder-dc7e0e9f-b845-4406-b203-01af3e2a7b80-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:11 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-11484232-36cc-44a8-9f5d-626fa6cb36e4 tempest-AttachVolumeTestJSON-1951495544 None] Lock "cinder-2e48f714-0749-4cfc-9c06-c173ab5a97e3-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-24840766-1847-47f8-9caf-121b9ffb58e5 tempest-VolumesSnapshotListTestJSON-1038731148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-24840766-1847-47f8-9caf-121b9ffb58e5 tempest-VolumesSnapshotListTestJSON-1038731148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:11 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-24840766-1847-47f8-9caf-121b9ffb58e5 tempest-VolumesSnapshotListTestJSON-1038731148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:26:11 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-24840766-1847-47f8-9caf-121b9ffb58e5 tempest-VolumesSnapshotListTestJSON-1038731148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:26:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-24840766-1847-47f8-9caf-121b9ffb58e5 tempest-VolumesSnapshotListTestJSON-1038731148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-24840766-1847-47f8-9caf-121b9ffb58e5 tempest-VolumesSnapshotListTestJSON-1038731148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:11 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-11484232-36cc-44a8-9f5d-626fa6cb36e4 tempest-AttachVolumeTestJSON-1951495544 None] Acquiring lock "cinder-quobyte-2e48f714-0749-4cfc-9c06-c173ab5a97e3" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:11 devstack sudo[98554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:26:11 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-11484232-36cc-44a8-9f5d-626fa6cb36e4 tempest-AttachVolumeTestJSON-1951495544 None] Lock "cinder-quobyte-2e48f714-0749-4cfc-9c06-c173ab5a97e3" acquired by "delete_volume" :: waited 0.024s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:11 devstack sudo[98554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:11 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b758263-2dc0-4ff2-9e0c-0c07fa9229bc]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-11484232-36cc-44a8-9f5d-626fa6cb36e4 tempest-AttachVolumeTestJSON-1951495544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2e48f714-0749-4cfc-9c06-c173ab5a97e3 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:11 devstack sudo[98559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2e48f714-0749-4cfc-9c06-c173ab5a97e3 Nov 03 20:26:11 devstack sudo[98559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:11 devstack sudo[98554]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-24840766-1847-47f8-9caf-121b9ffb58e5 tempest-VolumesSnapshotListTestJSON-1038731148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.284s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:11 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-24840766-1847-47f8-9caf-121b9ffb58e5 tempest-VolumesSnapshotListTestJSON-1038731148 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:26:11 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-24840766-1847-47f8-9caf-121b9ffb58e5 tempest-VolumesSnapshotListTestJSON-1038731148 None] Deleted volume successfully. Nov 03 20:26:11 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-24840766-1847-47f8-9caf-121b9ffb58e5 tempest-VolumesSnapshotListTestJSON-1038731148 None] Lock "cinder-69e0df1a-2f6d-4906-994b-3f77cf715b47-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:11 devstack sudo[98551]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f94a57ed-2eaf-441b-a0fb-a83f660d4225 1073741824" returned: 0 in 0.570s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f94a57ed-2eaf-441b-a0fb-a83f660d4225 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:11 devstack sudo[98564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f94a57ed-2eaf-441b-a0fb-a83f660d4225 Nov 03 20:26:11 devstack sudo[98564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:11 devstack sudo[98559]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-11484232-36cc-44a8-9f5d-626fa6cb36e4 tempest-AttachVolumeTestJSON-1951495544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2e48f714-0749-4cfc-9c06-c173ab5a97e3" returned: 0 in 0.486s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-11484232-36cc-44a8-9f5d-626fa6cb36e4 tempest-AttachVolumeTestJSON-1951495544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2e48f714-0749-4cfc-9c06-c173ab5a97e3 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:11 devstack sudo[98569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2e48f714-0749-4cfc-9c06-c173ab5a97e3 Nov 03 20:26:11 devstack sudo[98569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:12 devstack sudo[98564]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f94a57ed-2eaf-441b-a0fb-a83f660d4225" returned: 0 in 0.322s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:12 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:26:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:12 devstack cinder-volume[87248]: DEBUG cinder.volume.volume_utils [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Attempting download of 346de059-5b9a-438e-a6dd-24e9fc9a1ee3 ((None, [{'url': 'file:///opt/stack/data/glance/images/346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'metadata': {}}])) to volume f94a57ed-2eaf-441b-a0fb-a83f660d4225. {{(pid=87248) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 20:26:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1b6c4318-c4e3-4255-b4ee-455a77cb6635 tempest-VolumesExtendTest-1483889950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1b6c4318-c4e3-4255-b4ee-455a77cb6635 tempest-VolumesExtendTest-1483889950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:12 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f16bcb0-4247-4d91-839c-c95e7a878c70]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1b6c4318-c4e3-4255-b4ee-455a77cb6635 tempest-VolumesExtendTest-1483889950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:12 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[929adb90-f68d-47d8-b2fe-fb8f209e9912]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_j4ykq803 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:12 devstack sudo[98569]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-11484232-36cc-44a8-9f5d-626fa6cb36e4 tempest-AttachVolumeTestJSON-1951495544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2e48f714-0749-4cfc-9c06-c173ab5a97e3" returned: 0 in 0.426s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:12 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-11484232-36cc-44a8-9f5d-626fa6cb36e4 tempest-AttachVolumeTestJSON-1951495544 None] Lock "cinder-quobyte-2e48f714-0749-4cfc-9c06-c173ab5a97e3" released by "delete_volume" :: held 0.976s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:12 devstack sudo[98574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81 Nov 03 20:26:12 devstack sudo[98574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:12 devstack sudo[98575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_j4ykq803 Nov 03 20:26:12 devstack sudo[98575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:12 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-11484232-36cc-44a8-9f5d-626fa6cb36e4 tempest-AttachVolumeTestJSON-1951495544 None] Created reservations ['537ad4e0-4ea2-4654-8a94-32d48243c029', '79c18cd4-e4a3-409d-8309-b01a3a44dd9d', 'f86dae42-5714-4119-b444-a4e1794f8ac9', '3eaef93a-9359-41b3-a471-f173037570ea'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:26:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-11484232-36cc-44a8-9f5d-626fa6cb36e4 tempest-AttachVolumeTestJSON-1951495544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-11484232-36cc-44a8-9f5d-626fa6cb36e4 tempest-AttachVolumeTestJSON-1951495544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:12 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-11484232-36cc-44a8-9f5d-626fa6cb36e4 tempest-AttachVolumeTestJSON-1951495544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:26:12 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-11484232-36cc-44a8-9f5d-626fa6cb36e4 tempest-AttachVolumeTestJSON-1951495544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:26:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-11484232-36cc-44a8-9f5d-626fa6cb36e4 tempest-AttachVolumeTestJSON-1951495544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-11484232-36cc-44a8-9f5d-626fa6cb36e4 tempest-AttachVolumeTestJSON-1951495544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:12 devstack sudo[98578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:26:12 devstack sudo[98578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:12 devstack sudo[98575]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_j4ykq803" returned: 0 in 0.425s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_j4ykq803 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:12 devstack sudo[98574]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1b6c4318-c4e3-4255-b4ee-455a77cb6635 tempest-VolumesExtendTest-1483889950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81" returned: 0 in 0.547s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1b6c4318-c4e3-4255-b4ee-455a77cb6635 tempest-VolumesExtendTest-1483889950 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81.4fbb6b79-88a7-4775-b873-c912449f8277 2G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:12 devstack sudo[98585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_j4ykq803 Nov 03 20:26:12 devstack sudo[98585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:12 devstack sudo[98578]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-11484232-36cc-44a8-9f5d-626fa6cb36e4 tempest-AttachVolumeTestJSON-1951495544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.335s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:12 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-11484232-36cc-44a8-9f5d-626fa6cb36e4 tempest-AttachVolumeTestJSON-1951495544 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:26:12 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-11484232-36cc-44a8-9f5d-626fa6cb36e4 tempest-AttachVolumeTestJSON-1951495544 None] Deleted volume successfully. Nov 03 20:26:12 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-11484232-36cc-44a8-9f5d-626fa6cb36e4 tempest-AttachVolumeTestJSON-1951495544 None] Lock "cinder-2e48f714-0749-4cfc-9c06-c173ab5a97e3-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1b6c4318-c4e3-4255-b4ee-455a77cb6635 tempest-VolumesExtendTest-1483889950 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81.4fbb6b79-88a7-4775-b873-c912449f8277 2G" returned: 0 in 0.187s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1b6c4318-c4e3-4255-b4ee-455a77cb6635 tempest-VolumesExtendTest-1483889950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.793s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:12 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-1b6c4318-c4e3-4255-b4ee-455a77cb6635 tempest-VolumesExtendTest-1483889950 None] Extend volume completed successfully. Nov 03 20:26:13 devstack sudo[98585]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_j4ykq803" returned: 1 in 0.434s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_j4ykq803' failed. Not Retrying. {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 20:26:13 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53940cc-d93c-4685-bf83-320d72960c02]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_hvb55pq4devstack@QuobyteHD {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:13 devstack sudo[98593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_hvb55pq4devstack@QuobyteHD Nov 03 20:26:13 devstack sudo[98593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:13 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-118810e6-7b16-41b1-91f0-e2a32ce12c0e tempest-VolumesExtendTest-1483889950 None] Acquiring lock "cinder-4fbb6b79-88a7-4775-b873-c912449f8277-delete_snapshot" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:13 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-118810e6-7b16-41b1-91f0-e2a32ce12c0e tempest-VolumesExtendTest-1483889950 None] Lock "cinder-4fbb6b79-88a7-4775-b873-c912449f8277-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:13 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-118810e6-7b16-41b1-91f0-e2a32ce12c0e tempest-VolumesExtendTest-1483889950 None] Acquiring lock "cinder-quobyte-ddc8823c-5291-45bc-aacb-a54e9f367a81" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:13 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-118810e6-7b16-41b1-91f0-e2a32ce12c0e tempest-VolumesExtendTest-1483889950 None] Lock "cinder-quobyte-ddc8823c-5291-45bc-aacb-a54e9f367a81" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:13 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-118810e6-7b16-41b1-91f0-e2a32ce12c0e tempest-VolumesExtendTest-1483889950 None] Acquiring lock "cinder-quobyte-4fbb6b79-88a7-4775-b873-c912449f8277" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:13 devstack sudo[98593]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_hvb55pq4devstack@QuobyteHD" returned: 0 in 0.421s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:13 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] 346de059-5b9a-438e-a6dd-24e9fc9a1ee3 was qcow2, converting to qcow2 {{(pid=87248) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 20:26:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_hvb55pq4devstack@QuobyteHD /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f94a57ed-2eaf-441b-a0fb-a83f660d4225 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:13 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-118810e6-7b16-41b1-91f0-e2a32ce12c0e tempest-VolumesExtendTest-1483889950 None] Lock "cinder-quobyte-4fbb6b79-88a7-4775-b873-c912449f8277" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:13 devstack sudo[98599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_hvb55pq4devstack@QuobyteHD /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f94a57ed-2eaf-441b-a0fb-a83f660d4225 Nov 03 20:26:13 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:13 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-118810e6-7b16-41b1-91f0-e2a32ce12c0e tempest-VolumesExtendTest-1483889950 None] Deleting offline snapshot 4fbb6b79-88a7-4775-b873-c912449f8277 of volume ddc8823c-5291-45bc-aacb-a54e9f367a81 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:26:13 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-118810e6-7b16-41b1-91f0-e2a32ce12c0e tempest-VolumesExtendTest-1483889950 None] snapshot_file for this snap is: volume-ddc8823c-5291-45bc-aacb-a54e9f367a81.4fbb6b79-88a7-4775-b873-c912449f8277 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:26:13 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[4170e50c-2dab-4bf3-8a03-cf665af4b017]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-118810e6-7b16-41b1-91f0-e2a32ce12c0e tempest-VolumesExtendTest-1483889950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81.4fbb6b79-88a7-4775-b873-c912449f8277 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:13 devstack sudo[98601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81.4fbb6b79-88a7-4775-b873-c912449f8277 Nov 03 20:26:13 devstack sudo[98601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:14 devstack sudo[98601]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-118810e6-7b16-41b1-91f0-e2a32ce12c0e tempest-VolumesExtendTest-1483889950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81.4fbb6b79-88a7-4775-b873-c912449f8277" returned: 0 in 0.503s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:14 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-118810e6-7b16-41b1-91f0-e2a32ce12c0e tempest-VolumesExtendTest-1483889950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ddc8823c-5291-45bc-aacb-a54e9f367a81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:26:14 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[79899da5-dd16-4889-bff5-112e83eff615]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-118810e6-7b16-41b1-91f0-e2a32ce12c0e tempest-VolumesExtendTest-1483889950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:14 devstack sudo[98611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81 Nov 03 20:26:14 devstack sudo[98611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:14 devstack sudo[98611]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-118810e6-7b16-41b1-91f0-e2a32ce12c0e tempest-VolumesExtendTest-1483889950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81" returned: 0 in 0.529s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-118810e6-7b16-41b1-91f0-e2a32ce12c0e tempest-VolumesExtendTest-1483889950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81.4fbb6b79-88a7-4775-b873-c912449f8277 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:14 devstack sudo[98616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81.4fbb6b79-88a7-4775-b873-c912449f8277 Nov 03 20:26:14 devstack sudo[98616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:15 devstack sudo[98616]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-118810e6-7b16-41b1-91f0-e2a32ce12c0e tempest-VolumesExtendTest-1483889950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81.4fbb6b79-88a7-4775-b873-c912449f8277" returned: 0 in 0.543s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-118810e6-7b16-41b1-91f0-e2a32ce12c0e tempest-VolumesExtendTest-1483889950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81.4fbb6b79-88a7-4775-b873-c912449f8277 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:15 devstack sudo[98624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81.4fbb6b79-88a7-4775-b873-c912449f8277 Nov 03 20:26:15 devstack sudo[98624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:15 devstack sudo[98624]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-118810e6-7b16-41b1-91f0-e2a32ce12c0e tempest-VolumesExtendTest-1483889950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81.4fbb6b79-88a7-4775-b873-c912449f8277" returned: 0 in 0.419s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:15 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-118810e6-7b16-41b1-91f0-e2a32ce12c0e tempest-VolumesExtendTest-1483889950 None] Lock "cinder-quobyte-4fbb6b79-88a7-4775-b873-c912449f8277" released by "_delete_snapshot" :: held 2.174s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:15 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-118810e6-7b16-41b1-91f0-e2a32ce12c0e tempest-VolumesExtendTest-1483889950 None] Lock "cinder-quobyte-ddc8823c-5291-45bc-aacb-a54e9f367a81" released by "delete_snapshot" :: held 2.235s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:15 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-118810e6-7b16-41b1-91f0-e2a32ce12c0e tempest-VolumesExtendTest-1483889950 None] Created reservations ['845479e2-d5e5-4d03-a145-be22902ed874', '0dbf088c-8990-47aa-9f5d-8812aa3f081e', '979d98dc-5233-428a-a4e1-c3909822c347', 'c0afb5d1-a667-46b4-938c-673c81917d3b'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:26:15 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-118810e6-7b16-41b1-91f0-e2a32ce12c0e tempest-VolumesExtendTest-1483889950 None] Delete snapshot completed successfully. Nov 03 20:26:15 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-118810e6-7b16-41b1-91f0-e2a32ce12c0e tempest-VolumesExtendTest-1483889950 None] Lock "cinder-4fbb6b79-88a7-4775-b873-c912449f8277-delete_snapshot" released by "delete_snapshot" :: held 2.429s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:15 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_hvb55pq4devstack@QuobyteHD /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f94a57ed-2eaf-441b-a0fb-a83f660d4225" returned: 0 in 2.420s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:15 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_hvb55pq4devstack@QuobyteHD, size 112.00 MB, duration 2.42 sec, destination /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f94a57ed-2eaf-441b-a0fb-a83f660d4225 {{(pid=87248) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:26:15 devstack cinder-volume[87248]: INFO cinder.image.image_utils [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Converted 112.00 MB image at 46.26 MB/s Nov 03 20:26:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f94a57ed-2eaf-441b-a0fb-a83f660d4225 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:15 devstack sudo[98629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f94a57ed-2eaf-441b-a0fb-a83f660d4225 1G Nov 03 20:26:15 devstack sudo[98629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:16 devstack sudo[98629]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f94a57ed-2eaf-441b-a0fb-a83f660d4225 1G" returned: 0 in 0.410s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:16 devstack cinder-volume[87248]: DEBUG cinder.volume.volume_utils [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Downloaded image 346de059-5b9a-438e-a6dd-24e9fc9a1ee3 ((None, [{'url': 'file:///opt/stack/data/glance/images/346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'metadata': {}}])) to volume f94a57ed-2eaf-441b-a0fb-a83f660d4225 successfully. {{(pid=87248) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 20:26:16 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Temporary image 346de059-5b9a-438e-a6dd-24e9fc9a1ee3 for user 46e27afb1f9e4540be79dd576cbaaaeb is deleted. {{(pid=87248) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 20:26:16 devstack cinder-volume[87248]: DEBUG cinder.volume.volume_utils [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Marking volume f94a57ed-2eaf-441b-a0fb-a83f660d4225 as bootable. {{(pid=87248) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 20:26:16 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-d32bbf7b-a2b6-4a2f-9d38-2123c01b9d2c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:26:16 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d32bbf7b-a2b6-4a2f-9d38-2123c01b9d2c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Flow 'volume_create_manager' (bafb75ad-cfa7-4135-aeb3-088d8f96b26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:26:16 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d32bbf7b-a2b6-4a2f-9d38-2123c01b9d2c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd92333e-9228-4d19-aa5f-4551eb6f6f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:16 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Copying metadata from image 346de059-5b9a-438e-a6dd-24e9fc9a1ee3 to f94a57ed-2eaf-441b-a0fb-a83f660d4225. {{(pid=87248) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 20:26:16 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Creating volume glance metadata for volume f94a57ed-2eaf-441b-a0fb-a83f660d4225 backed by image 346de059-5b9a-438e-a6dd-24e9fc9a1ee3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87248) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 20:26:16 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d32bbf7b-a2b6-4a2f-9d38-2123c01b9d2c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd92333e-9228-4d19-aa5f-4551eb6f6f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1627672700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e0ad059-25c4-48fd-b39a-c64f3d764ec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f8adbe044f44ca190d972e7777165dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:26:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:26:16Z,use_quota=True,user_id='015a18b8e7a54eb4859e05e997d460c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:16 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d32bbf7b-a2b6-4a2f-9d38-2123c01b9d2c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cb3a836-75bb-4b80-9f75-0992730cb679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:16 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d32bbf7b-a2b6-4a2f-9d38-2123c01b9d2c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cb3a836-75bb-4b80-9f75-0992730cb679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:16 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d32bbf7b-a2b6-4a2f-9d38-2123c01b9d2c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8a30b6f-1da1-4eaf-a502-adfad237c653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:16 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d32bbf7b-a2b6-4a2f-9d38-2123c01b9d2c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8a30b6f-1da1-4eaf-a502-adfad237c653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e0ad059-25c4-48fd-b39a-c64f3d764ec5', 'volume_name': 'volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5', 'volume_size': 2}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:16 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d32bbf7b-a2b6-4a2f-9d38-2123c01b9d2c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9e361a2-d96f-4b87-bd4f-519731624b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:16 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d32bbf7b-a2b6-4a2f-9d38-2123c01b9d2c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9e361a2-d96f-4b87-bd4f-519731624b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:16 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d32bbf7b-a2b6-4a2f-9d38-2123c01b9d2c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5441286-8290-434a-aef7-0bd3fe34ab26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:16 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-d32bbf7b-a2b6-4a2f-9d38-2123c01b9d2c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Volume 8e0ad059-25c4-48fd-b39a-c64f3d764ec5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5', 'volume_size': 2} Nov 03 20:26:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d32bbf7b-a2b6-4a2f-9d38-2123c01b9d2c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d32bbf7b-a2b6-4a2f-9d38-2123c01b9d2c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:16 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-d32bbf7b-a2b6-4a2f-9d38-2123c01b9d2c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1627672700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e0ad059-25c4-48fd-b39a-c64f3d764ec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f8adbe044f44ca190d972e7777165dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:26:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:26:16Z,use_quota=True,user_id='015a18b8e7a54eb4859e05e997d460c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:26:16 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-d32bbf7b-a2b6-4a2f-9d38-2123c01b9d2c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Creating volume 8e0ad059-25c4-48fd-b39a-c64f3d764ec5 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:26:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d32bbf7b-a2b6-4a2f-9d38-2123c01b9d2c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d32bbf7b-a2b6-4a2f-9d38-2123c01b9d2c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:16 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-d32bbf7b-a2b6-4a2f-9d38-2123c01b9d2c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:26:16 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-d32bbf7b-a2b6-4a2f-9d38-2123c01b9d2c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:26:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d32bbf7b-a2b6-4a2f-9d38-2123c01b9d2c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:16 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-d32bbf7b-a2b6-4a2f-9d38-2123c01b9d2c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:26:16 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-d32bbf7b-a2b6-4a2f-9d38-2123c01b9d2c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:26:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d32bbf7b-a2b6-4a2f-9d38-2123c01b9d2c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5 2147483648 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:16 devstack sudo[98635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5 2147483648 Nov 03 20:26:16 devstack sudo[98635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:16 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4b643ef-a3fb-4772-a2c6-88c0b2d3879f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f94a57ed-2eaf-441b-a0fb-a83f660d4225', 'volume_size': 1, 'image_id': '346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a647f64245a54dad95167f6d04c75eaa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'created_at': datetime.datetime(2026, 11, 3, 19, 11, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 11, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/346de059-5b9a-438e-a6dd-24e9fc9a1ee3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:16 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f3e6da8-134a-464c-8806-bcf91a668049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:16 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Volume volume-f94a57ed-2eaf-441b-a0fb-a83f660d4225 (f94a57ed-2eaf-441b-a0fb-a83f660d4225): created successfully Nov 03 20:26:16 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f3e6da8-134a-464c-8806-bcf91a668049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:16 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Flow 'volume_create_manager' (cc6544b8-fa3a-4f12-908e-373a4c3f89a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:26:16 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-e514ff23-3af5-4ffc-b0eb-4b281fe57999 tempest-VolumesGetTest-644387191 None] Created volume successfully. Nov 03 20:26:16 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d01d239e-3efd-40c2-8bec-5261658a53ae tempest-VolumesExtendTest-1483889950 None] Acquiring lock "cinder-ddc8823c-5291-45bc-aacb-a54e9f367a81-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:16 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d01d239e-3efd-40c2-8bec-5261658a53ae tempest-VolumesExtendTest-1483889950 None] Lock "cinder-ddc8823c-5291-45bc-aacb-a54e9f367a81-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:16 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d01d239e-3efd-40c2-8bec-5261658a53ae tempest-VolumesExtendTest-1483889950 None] Acquiring lock "cinder-quobyte-ddc8823c-5291-45bc-aacb-a54e9f367a81" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:16 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d01d239e-3efd-40c2-8bec-5261658a53ae tempest-VolumesExtendTest-1483889950 None] Lock "cinder-quobyte-ddc8823c-5291-45bc-aacb-a54e9f367a81" acquired by "delete_volume" :: waited 0.016s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:16 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1bdb93-0b26-4c70-9bbc-3a8b0c54154d]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d01d239e-3efd-40c2-8bec-5261658a53ae tempest-VolumesExtendTest-1483889950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:17 devstack sudo[98641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81 Nov 03 20:26:17 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:17 devstack sudo[98635]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d32bbf7b-a2b6-4a2f-9d38-2123c01b9d2c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5 2147483648" returned: 0 in 0.603s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d32bbf7b-a2b6-4a2f-9d38-2123c01b9d2c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:17 devstack sudo[98643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5 Nov 03 20:26:17 devstack sudo[98643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:17 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d01d239e-3efd-40c2-8bec-5261658a53ae tempest-VolumesExtendTest-1483889950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81" returned: 0 in 0.455s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d01d239e-3efd-40c2-8bec-5261658a53ae tempest-VolumesExtendTest-1483889950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:17 devstack sudo[98649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81 Nov 03 20:26:17 devstack sudo[98649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:17 devstack sudo[98643]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d32bbf7b-a2b6-4a2f-9d38-2123c01b9d2c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5" returned: 0 in 0.292s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:17 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-d32bbf7b-a2b6-4a2f-9d38-2123c01b9d2c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:26:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d32bbf7b-a2b6-4a2f-9d38-2123c01b9d2c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:17 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d32bbf7b-a2b6-4a2f-9d38-2123c01b9d2c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5441286-8290-434a-aef7-0bd3fe34ab26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5', 'volume_size': 2}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:17 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d32bbf7b-a2b6-4a2f-9d38-2123c01b9d2c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b881e11-53fd-44d2-96ab-7015d5f4b8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:17 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-d32bbf7b-a2b6-4a2f-9d38-2123c01b9d2c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Volume volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5 (8e0ad059-25c4-48fd-b39a-c64f3d764ec5): created successfully Nov 03 20:26:17 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d32bbf7b-a2b6-4a2f-9d38-2123c01b9d2c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b881e11-53fd-44d2-96ab-7015d5f4b8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:17 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d32bbf7b-a2b6-4a2f-9d38-2123c01b9d2c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Flow 'volume_create_manager' (bafb75ad-cfa7-4135-aeb3-088d8f96b26a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:26:17 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-d32bbf7b-a2b6-4a2f-9d38-2123c01b9d2c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Created volume successfully. Nov 03 20:26:17 devstack sudo[98649]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d01d239e-3efd-40c2-8bec-5261658a53ae tempest-VolumesExtendTest-1483889950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ddc8823c-5291-45bc-aacb-a54e9f367a81" returned: 0 in 0.282s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:17 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d01d239e-3efd-40c2-8bec-5261658a53ae tempest-VolumesExtendTest-1483889950 None] Lock "cinder-quobyte-ddc8823c-5291-45bc-aacb-a54e9f367a81" released by "delete_volume" :: held 0.825s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:17 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-d01d239e-3efd-40c2-8bec-5261658a53ae tempest-VolumesExtendTest-1483889950 None] Created reservations ['f9a8c0dc-5572-4648-8b58-5f769b95e0e0', 'b0a50366-3d51-4c2a-a197-10634533313c', '8fc82861-fc0f-4e98-b3ff-93c6004ca9f4', '77efc594-c689-472a-a95a-57c2d7ef9a1c'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:26:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d01d239e-3efd-40c2-8bec-5261658a53ae tempest-VolumesExtendTest-1483889950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d01d239e-3efd-40c2-8bec-5261658a53ae tempest-VolumesExtendTest-1483889950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:17 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-d01d239e-3efd-40c2-8bec-5261658a53ae tempest-VolumesExtendTest-1483889950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:26:17 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-d01d239e-3efd-40c2-8bec-5261658a53ae tempest-VolumesExtendTest-1483889950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:26:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d01d239e-3efd-40c2-8bec-5261658a53ae tempest-VolumesExtendTest-1483889950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d01d239e-3efd-40c2-8bec-5261658a53ae tempest-VolumesExtendTest-1483889950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:17 devstack sudo[98652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:26:17 devstack sudo[98652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:17 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-f167c7ed-3ad8-46ee-b5ff-495847a6994d tempest-VolumesGetTest-644387191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:26:18 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f167c7ed-3ad8-46ee-b5ff-495847a6994d tempest-VolumesGetTest-644387191 None] Flow 'volume_create_manager' (69b1c9f6-acd1-4822-894c-5fd507975d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:26:18 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f167c7ed-3ad8-46ee-b5ff-495847a6994d tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79581051-1d32-4f2a-975c-5954003d2f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:18 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f167c7ed-3ad8-46ee-b5ff-495847a6994d tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79581051-1d32-4f2a-975c-5954003d2f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:26:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1621044858',display_name='tempest-VolumesGetTest-Volume-129209691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b24c620-f2c6-4df2-afc6-41ad79cc5308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ab0e227a82349bc909b7d4688755960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:26:18Z,use_quota=True,user_id='46e27afb1f9e4540be79dd576cbaaaeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:18 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f167c7ed-3ad8-46ee-b5ff-495847a6994d tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61d7586b-cae8-416b-a3ac-21689c608684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:18 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f167c7ed-3ad8-46ee-b5ff-495847a6994d tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61d7586b-cae8-416b-a3ac-21689c608684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:18 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f167c7ed-3ad8-46ee-b5ff-495847a6994d tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f1b013f-379d-4838-a275-d7cd8eab27c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:18 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f167c7ed-3ad8-46ee-b5ff-495847a6994d tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f1b013f-379d-4838-a275-d7cd8eab27c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b24c620-f2c6-4df2-afc6-41ad79cc5308', 'volume_name': 'volume-5b24c620-f2c6-4df2-afc6-41ad79cc5308', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:18 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f167c7ed-3ad8-46ee-b5ff-495847a6994d tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5eca799-7fa9-41cf-936c-e63a92277bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:18 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f167c7ed-3ad8-46ee-b5ff-495847a6994d tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5eca799-7fa9-41cf-936c-e63a92277bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:18 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f167c7ed-3ad8-46ee-b5ff-495847a6994d tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5ea70e-5ba8-40e3-93b5-6d081a33b9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:18 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-f167c7ed-3ad8-46ee-b5ff-495847a6994d tempest-VolumesGetTest-644387191 None] Volume 5b24c620-f2c6-4df2-afc6-41ad79cc5308: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b24c620-f2c6-4df2-afc6-41ad79cc5308', 'volume_size': 1} Nov 03 20:26:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f167c7ed-3ad8-46ee-b5ff-495847a6994d tempest-VolumesGetTest-644387191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f167c7ed-3ad8-46ee-b5ff-495847a6994d tempest-VolumesGetTest-644387191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:18 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-f167c7ed-3ad8-46ee-b5ff-495847a6994d tempest-VolumesGetTest-644387191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:26:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1621044858',display_name='tempest-VolumesGetTest-Volume-129209691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b24c620-f2c6-4df2-afc6-41ad79cc5308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ab0e227a82349bc909b7d4688755960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:26:18Z,use_quota=True,user_id='46e27afb1f9e4540be79dd576cbaaaeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:26:18 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-f167c7ed-3ad8-46ee-b5ff-495847a6994d tempest-VolumesGetTest-644387191 None] Creating volume 5b24c620-f2c6-4df2-afc6-41ad79cc5308 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:26:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f167c7ed-3ad8-46ee-b5ff-495847a6994d tempest-VolumesGetTest-644387191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f167c7ed-3ad8-46ee-b5ff-495847a6994d tempest-VolumesGetTest-644387191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:18 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-f167c7ed-3ad8-46ee-b5ff-495847a6994d tempest-VolumesGetTest-644387191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:26:18 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-f167c7ed-3ad8-46ee-b5ff-495847a6994d tempest-VolumesGetTest-644387191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:26:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f167c7ed-3ad8-46ee-b5ff-495847a6994d tempest-VolumesGetTest-644387191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:18 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-f167c7ed-3ad8-46ee-b5ff-495847a6994d tempest-VolumesGetTest-644387191 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:26:18 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-f167c7ed-3ad8-46ee-b5ff-495847a6994d tempest-VolumesGetTest-644387191 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:26:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f167c7ed-3ad8-46ee-b5ff-495847a6994d tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5b24c620-f2c6-4df2-afc6-41ad79cc5308 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:18 devstack sudo[98654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5b24c620-f2c6-4df2-afc6-41ad79cc5308 1073741824 Nov 03 20:26:18 devstack sudo[98654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:18 devstack sudo[98652]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d01d239e-3efd-40c2-8bec-5261658a53ae tempest-VolumesExtendTest-1483889950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.363s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:18 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-d01d239e-3efd-40c2-8bec-5261658a53ae tempest-VolumesExtendTest-1483889950 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:26:18 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-d01d239e-3efd-40c2-8bec-5261658a53ae tempest-VolumesExtendTest-1483889950 None] Deleted volume successfully. Nov 03 20:26:18 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d01d239e-3efd-40c2-8bec-5261658a53ae tempest-VolumesExtendTest-1483889950 None] Lock "cinder-ddc8823c-5291-45bc-aacb-a54e9f367a81-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d51b8345-eb21-48cc-aae7-9df62b861d1a tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:18 devstack sudo[98654]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f167c7ed-3ad8-46ee-b5ff-495847a6994d tempest-VolumesGetTest-644387191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5b24c620-f2c6-4df2-afc6-41ad79cc5308 1073741824" returned: 0 in 0.638s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f167c7ed-3ad8-46ee-b5ff-495847a6994d tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5b24c620-f2c6-4df2-afc6-41ad79cc5308 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:18 devstack sudo[98661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5b24c620-f2c6-4df2-afc6-41ad79cc5308 Nov 03 20:26:18 devstack sudo[98661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:19 devstack sudo[98661]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f167c7ed-3ad8-46ee-b5ff-495847a6994d tempest-VolumesGetTest-644387191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5b24c620-f2c6-4df2-afc6-41ad79cc5308" returned: 0 in 0.339s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:19 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-f167c7ed-3ad8-46ee-b5ff-495847a6994d tempest-VolumesGetTest-644387191 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:26:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f167c7ed-3ad8-46ee-b5ff-495847a6994d tempest-VolumesGetTest-644387191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d51b8345-eb21-48cc-aae7-9df62b861d1a tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.468s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:19 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f167c7ed-3ad8-46ee-b5ff-495847a6994d tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5ea70e-5ba8-40e3-93b5-6d081a33b9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b24c620-f2c6-4df2-afc6-41ad79cc5308', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:19 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f167c7ed-3ad8-46ee-b5ff-495847a6994d tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49e1c7ba-50d3-4395-abd7-8486540edd70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:19 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-d51b8345-eb21-48cc-aae7-9df62b861d1a tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Creating offline snapshot d9d9268b-42d7-4536-ad55-0ba46ba6f858 of volume 8e0ad059-25c4-48fd-b39a-c64f3d764ec5 {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:26:19 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-f167c7ed-3ad8-46ee-b5ff-495847a6994d tempest-VolumesGetTest-644387191 None] Volume volume-5b24c620-f2c6-4df2-afc6-41ad79cc5308 (5b24c620-f2c6-4df2-afc6-41ad79cc5308): created successfully Nov 03 20:26:19 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f167c7ed-3ad8-46ee-b5ff-495847a6994d tempest-VolumesGetTest-644387191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49e1c7ba-50d3-4395-abd7-8486540edd70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:19 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f167c7ed-3ad8-46ee-b5ff-495847a6994d tempest-VolumesGetTest-644387191 None] Flow 'volume_create_manager' (69b1c9f6-acd1-4822-894c-5fd507975d71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:26:19 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0473b7a-733f-43a9-b344-4a1e70427549]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d51b8345-eb21-48cc-aae7-9df62b861d1a tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:19 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-f167c7ed-3ad8-46ee-b5ff-495847a6994d tempest-VolumesGetTest-644387191 None] Created volume successfully. Nov 03 20:26:19 devstack sudo[98665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5 Nov 03 20:26:19 devstack sudo[98665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:19 devstack sudo[98665]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d51b8345-eb21-48cc-aae7-9df62b861d1a tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5" returned: 0 in 0.445s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d51b8345-eb21-48cc-aae7-9df62b861d1a tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5.d9d9268b-42d7-4536-ad55-0ba46ba6f858 2G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:19 devstack sudo[98670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5.d9d9268b-42d7-4536-ad55-0ba46ba6f858 2G Nov 03 20:26:19 devstack sudo[98670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:20 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-f3925daf-9126-4e51-82cf-0cb2d2215e88 tempest-VolumesGetTest-644387191 None] Acquiring lock "cinder-5b24c620-f2c6-4df2-afc6-41ad79cc5308-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:20 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-f3925daf-9126-4e51-82cf-0cb2d2215e88 tempest-VolumesGetTest-644387191 None] Lock "cinder-5b24c620-f2c6-4df2-afc6-41ad79cc5308-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:20 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-f3925daf-9126-4e51-82cf-0cb2d2215e88 tempest-VolumesGetTest-644387191 None] Acquiring lock "cinder-quobyte-5b24c620-f2c6-4df2-afc6-41ad79cc5308" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:20 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-f3925daf-9126-4e51-82cf-0cb2d2215e88 tempest-VolumesGetTest-644387191 None] Lock "cinder-quobyte-5b24c620-f2c6-4df2-afc6-41ad79cc5308" acquired by "delete_volume" :: waited 0.020s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:20 devstack sudo[98670]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d51b8345-eb21-48cc-aae7-9df62b861d1a tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5.d9d9268b-42d7-4536-ad55-0ba46ba6f858 2G" returned: 0 in 0.632s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d51b8345-eb21-48cc-aae7-9df62b861d1a tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5.d9d9268b-42d7-4536-ad55-0ba46ba6f858 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:20 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[781b62a5-1c86-4221-a8a7-7115ee02666f]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f3925daf-9126-4e51-82cf-0cb2d2215e88 tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5b24c620-f2c6-4df2-afc6-41ad79cc5308 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:20 devstack sudo[98676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5.d9d9268b-42d7-4536-ad55-0ba46ba6f858 Nov 03 20:26:20 devstack sudo[98676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:20 devstack sudo[98677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5b24c620-f2c6-4df2-afc6-41ad79cc5308 Nov 03 20:26:20 devstack sudo[98677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:20 devstack sudo[98676]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d51b8345-eb21-48cc-aae7-9df62b861d1a tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5.d9d9268b-42d7-4536-ad55-0ba46ba6f858" returned: 0 in 0.350s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:20 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-d51b8345-eb21-48cc-aae7-9df62b861d1a tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5.d9d9268b-42d7-4536-ad55-0ba46ba6f858 is being set with open permissions: ugo+rw Nov 03 20:26:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d51b8345-eb21-48cc-aae7-9df62b861d1a tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5.d9d9268b-42d7-4536-ad55-0ba46ba6f858 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:20 devstack sudo[98690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5.d9d9268b-42d7-4536-ad55-0ba46ba6f858 Nov 03 20:26:20 devstack sudo[98690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:20 devstack sudo[98677]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f3925daf-9126-4e51-82cf-0cb2d2215e88 tempest-VolumesGetTest-644387191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5b24c620-f2c6-4df2-afc6-41ad79cc5308" returned: 0 in 0.440s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f3925daf-9126-4e51-82cf-0cb2d2215e88 tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5b24c620-f2c6-4df2-afc6-41ad79cc5308 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:20 devstack sudo[98694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5b24c620-f2c6-4df2-afc6-41ad79cc5308 Nov 03 20:26:20 devstack sudo[98694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:20 devstack sudo[98690]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d51b8345-eb21-48cc-aae7-9df62b861d1a tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5.d9d9268b-42d7-4536-ad55-0ba46ba6f858" returned: 0 in 0.286s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d51b8345-eb21-48cc-aae7-9df62b861d1a tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:21 devstack sudo[98698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5.info Nov 03 20:26:21 devstack sudo[98698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:21 devstack sudo[98694]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f3925daf-9126-4e51-82cf-0cb2d2215e88 tempest-VolumesGetTest-644387191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5b24c620-f2c6-4df2-afc6-41ad79cc5308" returned: 0 in 0.277s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:21 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-f3925daf-9126-4e51-82cf-0cb2d2215e88 tempest-VolumesGetTest-644387191 None] Lock "cinder-quobyte-5b24c620-f2c6-4df2-afc6-41ad79cc5308" released by "delete_volume" :: held 0.792s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:21 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-f3925daf-9126-4e51-82cf-0cb2d2215e88 tempest-VolumesGetTest-644387191 None] Created reservations ['e9b8d140-c6dc-4f9b-a1c2-3344e99577da', 'eee9df22-20c7-4aea-a9fb-40ea4f33052f', '490c9e2c-e4ee-4f5d-ba63-6ae44fb40f9e', 'af861973-1a2f-4dbe-963e-3dba835dcaab'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:26:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f3925daf-9126-4e51-82cf-0cb2d2215e88 tempest-VolumesGetTest-644387191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f3925daf-9126-4e51-82cf-0cb2d2215e88 tempest-VolumesGetTest-644387191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-f3925daf-9126-4e51-82cf-0cb2d2215e88 tempest-VolumesGetTest-644387191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:26:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-f3925daf-9126-4e51-82cf-0cb2d2215e88 tempest-VolumesGetTest-644387191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:26:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f3925daf-9126-4e51-82cf-0cb2d2215e88 tempest-VolumesGetTest-644387191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f3925daf-9126-4e51-82cf-0cb2d2215e88 tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:21 devstack sudo[98701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:26:21 devstack sudo[98701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:21 devstack sudo[98698]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d51b8345-eb21-48cc-aae7-9df62b861d1a tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5.info" returned: 0 in 0.311s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:21 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-d51b8345-eb21-48cc-aae7-9df62b861d1a tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5.info is being set with open permissions: ugo+rw Nov 03 20:26:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d51b8345-eb21-48cc-aae7-9df62b861d1a tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:21 devstack sudo[98703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5.info Nov 03 20:26:21 devstack sudo[98703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:21 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-3e92e79c-fb43-423a-a553-c83beb5580fc tempest-VolumesGetTest-644387191 None] Acquiring lock "cinder-f94a57ed-2eaf-441b-a0fb-a83f660d4225-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:21 devstack sudo[98701]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f3925daf-9126-4e51-82cf-0cb2d2215e88 tempest-VolumesGetTest-644387191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.286s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:21 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-f3925daf-9126-4e51-82cf-0cb2d2215e88 tempest-VolumesGetTest-644387191 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:26:21 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-f3925daf-9126-4e51-82cf-0cb2d2215e88 tempest-VolumesGetTest-644387191 None] Deleted volume successfully. Nov 03 20:26:21 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-3e92e79c-fb43-423a-a553-c83beb5580fc tempest-VolumesGetTest-644387191 None] Lock "cinder-f94a57ed-2eaf-441b-a0fb-a83f660d4225-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:21 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-f3925daf-9126-4e51-82cf-0cb2d2215e88 tempest-VolumesGetTest-644387191 None] Lock "cinder-5b24c620-f2c6-4df2-afc6-41ad79cc5308-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:21 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-3e92e79c-fb43-423a-a553-c83beb5580fc tempest-VolumesGetTest-644387191 None] Acquiring lock "cinder-quobyte-f94a57ed-2eaf-441b-a0fb-a83f660d4225" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:21 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-3e92e79c-fb43-423a-a553-c83beb5580fc tempest-VolumesGetTest-644387191 None] Lock "cinder-quobyte-f94a57ed-2eaf-441b-a0fb-a83f660d4225" acquired by "delete_volume" :: waited 0.044s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:21 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e21956-02a9-4d5f-9fad-ea8496a8e948]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3e92e79c-fb43-423a-a553-c83beb5580fc tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f94a57ed-2eaf-441b-a0fb-a83f660d4225 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:21 devstack sudo[98703]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d51b8345-eb21-48cc-aae7-9df62b861d1a tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5.info" returned: 0 in 0.414s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d51b8345-eb21-48cc-aae7-9df62b861d1a tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.622s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:21 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-d51b8345-eb21-48cc-aae7-9df62b861d1a tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Create snapshot completed successfully Nov 03 20:26:21 devstack sudo[98708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f94a57ed-2eaf-441b-a0fb-a83f660d4225 Nov 03 20:26:21 devstack sudo[98708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:22 devstack sudo[98708]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3e92e79c-fb43-423a-a553-c83beb5580fc tempest-VolumesGetTest-644387191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f94a57ed-2eaf-441b-a0fb-a83f660d4225" returned: 0 in 0.452s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3e92e79c-fb43-423a-a553-c83beb5580fc tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f94a57ed-2eaf-441b-a0fb-a83f660d4225 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:22 devstack sudo[98713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f94a57ed-2eaf-441b-a0fb-a83f660d4225 Nov 03 20:26:22 devstack sudo[98713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:22 devstack sudo[98713]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3e92e79c-fb43-423a-a553-c83beb5580fc tempest-VolumesGetTest-644387191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f94a57ed-2eaf-441b-a0fb-a83f660d4225" returned: 0 in 0.312s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:22 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-3e92e79c-fb43-423a-a553-c83beb5580fc tempest-VolumesGetTest-644387191 None] Lock "cinder-quobyte-f94a57ed-2eaf-441b-a0fb-a83f660d4225" released by "delete_volume" :: held 0.825s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:22 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-3e92e79c-fb43-423a-a553-c83beb5580fc tempest-VolumesGetTest-644387191 None] Created reservations ['bead6384-5a14-4eeb-adbe-969329f415cb', 'c8e4f057-e5d6-40ff-aa73-376f3dc8e71c', '2f2ccebf-7cc5-44be-9f22-9ae0adb5c7b5', '23859760-6e9c-454c-b856-ea19ad076c74'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:26:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-3e92e79c-fb43-423a-a553-c83beb5580fc tempest-VolumesGetTest-644387191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-3e92e79c-fb43-423a-a553-c83beb5580fc tempest-VolumesGetTest-644387191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:22 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-3e92e79c-fb43-423a-a553-c83beb5580fc tempest-VolumesGetTest-644387191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:26:22 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-3e92e79c-fb43-423a-a553-c83beb5580fc tempest-VolumesGetTest-644387191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:26:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-3e92e79c-fb43-423a-a553-c83beb5580fc tempest-VolumesGetTest-644387191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3e92e79c-fb43-423a-a553-c83beb5580fc tempest-VolumesGetTest-644387191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:22 devstack sudo[98716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:26:22 devstack sudo[98716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:22 devstack sudo[98716]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3e92e79c-fb43-423a-a553-c83beb5580fc tempest-VolumesGetTest-644387191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.288s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:22 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-3e92e79c-fb43-423a-a553-c83beb5580fc tempest-VolumesGetTest-644387191 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:26:22 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-3e92e79c-fb43-423a-a553-c83beb5580fc tempest-VolumesGetTest-644387191 None] Deleted volume successfully. Nov 03 20:26:23 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-3e92e79c-fb43-423a-a553-c83beb5580fc tempest-VolumesGetTest-644387191 None] Lock "cinder-f94a57ed-2eaf-441b-a0fb-a83f660d4225-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:23 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b3204c6d-dd38-45c7-a70f-22c24ded064c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Acquiring lock "cinder-d9d9268b-42d7-4536-ad55-0ba46ba6f858-delete_snapshot" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:23 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b3204c6d-dd38-45c7-a70f-22c24ded064c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Lock "cinder-d9d9268b-42d7-4536-ad55-0ba46ba6f858-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:23 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b3204c6d-dd38-45c7-a70f-22c24ded064c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Acquiring lock "cinder-quobyte-8e0ad059-25c4-48fd-b39a-c64f3d764ec5" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:23 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b3204c6d-dd38-45c7-a70f-22c24ded064c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Lock "cinder-quobyte-8e0ad059-25c4-48fd-b39a-c64f3d764ec5" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:23 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b3204c6d-dd38-45c7-a70f-22c24ded064c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Acquiring lock "cinder-quobyte-d9d9268b-42d7-4536-ad55-0ba46ba6f858" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:23 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b3204c6d-dd38-45c7-a70f-22c24ded064c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Lock "cinder-quobyte-d9d9268b-42d7-4536-ad55-0ba46ba6f858" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:23 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-b3204c6d-dd38-45c7-a70f-22c24ded064c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Deleting offline snapshot d9d9268b-42d7-4536-ad55-0ba46ba6f858 of volume 8e0ad059-25c4-48fd-b39a-c64f3d764ec5 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:26:23 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-b3204c6d-dd38-45c7-a70f-22c24ded064c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] snapshot_file for this snap is: volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5.d9d9268b-42d7-4536-ad55-0ba46ba6f858 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:26:23 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[393bdd68-91e7-44da-ba58-b1f027598c29]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b3204c6d-dd38-45c7-a70f-22c24ded064c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5.d9d9268b-42d7-4536-ad55-0ba46ba6f858 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:23 devstack sudo[98719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5.d9d9268b-42d7-4536-ad55-0ba46ba6f858 Nov 03 20:26:23 devstack sudo[98719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:23 devstack sudo[98719]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b3204c6d-dd38-45c7-a70f-22c24ded064c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5.d9d9268b-42d7-4536-ad55-0ba46ba6f858" returned: 0 in 0.518s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:23 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-b3204c6d-dd38-45c7-a70f-22c24ded064c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:26:23 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02ef344-e58e-49ed-a678-6cd96aa54810]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b3204c6d-dd38-45c7-a70f-22c24ded064c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:23 devstack sudo[98725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5 Nov 03 20:26:23 devstack sudo[98725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:24 devstack sudo[98725]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b3204c6d-dd38-45c7-a70f-22c24ded064c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5" returned: 0 in 0.493s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b3204c6d-dd38-45c7-a70f-22c24ded064c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5.d9d9268b-42d7-4536-ad55-0ba46ba6f858 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:24 devstack sudo[98732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5.d9d9268b-42d7-4536-ad55-0ba46ba6f858 Nov 03 20:26:24 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:24 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b3204c6d-dd38-45c7-a70f-22c24ded064c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5.d9d9268b-42d7-4536-ad55-0ba46ba6f858" returned: 0 in 0.535s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b3204c6d-dd38-45c7-a70f-22c24ded064c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5.d9d9268b-42d7-4536-ad55-0ba46ba6f858 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:24 devstack sudo[98737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5.d9d9268b-42d7-4536-ad55-0ba46ba6f858 Nov 03 20:26:24 devstack sudo[98737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:25 devstack sudo[98737]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b3204c6d-dd38-45c7-a70f-22c24ded064c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5.d9d9268b-42d7-4536-ad55-0ba46ba6f858" returned: 0 in 0.317s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:25 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b3204c6d-dd38-45c7-a70f-22c24ded064c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Lock "cinder-quobyte-d9d9268b-42d7-4536-ad55-0ba46ba6f858" released by "_delete_snapshot" :: held 2.025s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:25 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b3204c6d-dd38-45c7-a70f-22c24ded064c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Lock "cinder-quobyte-8e0ad059-25c4-48fd-b39a-c64f3d764ec5" released by "delete_snapshot" :: held 2.059s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:25 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-b3204c6d-dd38-45c7-a70f-22c24ded064c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Created reservations ['3515e18d-938a-4a04-84b0-eff788e6453e', 'd11c0ca9-4c77-462f-963f-db8df54375c1', '88ba4c86-d1f6-4c9d-8170-600ed24747e7', '211d6f9a-30df-4367-8a84-002376c3beb1'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:26:25 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-b3204c6d-dd38-45c7-a70f-22c24ded064c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Delete snapshot completed successfully. Nov 03 20:26:25 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b3204c6d-dd38-45c7-a70f-22c24ded064c tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Lock "cinder-d9d9268b-42d7-4536-ad55-0ba46ba6f858-delete_snapshot" released by "delete_snapshot" :: held 2.241s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:26 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-51f317a6-1841-49a7-9bea-e8a4eff060ee tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Acquiring lock "cinder-8e0ad059-25c4-48fd-b39a-c64f3d764ec5-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:26 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-51f317a6-1841-49a7-9bea-e8a4eff060ee tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Lock "cinder-8e0ad059-25c4-48fd-b39a-c64f3d764ec5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:26 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-51f317a6-1841-49a7-9bea-e8a4eff060ee tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Acquiring lock "cinder-quobyte-8e0ad059-25c4-48fd-b39a-c64f3d764ec5" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:26 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-51f317a6-1841-49a7-9bea-e8a4eff060ee tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Lock "cinder-quobyte-8e0ad059-25c4-48fd-b39a-c64f3d764ec5" acquired by "delete_volume" :: waited 0.022s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:26 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3aef25-b987-4760-8a11-659aa40a9261]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-51f317a6-1841-49a7-9bea-e8a4eff060ee tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:26 devstack sudo[98740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5 Nov 03 20:26:26 devstack sudo[98740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:27 devstack sudo[98740]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-51f317a6-1841-49a7-9bea-e8a4eff060ee tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5" returned: 0 in 0.428s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-51f317a6-1841-49a7-9bea-e8a4eff060ee tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:27 devstack sudo[98745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5 Nov 03 20:26:27 devstack sudo[98745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:27 devstack sudo[98745]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-51f317a6-1841-49a7-9bea-e8a4eff060ee tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8e0ad059-25c4-48fd-b39a-c64f3d764ec5" returned: 0 in 0.306s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:27 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-51f317a6-1841-49a7-9bea-e8a4eff060ee tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Lock "cinder-quobyte-8e0ad059-25c4-48fd-b39a-c64f3d764ec5" released by "delete_volume" :: held 0.839s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:27 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-51f317a6-1841-49a7-9bea-e8a4eff060ee tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Created reservations ['532e3190-f64c-4c1a-9f42-e4782f919caa', 'bf5a4b1b-a14c-4d60-bd0e-a90a21d51b17', '9769bae8-4282-4bb3-86a5-1ea4685d21cc', 'bba3058a-eaf5-4dc9-a4da-09512cb2c4a2'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:26:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-51f317a6-1841-49a7-9bea-e8a4eff060ee tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-51f317a6-1841-49a7-9bea-e8a4eff060ee tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:27 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-51f317a6-1841-49a7-9bea-e8a4eff060ee tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:26:27 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-51f317a6-1841-49a7-9bea-e8a4eff060ee tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:26:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-51f317a6-1841-49a7-9bea-e8a4eff060ee tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-51f317a6-1841-49a7-9bea-e8a4eff060ee tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:27 devstack sudo[98748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:26:27 devstack sudo[98748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:27 devstack sudo[98748]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-51f317a6-1841-49a7-9bea-e8a4eff060ee tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.352s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:27 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-51f317a6-1841-49a7-9bea-e8a4eff060ee tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:26:27 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-51f317a6-1841-49a7-9bea-e8a4eff060ee tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Deleted volume successfully. Nov 03 20:26:27 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-51f317a6-1841-49a7-9bea-e8a4eff060ee tempest-VolumesSnapshotNegativeTestJSON-1121261583 None] Lock "cinder-8e0ad059-25c4-48fd-b39a-c64f3d764ec5-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:28 devstack cinder-volume[87248]: DEBUG oslo_service.periodic_task [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:26:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:26:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:26:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:28 devstack sudo[98751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:26:28 devstack sudo[98751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:29 devstack sudo[98751]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.341s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:29 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:26:29 devstack cinder-volume[87248]: DEBUG oslo_service.periodic_task [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running periodic task VolumeManager._thread_info {{(pid=87248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:26:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] thread count: 28 {{(pid=87248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:26:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] thread info: [<_MainThread(MainThread, started 124862067372160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:26:37 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:SELECT=186,cinder:INSERT=70,cinder:UPDATE=209,cinder:DELETE=16 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:26:37 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:SELECT=186,cinder:INSERT=62,cinder:UPDATE=234,cinder:DELETE=19 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:26:37 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-e08793a7-0788-411b-b114-99b365d37787 tempest-VolumesSnapshotTestJSON-522224620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:26:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e08793a7-0788-411b-b114-99b365d37787 tempest-VolumesSnapshotTestJSON-522224620 None] Flow 'volume_create_manager' (4b6ab250-b4a4-4548-a5d1-d74bef4b68f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:26:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e08793a7-0788-411b-b114-99b365d37787 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0ab53b3-c994-4826-81c5-475a8332aa38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e08793a7-0788-411b-b114-99b365d37787 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0ab53b3-c994-4826-81c5-475a8332aa38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-669843431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf133c3c-76a1-4ce6-a029-cec57d450a31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0eda3dd5b2d4d3bad6105060920664a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:26:37Z,use_quota=True,user_id='16b43c64364a4e9e9bf532514e566bc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e08793a7-0788-411b-b114-99b365d37787 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a7a870c-9d4b-4041-980d-6261ea4832ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e08793a7-0788-411b-b114-99b365d37787 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a7a870c-9d4b-4041-980d-6261ea4832ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e08793a7-0788-411b-b114-99b365d37787 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (588961c5-8014-4eb9-8a7a-e758a169741e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e08793a7-0788-411b-b114-99b365d37787 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (588961c5-8014-4eb9-8a7a-e758a169741e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf133c3c-76a1-4ce6-a029-cec57d450a31', 'volume_name': 'volume-bf133c3c-76a1-4ce6-a029-cec57d450a31', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e08793a7-0788-411b-b114-99b365d37787 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2af9cbc3-5aa1-490a-be0d-c92acf04a405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e08793a7-0788-411b-b114-99b365d37787 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2af9cbc3-5aa1-490a-be0d-c92acf04a405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e08793a7-0788-411b-b114-99b365d37787 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e1bc3b6-dfd3-4cf0-8d0e-c3fb21eaddd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:37 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-e08793a7-0788-411b-b114-99b365d37787 tempest-VolumesSnapshotTestJSON-522224620 None] Volume bf133c3c-76a1-4ce6-a029-cec57d450a31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf133c3c-76a1-4ce6-a029-cec57d450a31', 'volume_size': 1} Nov 03 20:26:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e08793a7-0788-411b-b114-99b365d37787 tempest-VolumesSnapshotTestJSON-522224620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e08793a7-0788-411b-b114-99b365d37787 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:37 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e08793a7-0788-411b-b114-99b365d37787 tempest-VolumesSnapshotTestJSON-522224620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-669843431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf133c3c-76a1-4ce6-a029-cec57d450a31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0eda3dd5b2d4d3bad6105060920664a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:26:37Z,use_quota=True,user_id='16b43c64364a4e9e9bf532514e566bc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:26:37 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-e08793a7-0788-411b-b114-99b365d37787 tempest-VolumesSnapshotTestJSON-522224620 None] Creating volume bf133c3c-76a1-4ce6-a029-cec57d450a31 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:26:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e08793a7-0788-411b-b114-99b365d37787 tempest-VolumesSnapshotTestJSON-522224620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e08793a7-0788-411b-b114-99b365d37787 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:37 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e08793a7-0788-411b-b114-99b365d37787 tempest-VolumesSnapshotTestJSON-522224620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:26:37 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e08793a7-0788-411b-b114-99b365d37787 tempest-VolumesSnapshotTestJSON-522224620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:26:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e08793a7-0788-411b-b114-99b365d37787 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:37 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e08793a7-0788-411b-b114-99b365d37787 tempest-VolumesSnapshotTestJSON-522224620 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:26:37 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-e08793a7-0788-411b-b114-99b365d37787 tempest-VolumesSnapshotTestJSON-522224620 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:26:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e08793a7-0788-411b-b114-99b365d37787 tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bf133c3c-76a1-4ce6-a029-cec57d450a31 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:37 devstack sudo[98755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bf133c3c-76a1-4ce6-a029-cec57d450a31 1073741824 Nov 03 20:26:37 devstack sudo[98755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:37 devstack sudo[98755]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e08793a7-0788-411b-b114-99b365d37787 tempest-VolumesSnapshotTestJSON-522224620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bf133c3c-76a1-4ce6-a029-cec57d450a31 1073741824" returned: 0 in 0.636s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e08793a7-0788-411b-b114-99b365d37787 tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bf133c3c-76a1-4ce6-a029-cec57d450a31 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:38 devstack sudo[98761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bf133c3c-76a1-4ce6-a029-cec57d450a31 Nov 03 20:26:38 devstack sudo[98761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:38 devstack sudo[98761]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e08793a7-0788-411b-b114-99b365d37787 tempest-VolumesSnapshotTestJSON-522224620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bf133c3c-76a1-4ce6-a029-cec57d450a31" returned: 0 in 0.288s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:38 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e08793a7-0788-411b-b114-99b365d37787 tempest-VolumesSnapshotTestJSON-522224620 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:26:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e08793a7-0788-411b-b114-99b365d37787 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e08793a7-0788-411b-b114-99b365d37787 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e1bc3b6-dfd3-4cf0-8d0e-c3fb21eaddd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf133c3c-76a1-4ce6-a029-cec57d450a31', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e08793a7-0788-411b-b114-99b365d37787 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a04e24cd-6eb0-4567-b188-f496883878eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:38 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-e08793a7-0788-411b-b114-99b365d37787 tempest-VolumesSnapshotTestJSON-522224620 None] Volume volume-bf133c3c-76a1-4ce6-a029-cec57d450a31 (bf133c3c-76a1-4ce6-a029-cec57d450a31): created successfully Nov 03 20:26:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e08793a7-0788-411b-b114-99b365d37787 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a04e24cd-6eb0-4567-b188-f496883878eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e08793a7-0788-411b-b114-99b365d37787 tempest-VolumesSnapshotTestJSON-522224620 None] Flow 'volume_create_manager' (4b6ab250-b4a4-4548-a5d1-d74bef4b68f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:26:38 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-e08793a7-0788-411b-b114-99b365d37787 tempest-VolumesSnapshotTestJSON-522224620 None] Created volume successfully. Nov 03 20:26:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-9627b058-09a2-44bf-a186-5610137be8bb tempest-VolumesSnapshotTestJSON-522224620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-9627b058-09a2-44bf-a186-5610137be8bb tempest-VolumesSnapshotTestJSON-522224620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:39 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-9627b058-09a2-44bf-a186-5610137be8bb tempest-VolumesSnapshotTestJSON-522224620 None] Creating offline snapshot 05275a30-7fb7-45d2-aec0-198e101434a0 of volume bf133c3c-76a1-4ce6-a029-cec57d450a31 {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:26:39 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb8aa9e-e64d-428e-89fa-0a5501535823]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9627b058-09a2-44bf-a186-5610137be8bb tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bf133c3c-76a1-4ce6-a029-cec57d450a31 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:40 devstack sudo[98764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bf133c3c-76a1-4ce6-a029-cec57d450a31 Nov 03 20:26:40 devstack sudo[98764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:40 devstack sudo[98764]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9627b058-09a2-44bf-a186-5610137be8bb tempest-VolumesSnapshotTestJSON-522224620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bf133c3c-76a1-4ce6-a029-cec57d450a31" returned: 0 in 0.474s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9627b058-09a2-44bf-a186-5610137be8bb tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bf133c3c-76a1-4ce6-a029-cec57d450a31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bf133c3c-76a1-4ce6-a029-cec57d450a31.05275a30-7fb7-45d2-aec0-198e101434a0 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:40 devstack sudo[98769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bf133c3c-76a1-4ce6-a029-cec57d450a31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bf133c3c-76a1-4ce6-a029-cec57d450a31.05275a30-7fb7-45d2-aec0-198e101434a0 1G Nov 03 20:26:40 devstack sudo[98769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:40 devstack sudo[98769]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9627b058-09a2-44bf-a186-5610137be8bb tempest-VolumesSnapshotTestJSON-522224620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bf133c3c-76a1-4ce6-a029-cec57d450a31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bf133c3c-76a1-4ce6-a029-cec57d450a31.05275a30-7fb7-45d2-aec0-198e101434a0 1G" returned: 0 in 0.477s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9627b058-09a2-44bf-a186-5610137be8bb tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf133c3c-76a1-4ce6-a029-cec57d450a31 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bf133c3c-76a1-4ce6-a029-cec57d450a31.05275a30-7fb7-45d2-aec0-198e101434a0 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:40 devstack sudo[98776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf133c3c-76a1-4ce6-a029-cec57d450a31 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bf133c3c-76a1-4ce6-a029-cec57d450a31.05275a30-7fb7-45d2-aec0-198e101434a0 Nov 03 20:26:40 devstack sudo[98776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:41 devstack sudo[98776]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9627b058-09a2-44bf-a186-5610137be8bb tempest-VolumesSnapshotTestJSON-522224620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf133c3c-76a1-4ce6-a029-cec57d450a31 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bf133c3c-76a1-4ce6-a029-cec57d450a31.05275a30-7fb7-45d2-aec0-198e101434a0" returned: 0 in 0.334s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:41 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-9627b058-09a2-44bf-a186-5610137be8bb tempest-VolumesSnapshotTestJSON-522224620 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bf133c3c-76a1-4ce6-a029-cec57d450a31.05275a30-7fb7-45d2-aec0-198e101434a0 is being set with open permissions: ugo+rw Nov 03 20:26:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9627b058-09a2-44bf-a186-5610137be8bb tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bf133c3c-76a1-4ce6-a029-cec57d450a31.05275a30-7fb7-45d2-aec0-198e101434a0 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:41 devstack sudo[98782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bf133c3c-76a1-4ce6-a029-cec57d450a31.05275a30-7fb7-45d2-aec0-198e101434a0 Nov 03 20:26:41 devstack sudo[98782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:41 devstack sudo[98782]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9627b058-09a2-44bf-a186-5610137be8bb tempest-VolumesSnapshotTestJSON-522224620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bf133c3c-76a1-4ce6-a029-cec57d450a31.05275a30-7fb7-45d2-aec0-198e101434a0" returned: 0 in 0.283s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9627b058-09a2-44bf-a186-5610137be8bb tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bf133c3c-76a1-4ce6-a029-cec57d450a31.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:41 devstack sudo[98785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bf133c3c-76a1-4ce6-a029-cec57d450a31.info Nov 03 20:26:41 devstack sudo[98785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:41 devstack sudo[98785]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9627b058-09a2-44bf-a186-5610137be8bb tempest-VolumesSnapshotTestJSON-522224620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bf133c3c-76a1-4ce6-a029-cec57d450a31.info" returned: 0 in 0.315s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:41 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-9627b058-09a2-44bf-a186-5610137be8bb tempest-VolumesSnapshotTestJSON-522224620 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bf133c3c-76a1-4ce6-a029-cec57d450a31.info is being set with open permissions: ugo+rw Nov 03 20:26:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9627b058-09a2-44bf-a186-5610137be8bb tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bf133c3c-76a1-4ce6-a029-cec57d450a31.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:41 devstack sudo[98789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bf133c3c-76a1-4ce6-a029-cec57d450a31.info Nov 03 20:26:41 devstack sudo[98789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:42 devstack sudo[98789]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9627b058-09a2-44bf-a186-5610137be8bb tempest-VolumesSnapshotTestJSON-522224620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bf133c3c-76a1-4ce6-a029-cec57d450a31.info" returned: 0 in 0.274s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-9627b058-09a2-44bf-a186-5610137be8bb tempest-VolumesSnapshotTestJSON-522224620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.277s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:42 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-9627b058-09a2-44bf-a186-5610137be8bb tempest-VolumesSnapshotTestJSON-522224620 None] Create snapshot completed successfully Nov 03 20:26:43 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-07fbea00-8200-46da-91c2-4ef3cd7fe60e tempest-VolumesSnapshotTestJSON-522224620 None] Acquiring lock "cinder-05275a30-7fb7-45d2-aec0-198e101434a0-delete_snapshot" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:43 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-07fbea00-8200-46da-91c2-4ef3cd7fe60e tempest-VolumesSnapshotTestJSON-522224620 None] Lock "cinder-05275a30-7fb7-45d2-aec0-198e101434a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:43 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-07fbea00-8200-46da-91c2-4ef3cd7fe60e tempest-VolumesSnapshotTestJSON-522224620 None] Acquiring lock "cinder-quobyte-bf133c3c-76a1-4ce6-a029-cec57d450a31" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:43 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-07fbea00-8200-46da-91c2-4ef3cd7fe60e tempest-VolumesSnapshotTestJSON-522224620 None] Lock "cinder-quobyte-bf133c3c-76a1-4ce6-a029-cec57d450a31" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:43 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-07fbea00-8200-46da-91c2-4ef3cd7fe60e tempest-VolumesSnapshotTestJSON-522224620 None] Acquiring lock "cinder-quobyte-05275a30-7fb7-45d2-aec0-198e101434a0" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:43 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-07fbea00-8200-46da-91c2-4ef3cd7fe60e tempest-VolumesSnapshotTestJSON-522224620 None] Lock "cinder-quobyte-05275a30-7fb7-45d2-aec0-198e101434a0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:43 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-07fbea00-8200-46da-91c2-4ef3cd7fe60e tempest-VolumesSnapshotTestJSON-522224620 None] Deleting offline snapshot 05275a30-7fb7-45d2-aec0-198e101434a0 of volume bf133c3c-76a1-4ce6-a029-cec57d450a31 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:26:43 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-07fbea00-8200-46da-91c2-4ef3cd7fe60e tempest-VolumesSnapshotTestJSON-522224620 None] snapshot_file for this snap is: volume-bf133c3c-76a1-4ce6-a029-cec57d450a31.05275a30-7fb7-45d2-aec0-198e101434a0 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:26:43 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f59c4e-dcb4-4fdb-975e-0d30c1401ed3]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-07fbea00-8200-46da-91c2-4ef3cd7fe60e tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bf133c3c-76a1-4ce6-a029-cec57d450a31.05275a30-7fb7-45d2-aec0-198e101434a0 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:43 devstack sudo[98792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bf133c3c-76a1-4ce6-a029-cec57d450a31.05275a30-7fb7-45d2-aec0-198e101434a0 Nov 03 20:26:43 devstack sudo[98792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:43 devstack sudo[98792]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-07fbea00-8200-46da-91c2-4ef3cd7fe60e tempest-VolumesSnapshotTestJSON-522224620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bf133c3c-76a1-4ce6-a029-cec57d450a31.05275a30-7fb7-45d2-aec0-198e101434a0" returned: 0 in 0.410s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:43 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-07fbea00-8200-46da-91c2-4ef3cd7fe60e tempest-VolumesSnapshotTestJSON-522224620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf133c3c-76a1-4ce6-a029-cec57d450a31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:26:43 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc4d2cb-609e-4508-ac6c-79f8fbe4837b]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-07fbea00-8200-46da-91c2-4ef3cd7fe60e tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bf133c3c-76a1-4ce6-a029-cec57d450a31 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:43 devstack sudo[98797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bf133c3c-76a1-4ce6-a029-cec57d450a31 Nov 03 20:26:43 devstack sudo[98797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:44 devstack sudo[98797]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-07fbea00-8200-46da-91c2-4ef3cd7fe60e tempest-VolumesSnapshotTestJSON-522224620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bf133c3c-76a1-4ce6-a029-cec57d450a31" returned: 0 in 0.421s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-07fbea00-8200-46da-91c2-4ef3cd7fe60e tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bf133c3c-76a1-4ce6-a029-cec57d450a31.05275a30-7fb7-45d2-aec0-198e101434a0 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:44 devstack sudo[98802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bf133c3c-76a1-4ce6-a029-cec57d450a31.05275a30-7fb7-45d2-aec0-198e101434a0 Nov 03 20:26:44 devstack sudo[98802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:44 devstack sudo[98802]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-07fbea00-8200-46da-91c2-4ef3cd7fe60e tempest-VolumesSnapshotTestJSON-522224620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bf133c3c-76a1-4ce6-a029-cec57d450a31.05275a30-7fb7-45d2-aec0-198e101434a0" returned: 0 in 0.421s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-07fbea00-8200-46da-91c2-4ef3cd7fe60e tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bf133c3c-76a1-4ce6-a029-cec57d450a31.05275a30-7fb7-45d2-aec0-198e101434a0 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:44 devstack sudo[98808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bf133c3c-76a1-4ce6-a029-cec57d450a31.05275a30-7fb7-45d2-aec0-198e101434a0 Nov 03 20:26:44 devstack sudo[98808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:45 devstack sudo[98808]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-07fbea00-8200-46da-91c2-4ef3cd7fe60e tempest-VolumesSnapshotTestJSON-522224620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bf133c3c-76a1-4ce6-a029-cec57d450a31.05275a30-7fb7-45d2-aec0-198e101434a0" returned: 0 in 0.335s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:45 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-07fbea00-8200-46da-91c2-4ef3cd7fe60e tempest-VolumesSnapshotTestJSON-522224620 None] Lock "cinder-quobyte-05275a30-7fb7-45d2-aec0-198e101434a0" released by "_delete_snapshot" :: held 1.717s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:45 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-07fbea00-8200-46da-91c2-4ef3cd7fe60e tempest-VolumesSnapshotTestJSON-522224620 None] Lock "cinder-quobyte-bf133c3c-76a1-4ce6-a029-cec57d450a31" released by "delete_snapshot" :: held 1.743s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:45 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-07fbea00-8200-46da-91c2-4ef3cd7fe60e tempest-VolumesSnapshotTestJSON-522224620 None] Created reservations ['df558bb2-9ffb-45f6-85b8-12089bdc0439', 'c536ff70-19ea-450a-8731-5228464d9d05', '9e74f6cd-7d91-4d4d-b803-3a712d509862', 'b1317660-3870-4119-b200-c52ecd53f9bc'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:26:45 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-07fbea00-8200-46da-91c2-4ef3cd7fe60e tempest-VolumesSnapshotTestJSON-522224620 None] Delete snapshot completed successfully. Nov 03 20:26:45 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-07fbea00-8200-46da-91c2-4ef3cd7fe60e tempest-VolumesSnapshotTestJSON-522224620 None] Lock "cinder-05275a30-7fb7-45d2-aec0-198e101434a0-delete_snapshot" released by "delete_snapshot" :: held 1.955s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:26:46 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-519e86e6-9c2a-4525-9e5f-ebf9d0026f27 tempest-VolumesSnapshotTestJSON-522224620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:26:46 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-519e86e6-9c2a-4525-9e5f-ebf9d0026f27 tempest-VolumesSnapshotTestJSON-522224620 None] Flow 'volume_create_manager' (067d7d86-8d45-4fe1-b0fe-a54876706ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:26:46 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-519e86e6-9c2a-4525-9e5f-ebf9d0026f27 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bab85889-5992-4bec-8a23-c8e256013bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:46 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-519e86e6-9c2a-4525-9e5f-ebf9d0026f27 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bab85889-5992-4bec-8a23-c8e256013bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2118080753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3918446d-e8d4-47bf-87e6-faac233e4bdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0eda3dd5b2d4d3bad6105060920664a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:26:46Z,use_quota=True,user_id='16b43c64364a4e9e9bf532514e566bc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:46 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-519e86e6-9c2a-4525-9e5f-ebf9d0026f27 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f751ce8-5032-49f0-92ae-6e45c9d86a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:46 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-519e86e6-9c2a-4525-9e5f-ebf9d0026f27 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f751ce8-5032-49f0-92ae-6e45c9d86a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:46 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-519e86e6-9c2a-4525-9e5f-ebf9d0026f27 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d29668b-3a7d-473d-b725-5cdf3dca6ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:46 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-519e86e6-9c2a-4525-9e5f-ebf9d0026f27 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d29668b-3a7d-473d-b725-5cdf3dca6ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3918446d-e8d4-47bf-87e6-faac233e4bdd', 'volume_name': 'volume-3918446d-e8d4-47bf-87e6-faac233e4bdd', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:46 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-519e86e6-9c2a-4525-9e5f-ebf9d0026f27 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6efff0bf-71b2-4c25-b990-48205a268b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:46 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-519e86e6-9c2a-4525-9e5f-ebf9d0026f27 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6efff0bf-71b2-4c25-b990-48205a268b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:46 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-519e86e6-9c2a-4525-9e5f-ebf9d0026f27 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (054aea31-9b0c-4a36-a522-0e875b561675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:46 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-519e86e6-9c2a-4525-9e5f-ebf9d0026f27 tempest-VolumesSnapshotTestJSON-522224620 None] Volume 3918446d-e8d4-47bf-87e6-faac233e4bdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3918446d-e8d4-47bf-87e6-faac233e4bdd', 'volume_size': 1} Nov 03 20:26:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-519e86e6-9c2a-4525-9e5f-ebf9d0026f27 tempest-VolumesSnapshotTestJSON-522224620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-519e86e6-9c2a-4525-9e5f-ebf9d0026f27 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:46 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-519e86e6-9c2a-4525-9e5f-ebf9d0026f27 tempest-VolumesSnapshotTestJSON-522224620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2118080753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3918446d-e8d4-47bf-87e6-faac233e4bdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0eda3dd5b2d4d3bad6105060920664a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:26:46Z,use_quota=True,user_id='16b43c64364a4e9e9bf532514e566bc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:26:46 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-519e86e6-9c2a-4525-9e5f-ebf9d0026f27 tempest-VolumesSnapshotTestJSON-522224620 None] Creating volume 3918446d-e8d4-47bf-87e6-faac233e4bdd {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:26:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-519e86e6-9c2a-4525-9e5f-ebf9d0026f27 tempest-VolumesSnapshotTestJSON-522224620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-519e86e6-9c2a-4525-9e5f-ebf9d0026f27 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:46 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-519e86e6-9c2a-4525-9e5f-ebf9d0026f27 tempest-VolumesSnapshotTestJSON-522224620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:26:46 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-519e86e6-9c2a-4525-9e5f-ebf9d0026f27 tempest-VolumesSnapshotTestJSON-522224620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:26:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-519e86e6-9c2a-4525-9e5f-ebf9d0026f27 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:46 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-519e86e6-9c2a-4525-9e5f-ebf9d0026f27 tempest-VolumesSnapshotTestJSON-522224620 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:26:46 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-519e86e6-9c2a-4525-9e5f-ebf9d0026f27 tempest-VolumesSnapshotTestJSON-522224620 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:26:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-519e86e6-9c2a-4525-9e5f-ebf9d0026f27 tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:46 devstack sudo[98812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd 1073741824 Nov 03 20:26:46 devstack sudo[98812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:46 devstack sudo[98812]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-519e86e6-9c2a-4525-9e5f-ebf9d0026f27 tempest-VolumesSnapshotTestJSON-522224620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd 1073741824" returned: 0 in 0.522s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-519e86e6-9c2a-4525-9e5f-ebf9d0026f27 tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:46 devstack sudo[98818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd Nov 03 20:26:46 devstack sudo[98818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:47 devstack sudo[98818]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-519e86e6-9c2a-4525-9e5f-ebf9d0026f27 tempest-VolumesSnapshotTestJSON-522224620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd" returned: 0 in 0.376s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:47 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-519e86e6-9c2a-4525-9e5f-ebf9d0026f27 tempest-VolumesSnapshotTestJSON-522224620 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:26:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-519e86e6-9c2a-4525-9e5f-ebf9d0026f27 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:47 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-519e86e6-9c2a-4525-9e5f-ebf9d0026f27 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (054aea31-9b0c-4a36-a522-0e875b561675) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3918446d-e8d4-47bf-87e6-faac233e4bdd', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:47 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-519e86e6-9c2a-4525-9e5f-ebf9d0026f27 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b77dbc0-f231-4787-b440-58426e718750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:47 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-519e86e6-9c2a-4525-9e5f-ebf9d0026f27 tempest-VolumesSnapshotTestJSON-522224620 None] Volume volume-3918446d-e8d4-47bf-87e6-faac233e4bdd (3918446d-e8d4-47bf-87e6-faac233e4bdd): created successfully Nov 03 20:26:47 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-519e86e6-9c2a-4525-9e5f-ebf9d0026f27 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b77dbc0-f231-4787-b440-58426e718750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:47 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-519e86e6-9c2a-4525-9e5f-ebf9d0026f27 tempest-VolumesSnapshotTestJSON-522224620 None] Flow 'volume_create_manager' (067d7d86-8d45-4fe1-b0fe-a54876706ffc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:26:47 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-519e86e6-9c2a-4525-9e5f-ebf9d0026f27 tempest-VolumesSnapshotTestJSON-522224620 None] Created volume successfully. Nov 03 20:26:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6c74d7b1-a18e-40bf-8cba-3b66bfaef69b tempest-VolumesSnapshotTestJSON-522224620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6c74d7b1-a18e-40bf-8cba-3b66bfaef69b tempest-VolumesSnapshotTestJSON-522224620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:48 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-6c74d7b1-a18e-40bf-8cba-3b66bfaef69b tempest-VolumesSnapshotTestJSON-522224620 None] Creating offline snapshot effad0c3-17c9-43fa-a524-7c35e24efb09 of volume 3918446d-e8d4-47bf-87e6-faac233e4bdd {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:26:48 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed3dab6-24fa-4d0f-b66b-083505f54ac6]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6c74d7b1-a18e-40bf-8cba-3b66bfaef69b tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:48 devstack sudo[98821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd Nov 03 20:26:48 devstack sudo[98821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:49 devstack sudo[98821]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6c74d7b1-a18e-40bf-8cba-3b66bfaef69b tempest-VolumesSnapshotTestJSON-522224620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd" returned: 0 in 0.408s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6c74d7b1-a18e-40bf-8cba-3b66bfaef69b tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd.effad0c3-17c9-43fa-a524-7c35e24efb09 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:49 devstack sudo[98826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd.effad0c3-17c9-43fa-a524-7c35e24efb09 1G Nov 03 20:26:49 devstack sudo[98826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:49 devstack sudo[98826]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6c74d7b1-a18e-40bf-8cba-3b66bfaef69b tempest-VolumesSnapshotTestJSON-522224620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd.effad0c3-17c9-43fa-a524-7c35e24efb09 1G" returned: 0 in 0.449s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6c74d7b1-a18e-40bf-8cba-3b66bfaef69b tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3918446d-e8d4-47bf-87e6-faac233e4bdd -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd.effad0c3-17c9-43fa-a524-7c35e24efb09 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:49 devstack sudo[98832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3918446d-e8d4-47bf-87e6-faac233e4bdd -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd.effad0c3-17c9-43fa-a524-7c35e24efb09 Nov 03 20:26:49 devstack sudo[98832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:49 devstack sudo[98832]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6c74d7b1-a18e-40bf-8cba-3b66bfaef69b tempest-VolumesSnapshotTestJSON-522224620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3918446d-e8d4-47bf-87e6-faac233e4bdd -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd.effad0c3-17c9-43fa-a524-7c35e24efb09" returned: 0 in 0.404s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:49 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-6c74d7b1-a18e-40bf-8cba-3b66bfaef69b tempest-VolumesSnapshotTestJSON-522224620 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd.effad0c3-17c9-43fa-a524-7c35e24efb09 is being set with open permissions: ugo+rw Nov 03 20:26:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6c74d7b1-a18e-40bf-8cba-3b66bfaef69b tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd.effad0c3-17c9-43fa-a524-7c35e24efb09 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:49 devstack sudo[98837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd.effad0c3-17c9-43fa-a524-7c35e24efb09 Nov 03 20:26:49 devstack sudo[98837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:50 devstack sudo[98837]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6c74d7b1-a18e-40bf-8cba-3b66bfaef69b tempest-VolumesSnapshotTestJSON-522224620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd.effad0c3-17c9-43fa-a524-7c35e24efb09" returned: 0 in 0.391s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6c74d7b1-a18e-40bf-8cba-3b66bfaef69b tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:50 devstack sudo[98843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd.info Nov 03 20:26:50 devstack sudo[98843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:50 devstack sudo[98843]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6c74d7b1-a18e-40bf-8cba-3b66bfaef69b tempest-VolumesSnapshotTestJSON-522224620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd.info" returned: 0 in 0.386s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:50 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-6c74d7b1-a18e-40bf-8cba-3b66bfaef69b tempest-VolumesSnapshotTestJSON-522224620 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd.info is being set with open permissions: ugo+rw Nov 03 20:26:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6c74d7b1-a18e-40bf-8cba-3b66bfaef69b tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:50 devstack sudo[98846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd.info Nov 03 20:26:50 devstack sudo[98846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:51 devstack sudo[98846]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6c74d7b1-a18e-40bf-8cba-3b66bfaef69b tempest-VolumesSnapshotTestJSON-522224620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd.info" returned: 0 in 0.287s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6c74d7b1-a18e-40bf-8cba-3b66bfaef69b tempest-VolumesSnapshotTestJSON-522224620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.510s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:51 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-6c74d7b1-a18e-40bf-8cba-3b66bfaef69b tempest-VolumesSnapshotTestJSON-522224620 None] Create snapshot completed successfully Nov 03 20:26:52 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:26:52 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] Flow 'volume_create_manager' (481fe1f4-fa8e-40b0-b1e1-5d244f633867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:26:52 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40c2c54e-5ef4-4ea5-9d7b-80aee203af13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:52 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40c2c54e-5ef4-4ea5-9d7b-80aee203af13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:26:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1701235803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d020bd43-803f-418b-b18d-540ff91f70fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0eda3dd5b2d4d3bad6105060920664a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:26:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=effad0c3-17c9-43fa-a524-7c35e24efb09,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:26:53Z,use_quota=True,user_id='16b43c64364a4e9e9bf532514e566bc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:52 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7acb062-9413-469e-b38f-b8cb8740e90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:52 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7acb062-9413-469e-b38f-b8cb8740e90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:52 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4966e4c2-23dc-4493-beab-5b27d72fc7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:52 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4966e4c2-23dc-4493-beab-5b27d72fc7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd020bd43-803f-418b-b18d-540ff91f70fd', 'volume_name': 'volume-d020bd43-803f-418b-b18d-540ff91f70fd', 'volume_size': 2, 'snapshot_id': 'effad0c3-17c9-43fa-a524-7c35e24efb09'}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:52 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c09da0d9-3e77-4604-bacc-de94b5ce6404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:52 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c09da0d9-3e77-4604-bacc-de94b5ce6404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:26:52 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97b77b8b-1c69-47d8-b548-92c8454cb48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:26:52 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] Volume d020bd43-803f-418b-b18d-540ff91f70fd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d020bd43-803f-418b-b18d-540ff91f70fd', 'volume_size': 2, 'snapshot_id': 'effad0c3-17c9-43fa-a524-7c35e24efb09'} Nov 03 20:26:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:52 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] Acquiring lock "cinder-quobyte-effad0c3-17c9-43fa-a524-7c35e24efb09-d020bd43-803f-418b-b18d-540ff91f70fd" by "_create_volume_from_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:52 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "cinder-quobyte-effad0c3-17c9-43fa-a524-7c35e24efb09-d020bd43-803f-418b-b18d-540ff91f70fd" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:52 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] Creating volume d020bd43-803f-418b-b18d-540ff91f70fd from snapshot effad0c3-17c9-43fa-a524-7c35e24efb09 {{(pid=87248) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 20:26:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:52 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:26:52 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:26:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:52 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:26:52 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] Acquiring lock "cinder-quobyte-d020bd43-803f-418b-b18d-540ff91f70fd" by "_copy_volume_from_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:26:52 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "cinder-quobyte-d020bd43-803f-418b-b18d-540ff91f70fd" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:26:52 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] snapshot: effad0c3-17c9-43fa-a524-7c35e24efb09, volume: d020bd43-803f-418b-b18d-540ff91f70fd, {{(pid=87248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 20:26:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:26:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:26:52 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:26:52 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:26:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:26:52 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20e1b8d-9ed0-4338-b287-247d2764891f]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd.effad0c3-17c9-43fa-a524-7c35e24efb09 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:53 devstack sudo[98866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd.effad0c3-17c9-43fa-a524-7c35e24efb09 Nov 03 20:26:53 devstack sudo[98866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:53 devstack sudo[98866]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd.effad0c3-17c9-43fa-a524-7c35e24efb09" returned: 0 in 0.467s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:53 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3918446d-e8d4-47bf-87e6-faac233e4bdd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:26:53 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afaf4f6-0226-4936-999e-65e632e009ca]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:26:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:53 devstack sudo[98875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd Nov 03 20:26:53 devstack sudo[98875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:26:53 devstack sudo[98875]: pam_unix(sudo:session): session closed for user root Nov 03 20:26:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd" returned: 0 in 0.487s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:26:53 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd {{(pid=87248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 20:26:53 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] Creating direct copy from snapshot {{(pid=87248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 20:26:53 devstack cinder-volume[87248]: DEBUG cinder.utils [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] Path /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d020bd43-803f-418b-b18d-540ff91f70fd not found in is_blk_device check {{(pid=87248) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 20:26:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d020bd43-803f-418b-b18d-540ff91f70fd {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:26:53 devstack sudo[98881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d020bd43-803f-418b-b18d-540ff91f70fd Nov 03 20:26:53 devstack sudo[98881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:02 devstack sudo[98881]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d020bd43-803f-418b-b18d-540ff91f70fd" returned: 0 in 8.397s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:02 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] Image conversion details: src /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd, size 1024.00 MB, duration 8.40 sec, destination /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d020bd43-803f-418b-b18d-540ff91f70fd {{(pid=87248) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:27:02 devstack cinder-volume[87248]: INFO cinder.image.image_utils [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] Converted 1024.00 MB image at 121.93 MB/s Nov 03 20:27:02 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d020bd43-803f-418b-b18d-540ff91f70fd is being set with open permissions: ugo+rw Nov 03 20:27:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d020bd43-803f-418b-b18d-540ff91f70fd {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:02 devstack sudo[98901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d020bd43-803f-418b-b18d-540ff91f70fd Nov 03 20:27:02 devstack sudo[98901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:02 devstack sudo[98901]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d020bd43-803f-418b-b18d-540ff91f70fd" returned: 0 in 0.335s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:02 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "cinder-quobyte-d020bd43-803f-418b-b18d-540ff91f70fd" released by "_copy_volume_from_snapshot" :: held 9.829s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:02 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "cinder-quobyte-effad0c3-17c9-43fa-a524-7c35e24efb09-d020bd43-803f-418b-b18d-540ff91f70fd" released by "_create_volume_from_snapshot" :: held 9.930s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.960s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97b77b8b-1c69-47d8-b548-92c8454cb48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d020bd43-803f-418b-b18d-540ff91f70fd', 'volume_size': 2, 'snapshot_id': 'effad0c3-17c9-43fa-a524-7c35e24efb09'}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2002e88a-ff1e-4697-8132-3dfec398a796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:02 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] Volume volume-d020bd43-803f-418b-b18d-540ff91f70fd (d020bd43-803f-418b-b18d-540ff91f70fd): created successfully Nov 03 20:27:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2002e88a-ff1e-4697-8132-3dfec398a796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] Flow 'volume_create_manager' (481fe1f4-fa8e-40b0-b1e1-5d244f633867) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:02 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-1f4d420c-6a1b-4ff3-b8a0-998533a4bcd8 tempest-VolumesSnapshotTestJSON-522224620 None] Created volume successfully. Nov 03 20:27:03 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c8674014-09f6-4282-890c-4435a53d600b tempest-VolumesSnapshotTestJSON-522224620 None] Acquiring lock "cinder-d020bd43-803f-418b-b18d-540ff91f70fd-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:03 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c8674014-09f6-4282-890c-4435a53d600b tempest-VolumesSnapshotTestJSON-522224620 None] Lock "cinder-d020bd43-803f-418b-b18d-540ff91f70fd-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:04 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c8674014-09f6-4282-890c-4435a53d600b tempest-VolumesSnapshotTestJSON-522224620 None] Acquiring lock "cinder-quobyte-d020bd43-803f-418b-b18d-540ff91f70fd" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:04 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c8674014-09f6-4282-890c-4435a53d600b tempest-VolumesSnapshotTestJSON-522224620 None] Lock "cinder-quobyte-d020bd43-803f-418b-b18d-540ff91f70fd" acquired by "delete_volume" :: waited 0.023s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:04 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[216204c0-b39c-4f79-bba3-d4402c75b780]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c8674014-09f6-4282-890c-4435a53d600b tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d020bd43-803f-418b-b18d-540ff91f70fd {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:04 devstack sudo[98905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d020bd43-803f-418b-b18d-540ff91f70fd Nov 03 20:27:04 devstack sudo[98905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:04 devstack sudo[98905]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c8674014-09f6-4282-890c-4435a53d600b tempest-VolumesSnapshotTestJSON-522224620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d020bd43-803f-418b-b18d-540ff91f70fd" returned: 0 in 0.463s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c8674014-09f6-4282-890c-4435a53d600b tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d020bd43-803f-418b-b18d-540ff91f70fd {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:04 devstack sudo[98920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d020bd43-803f-418b-b18d-540ff91f70fd Nov 03 20:27:04 devstack sudo[98920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:05 devstack sudo[98920]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c8674014-09f6-4282-890c-4435a53d600b tempest-VolumesSnapshotTestJSON-522224620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-d020bd43-803f-418b-b18d-540ff91f70fd" returned: 0 in 0.497s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:05 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c8674014-09f6-4282-890c-4435a53d600b tempest-VolumesSnapshotTestJSON-522224620 None] Lock "cinder-quobyte-d020bd43-803f-418b-b18d-540ff91f70fd" released by "delete_volume" :: held 1.023s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:05 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-c8674014-09f6-4282-890c-4435a53d600b tempest-VolumesSnapshotTestJSON-522224620 None] Created reservations ['f55e06b1-5f2d-4c79-ba3c-ffcbd6d101e3', '81eca899-8c14-4a7d-818a-2c0cee3b3201', 'a20ae1d7-084e-40fc-a2ec-bb2d248a8997', 'dd07532c-41c0-432b-a6a5-cfb1bf65e889'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:27:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c8674014-09f6-4282-890c-4435a53d600b tempest-VolumesSnapshotTestJSON-522224620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c8674014-09f6-4282-890c-4435a53d600b tempest-VolumesSnapshotTestJSON-522224620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:05 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c8674014-09f6-4282-890c-4435a53d600b tempest-VolumesSnapshotTestJSON-522224620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:05 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c8674014-09f6-4282-890c-4435a53d600b tempest-VolumesSnapshotTestJSON-522224620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c8674014-09f6-4282-890c-4435a53d600b tempest-VolumesSnapshotTestJSON-522224620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c8674014-09f6-4282-890c-4435a53d600b tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:05 devstack sudo[98949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:27:05 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:05 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c8674014-09f6-4282-890c-4435a53d600b tempest-VolumesSnapshotTestJSON-522224620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.281s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:05 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-c8674014-09f6-4282-890c-4435a53d600b tempest-VolumesSnapshotTestJSON-522224620 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:27:05 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-c8674014-09f6-4282-890c-4435a53d600b tempest-VolumesSnapshotTestJSON-522224620 None] Deleted volume successfully. Nov 03 20:27:05 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c8674014-09f6-4282-890c-4435a53d600b tempest-VolumesSnapshotTestJSON-522224620 None] Lock "cinder-d020bd43-803f-418b-b18d-540ff91f70fd-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:06 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e77a7e9b-434e-49d5-9b0e-7254250b2d90 tempest-VolumesSnapshotTestJSON-522224620 None] Acquiring lock "cinder-effad0c3-17c9-43fa-a524-7c35e24efb09-delete_snapshot" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:06 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e77a7e9b-434e-49d5-9b0e-7254250b2d90 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "cinder-effad0c3-17c9-43fa-a524-7c35e24efb09-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:06 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e77a7e9b-434e-49d5-9b0e-7254250b2d90 tempest-VolumesSnapshotTestJSON-522224620 None] Acquiring lock "cinder-quobyte-3918446d-e8d4-47bf-87e6-faac233e4bdd" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:06 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-75807ade-5666-4e6f-84c7-e447304bbd8f tempest-TestServerVolumeAttachmentScenario-1934017498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:27:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75807ade-5666-4e6f-84c7-e447304bbd8f tempest-TestServerVolumeAttachmentScenario-1934017498 None] Flow 'volume_create_manager' (489ae43e-25e8-4d47-b458-8aa9889a86bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75807ade-5666-4e6f-84c7-e447304bbd8f tempest-TestServerVolumeAttachmentScenario-1934017498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (916d0c25-364e-4c64-b114-e46b95d22dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75807ade-5666-4e6f-84c7-e447304bbd8f tempest-TestServerVolumeAttachmentScenario-1934017498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (916d0c25-364e-4c64-b114-e46b95d22dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1165688277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32f63e3e-a888-48e8-82aa-6d035c6360fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7480b7bffaa643cda34f309316e1ff6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:07Z,use_quota=True,user_id='db2a034d19914f0d8e37c6c06fdef7d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75807ade-5666-4e6f-84c7-e447304bbd8f tempest-TestServerVolumeAttachmentScenario-1934017498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdf14124-04c5-468c-b284-dbef43ad13e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75807ade-5666-4e6f-84c7-e447304bbd8f tempest-TestServerVolumeAttachmentScenario-1934017498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdf14124-04c5-468c-b284-dbef43ad13e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75807ade-5666-4e6f-84c7-e447304bbd8f tempest-TestServerVolumeAttachmentScenario-1934017498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (441ba9af-91f8-40cc-a5a9-bf9309d45762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75807ade-5666-4e6f-84c7-e447304bbd8f tempest-TestServerVolumeAttachmentScenario-1934017498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (441ba9af-91f8-40cc-a5a9-bf9309d45762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32f63e3e-a888-48e8-82aa-6d035c6360fa', 'volume_name': 'volume-32f63e3e-a888-48e8-82aa-6d035c6360fa', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75807ade-5666-4e6f-84c7-e447304bbd8f tempest-TestServerVolumeAttachmentScenario-1934017498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d345b441-2327-4e52-b888-c0a40c0aa6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75807ade-5666-4e6f-84c7-e447304bbd8f tempest-TestServerVolumeAttachmentScenario-1934017498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d345b441-2327-4e52-b888-c0a40c0aa6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75807ade-5666-4e6f-84c7-e447304bbd8f tempest-TestServerVolumeAttachmentScenario-1934017498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b43cb3a1-5881-4479-80c1-a2c459b691dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:06 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-75807ade-5666-4e6f-84c7-e447304bbd8f tempest-TestServerVolumeAttachmentScenario-1934017498 None] Volume 32f63e3e-a888-48e8-82aa-6d035c6360fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32f63e3e-a888-48e8-82aa-6d035c6360fa', 'volume_size': 1} Nov 03 20:27:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75807ade-5666-4e6f-84c7-e447304bbd8f tempest-TestServerVolumeAttachmentScenario-1934017498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75807ade-5666-4e6f-84c7-e447304bbd8f tempest-TestServerVolumeAttachmentScenario-1934017498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75807ade-5666-4e6f-84c7-e447304bbd8f tempest-TestServerVolumeAttachmentScenario-1934017498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1165688277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32f63e3e-a888-48e8-82aa-6d035c6360fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7480b7bffaa643cda34f309316e1ff6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:07Z,use_quota=True,user_id='db2a034d19914f0d8e37c6c06fdef7d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:27:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-75807ade-5666-4e6f-84c7-e447304bbd8f tempest-TestServerVolumeAttachmentScenario-1934017498 None] Creating volume 32f63e3e-a888-48e8-82aa-6d035c6360fa {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:27:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75807ade-5666-4e6f-84c7-e447304bbd8f tempest-TestServerVolumeAttachmentScenario-1934017498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75807ade-5666-4e6f-84c7-e447304bbd8f tempest-TestServerVolumeAttachmentScenario-1934017498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75807ade-5666-4e6f-84c7-e447304bbd8f tempest-TestServerVolumeAttachmentScenario-1934017498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75807ade-5666-4e6f-84c7-e447304bbd8f tempest-TestServerVolumeAttachmentScenario-1934017498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75807ade-5666-4e6f-84c7-e447304bbd8f tempest-TestServerVolumeAttachmentScenario-1934017498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75807ade-5666-4e6f-84c7-e447304bbd8f tempest-TestServerVolumeAttachmentScenario-1934017498 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:27:06 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-75807ade-5666-4e6f-84c7-e447304bbd8f tempest-TestServerVolumeAttachmentScenario-1934017498 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:27:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75807ade-5666-4e6f-84c7-e447304bbd8f tempest-TestServerVolumeAttachmentScenario-1934017498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-32f63e3e-a888-48e8-82aa-6d035c6360fa 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:06 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e77a7e9b-434e-49d5-9b0e-7254250b2d90 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "cinder-quobyte-3918446d-e8d4-47bf-87e6-faac233e4bdd" acquired by "delete_snapshot" :: waited 0.270s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:06 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e77a7e9b-434e-49d5-9b0e-7254250b2d90 tempest-VolumesSnapshotTestJSON-522224620 None] Acquiring lock "cinder-quobyte-effad0c3-17c9-43fa-a524-7c35e24efb09" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:06 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e77a7e9b-434e-49d5-9b0e-7254250b2d90 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "cinder-quobyte-effad0c3-17c9-43fa-a524-7c35e24efb09" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:06 devstack sudo[99007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-32f63e3e-a888-48e8-82aa-6d035c6360fa 1073741824 Nov 03 20:27:06 devstack sudo[99007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-e77a7e9b-434e-49d5-9b0e-7254250b2d90 tempest-VolumesSnapshotTestJSON-522224620 None] Deleting offline snapshot effad0c3-17c9-43fa-a524-7c35e24efb09 of volume 3918446d-e8d4-47bf-87e6-faac233e4bdd {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:27:07 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-e77a7e9b-434e-49d5-9b0e-7254250b2d90 tempest-VolumesSnapshotTestJSON-522224620 None] snapshot_file for this snap is: volume-3918446d-e8d4-47bf-87e6-faac233e4bdd.effad0c3-17c9-43fa-a524-7c35e24efb09 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:27:07 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bec7c4c-3908-47ac-8213-73c3a7395757]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e77a7e9b-434e-49d5-9b0e-7254250b2d90 tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd.effad0c3-17c9-43fa-a524-7c35e24efb09 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:07 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9a16bb4-3c0f-47a7-b50b-a52eda3fb799 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:27:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f9a16bb4-3c0f-47a7-b50b-a52eda3fb799 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Flow 'volume_create_manager' (3ae8f392-606f-4e13-80b9-1918cc3fa5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f9a16bb4-3c0f-47a7-b50b-a52eda3fb799 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30837490-463b-4f13-85a0-0fc6624ba3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f9a16bb4-3c0f-47a7-b50b-a52eda3fb799 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30837490-463b-4f13-85a0-0fc6624ba3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-999374236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13f7bb77-4aed-4900-89e2-dd8a858c05df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7480b7bffaa643cda34f309316e1ff6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:07Z,use_quota=True,user_id='db2a034d19914f0d8e37c6c06fdef7d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f9a16bb4-3c0f-47a7-b50b-a52eda3fb799 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f06bfd0c-5d52-4484-b4fe-328f2d1cd527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f9a16bb4-3c0f-47a7-b50b-a52eda3fb799 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f06bfd0c-5d52-4484-b4fe-328f2d1cd527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f9a16bb4-3c0f-47a7-b50b-a52eda3fb799 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24553286-4b0a-4f32-86be-2c852bc72fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f9a16bb4-3c0f-47a7-b50b-a52eda3fb799 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24553286-4b0a-4f32-86be-2c852bc72fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13f7bb77-4aed-4900-89e2-dd8a858c05df', 'volume_name': 'volume-13f7bb77-4aed-4900-89e2-dd8a858c05df', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f9a16bb4-3c0f-47a7-b50b-a52eda3fb799 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df6b9e9b-af9d-47b7-ac79-a2e81f24a7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:07 devstack sudo[99011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd.effad0c3-17c9-43fa-a524-7c35e24efb09 Nov 03 20:27:07 devstack sudo[99011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f9a16bb4-3c0f-47a7-b50b-a52eda3fb799 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df6b9e9b-af9d-47b7-ac79-a2e81f24a7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f9a16bb4-3c0f-47a7-b50b-a52eda3fb799 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a31ae1ec-bec7-4686-958c-44d4bb60c911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:07 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-f9a16bb4-3c0f-47a7-b50b-a52eda3fb799 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Volume 13f7bb77-4aed-4900-89e2-dd8a858c05df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13f7bb77-4aed-4900-89e2-dd8a858c05df', 'volume_size': 1} Nov 03 20:27:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f9a16bb4-3c0f-47a7-b50b-a52eda3fb799 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:08 devstack sudo[99011]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e77a7e9b-434e-49d5-9b0e-7254250b2d90 tempest-VolumesSnapshotTestJSON-522224620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd.effad0c3-17c9-43fa-a524-7c35e24efb09" returned: 0 in 1.065s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:08 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-e77a7e9b-434e-49d5-9b0e-7254250b2d90 tempest-VolumesSnapshotTestJSON-522224620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3918446d-e8d4-47bf-87e6-faac233e4bdd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:27:08 devstack sudo[99007]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75807ade-5666-4e6f-84c7-e447304bbd8f tempest-TestServerVolumeAttachmentScenario-1934017498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-32f63e3e-a888-48e8-82aa-6d035c6360fa 1073741824" returned: 0 in 1.342s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:08 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8047ccc-7d19-40f9-b0fe-1584e31994bf]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e77a7e9b-434e-49d5-9b0e-7254250b2d90 tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75807ade-5666-4e6f-84c7-e447304bbd8f tempest-TestServerVolumeAttachmentScenario-1934017498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-32f63e3e-a888-48e8-82aa-6d035c6360fa {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:08 devstack sudo[99032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-32f63e3e-a888-48e8-82aa-6d035c6360fa Nov 03 20:27:08 devstack sudo[99032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:08 devstack sudo[99031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd Nov 03 20:27:08 devstack sudo[99031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:08 devstack sudo[99032]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75807ade-5666-4e6f-84c7-e447304bbd8f tempest-TestServerVolumeAttachmentScenario-1934017498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-32f63e3e-a888-48e8-82aa-6d035c6360fa" returned: 0 in 0.579s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:08 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75807ade-5666-4e6f-84c7-e447304bbd8f tempest-TestServerVolumeAttachmentScenario-1934017498 None] <== create_volume: return (2057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:27:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75807ade-5666-4e6f-84c7-e447304bbd8f tempest-TestServerVolumeAttachmentScenario-1934017498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.068s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f9a16bb4-3c0f-47a7-b50b-a52eda3fb799 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.368s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:08 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-f9a16bb4-3c0f-47a7-b50b-a52eda3fb799 tempest-TestServerVolumeAttachmentScenario-1934017498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-999374236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13f7bb77-4aed-4900-89e2-dd8a858c05df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7480b7bffaa643cda34f309316e1ff6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:07Z,use_quota=True,user_id='db2a034d19914f0d8e37c6c06fdef7d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:27:08 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-f9a16bb4-3c0f-47a7-b50b-a52eda3fb799 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Creating volume 13f7bb77-4aed-4900-89e2-dd8a858c05df {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:27:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f9a16bb4-3c0f-47a7-b50b-a52eda3fb799 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f9a16bb4-3c0f-47a7-b50b-a52eda3fb799 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:08 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-f9a16bb4-3c0f-47a7-b50b-a52eda3fb799 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:08 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-f9a16bb4-3c0f-47a7-b50b-a52eda3fb799 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f9a16bb4-3c0f-47a7-b50b-a52eda3fb799 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:08 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-f9a16bb4-3c0f-47a7-b50b-a52eda3fb799 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:27:08 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-f9a16bb4-3c0f-47a7-b50b-a52eda3fb799 tempest-TestServerVolumeAttachmentScenario-1934017498 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:27:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f9a16bb4-3c0f-47a7-b50b-a52eda3fb799 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-13f7bb77-4aed-4900-89e2-dd8a858c05df 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:09 devstack sudo[99039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-13f7bb77-4aed-4900-89e2-dd8a858c05df 1073741824 Nov 03 20:27:09 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75807ade-5666-4e6f-84c7-e447304bbd8f tempest-TestServerVolumeAttachmentScenario-1934017498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b43cb3a1-5881-4479-80c1-a2c459b691dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32f63e3e-a888-48e8-82aa-6d035c6360fa', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:09 devstack sudo[99039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:09 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75807ade-5666-4e6f-84c7-e447304bbd8f tempest-TestServerVolumeAttachmentScenario-1934017498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29e6a854-7714-42ee-9eea-c5cbeb035102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:09 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-75807ade-5666-4e6f-84c7-e447304bbd8f tempest-TestServerVolumeAttachmentScenario-1934017498 None] Volume volume-32f63e3e-a888-48e8-82aa-6d035c6360fa (32f63e3e-a888-48e8-82aa-6d035c6360fa): created successfully Nov 03 20:27:09 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75807ade-5666-4e6f-84c7-e447304bbd8f tempest-TestServerVolumeAttachmentScenario-1934017498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29e6a854-7714-42ee-9eea-c5cbeb035102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:09 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75807ade-5666-4e6f-84c7-e447304bbd8f tempest-TestServerVolumeAttachmentScenario-1934017498 None] Flow 'volume_create_manager' (489ae43e-25e8-4d47-b458-8aa9889a86bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:09 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-75807ade-5666-4e6f-84c7-e447304bbd8f tempest-TestServerVolumeAttachmentScenario-1934017498 None] Created volume successfully. Nov 03 20:27:09 devstack sudo[99031]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e77a7e9b-434e-49d5-9b0e-7254250b2d90 tempest-VolumesSnapshotTestJSON-522224620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd" returned: 0 in 1.158s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e77a7e9b-434e-49d5-9b0e-7254250b2d90 tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd.effad0c3-17c9-43fa-a524-7c35e24efb09 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:09 devstack sudo[99042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd.effad0c3-17c9-43fa-a524-7c35e24efb09 Nov 03 20:27:09 devstack sudo[99042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:09 devstack sudo[99039]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f9a16bb4-3c0f-47a7-b50b-a52eda3fb799 tempest-TestServerVolumeAttachmentScenario-1934017498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-13f7bb77-4aed-4900-89e2-dd8a858c05df 1073741824" returned: 0 in 0.981s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f9a16bb4-3c0f-47a7-b50b-a52eda3fb799 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-13f7bb77-4aed-4900-89e2-dd8a858c05df {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:10 devstack sudo[99051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-13f7bb77-4aed-4900-89e2-dd8a858c05df Nov 03 20:27:10 devstack sudo[99051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:10 devstack sudo[99042]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e77a7e9b-434e-49d5-9b0e-7254250b2d90 tempest-VolumesSnapshotTestJSON-522224620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd.effad0c3-17c9-43fa-a524-7c35e24efb09" returned: 0 in 0.641s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e77a7e9b-434e-49d5-9b0e-7254250b2d90 tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd.effad0c3-17c9-43fa-a524-7c35e24efb09 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:10 devstack sudo[99053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd.effad0c3-17c9-43fa-a524-7c35e24efb09 Nov 03 20:27:10 devstack sudo[99053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:10 devstack sudo[99051]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f9a16bb4-3c0f-47a7-b50b-a52eda3fb799 tempest-TestServerVolumeAttachmentScenario-1934017498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-13f7bb77-4aed-4900-89e2-dd8a858c05df" returned: 0 in 0.401s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:10 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-f9a16bb4-3c0f-47a7-b50b-a52eda3fb799 tempest-TestServerVolumeAttachmentScenario-1934017498 None] <== create_volume: return (1442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:27:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f9a16bb4-3c0f-47a7-b50b-a52eda3fb799 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.449s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:10 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f9a16bb4-3c0f-47a7-b50b-a52eda3fb799 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a31ae1ec-bec7-4686-958c-44d4bb60c911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13f7bb77-4aed-4900-89e2-dd8a858c05df', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:10 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f9a16bb4-3c0f-47a7-b50b-a52eda3fb799 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cca1686e-1086-4adb-a5b4-3e62977215be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:10 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-f9a16bb4-3c0f-47a7-b50b-a52eda3fb799 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Volume volume-13f7bb77-4aed-4900-89e2-dd8a858c05df (13f7bb77-4aed-4900-89e2-dd8a858c05df): created successfully Nov 03 20:27:10 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f9a16bb4-3c0f-47a7-b50b-a52eda3fb799 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cca1686e-1086-4adb-a5b4-3e62977215be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:10 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f9a16bb4-3c0f-47a7-b50b-a52eda3fb799 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Flow 'volume_create_manager' (3ae8f392-606f-4e13-80b9-1918cc3fa5da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:10 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-f9a16bb4-3c0f-47a7-b50b-a52eda3fb799 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Created volume successfully. Nov 03 20:27:10 devstack sudo[99053]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e77a7e9b-434e-49d5-9b0e-7254250b2d90 tempest-VolumesSnapshotTestJSON-522224620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd.effad0c3-17c9-43fa-a524-7c35e24efb09" returned: 0 in 0.451s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:10 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e77a7e9b-434e-49d5-9b0e-7254250b2d90 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "cinder-quobyte-effad0c3-17c9-43fa-a524-7c35e24efb09" released by "_delete_snapshot" :: held 3.599s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:10 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e77a7e9b-434e-49d5-9b0e-7254250b2d90 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "cinder-quobyte-3918446d-e8d4-47bf-87e6-faac233e4bdd" released by "delete_snapshot" :: held 3.661s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:10 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-e77a7e9b-434e-49d5-9b0e-7254250b2d90 tempest-VolumesSnapshotTestJSON-522224620 None] Created reservations ['d27882ca-c430-4927-9bef-e43845b4fa9d', '3585b946-7a14-4499-b38d-15585010bcd9', '99eff6f7-8325-4b1b-a05a-3e882cebb899', 'e68405dd-382c-4d83-a7bf-f0b528598a62'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:27:10 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-e77a7e9b-434e-49d5-9b0e-7254250b2d90 tempest-VolumesSnapshotTestJSON-522224620 None] Delete snapshot completed successfully. Nov 03 20:27:10 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e77a7e9b-434e-49d5-9b0e-7254250b2d90 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "cinder-effad0c3-17c9-43fa-a524-7c35e24efb09-delete_snapshot" released by "delete_snapshot" :: held 4.101s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:11 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-eca8f4c0-4ba6-46dd-a302-9f0495826345 tempest-VolumesSnapshotTestJSON-522224620 None] Acquiring lock "cinder-3918446d-e8d4-47bf-87e6-faac233e4bdd-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:11 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-eca8f4c0-4ba6-46dd-a302-9f0495826345 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "cinder-3918446d-e8d4-47bf-87e6-faac233e4bdd-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:11 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-eca8f4c0-4ba6-46dd-a302-9f0495826345 tempest-VolumesSnapshotTestJSON-522224620 None] Acquiring lock "cinder-quobyte-3918446d-e8d4-47bf-87e6-faac233e4bdd" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:11 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-eca8f4c0-4ba6-46dd-a302-9f0495826345 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "cinder-quobyte-3918446d-e8d4-47bf-87e6-faac233e4bdd" acquired by "delete_volume" :: waited 0.043s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:11 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19d29dc-087f-4d27-9253-774d97b48cf5]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-eca8f4c0-4ba6-46dd-a302-9f0495826345 tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:11 devstack sudo[99057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd Nov 03 20:27:11 devstack sudo[99057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:11 devstack sudo[99057]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-eca8f4c0-4ba6-46dd-a302-9f0495826345 tempest-VolumesSnapshotTestJSON-522224620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd" returned: 0 in 0.444s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-eca8f4c0-4ba6-46dd-a302-9f0495826345 tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:11 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd Nov 03 20:27:11 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:12 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-eca8f4c0-4ba6-46dd-a302-9f0495826345 tempest-VolumesSnapshotTestJSON-522224620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3918446d-e8d4-47bf-87e6-faac233e4bdd" returned: 0 in 0.375s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:12 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-eca8f4c0-4ba6-46dd-a302-9f0495826345 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "cinder-quobyte-3918446d-e8d4-47bf-87e6-faac233e4bdd" released by "delete_volume" :: held 0.916s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:12 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-eca8f4c0-4ba6-46dd-a302-9f0495826345 tempest-VolumesSnapshotTestJSON-522224620 None] Created reservations ['786ab515-80e2-4401-b615-726925a91e7e', '051a8bb5-289d-4ac6-ac83-1bd58be5cd10', 'd224f56c-014c-4e41-85bc-94cfa2d1dabd', '5ecdf329-a75b-4ef7-a092-233525f2fdc1'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:27:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-eca8f4c0-4ba6-46dd-a302-9f0495826345 tempest-VolumesSnapshotTestJSON-522224620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-eca8f4c0-4ba6-46dd-a302-9f0495826345 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:12 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-eca8f4c0-4ba6-46dd-a302-9f0495826345 tempest-VolumesSnapshotTestJSON-522224620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:12 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-eca8f4c0-4ba6-46dd-a302-9f0495826345 tempest-VolumesSnapshotTestJSON-522224620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-eca8f4c0-4ba6-46dd-a302-9f0495826345 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-eca8f4c0-4ba6-46dd-a302-9f0495826345 tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:12 devstack sudo[99067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:27:12 devstack sudo[99067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:12 devstack sudo[99067]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-eca8f4c0-4ba6-46dd-a302-9f0495826345 tempest-VolumesSnapshotTestJSON-522224620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.321s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:12 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-eca8f4c0-4ba6-46dd-a302-9f0495826345 tempest-VolumesSnapshotTestJSON-522224620 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:27:12 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-eca8f4c0-4ba6-46dd-a302-9f0495826345 tempest-VolumesSnapshotTestJSON-522224620 None] Deleted volume successfully. Nov 03 20:27:12 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-eca8f4c0-4ba6-46dd-a302-9f0495826345 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "cinder-3918446d-e8d4-47bf-87e6-faac233e4bdd-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:14 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd4c3e7b-27fc-4784-9f8b-1c11646b2288 tempest-VolumesSnapshotTestJSON-522224620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:27:14 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cd4c3e7b-27fc-4784-9f8b-1c11646b2288 tempest-VolumesSnapshotTestJSON-522224620 None] Flow 'volume_create_manager' (6b46f6c5-acef-4c3e-88a3-0deca340e7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:14 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cd4c3e7b-27fc-4784-9f8b-1c11646b2288 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5cd7609-250f-477d-b845-cde15405098f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:14 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cd4c3e7b-27fc-4784-9f8b-1c11646b2288 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5cd7609-250f-477d-b845-cde15405098f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1911331807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c62b2db-1251-4880-9268-2bb9bb74690d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0eda3dd5b2d4d3bad6105060920664a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:14Z,use_quota=True,user_id='16b43c64364a4e9e9bf532514e566bc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:14 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cd4c3e7b-27fc-4784-9f8b-1c11646b2288 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7015f6af-aeec-4263-be6e-4349b29195b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:14 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cd4c3e7b-27fc-4784-9f8b-1c11646b2288 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7015f6af-aeec-4263-be6e-4349b29195b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:14 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cd4c3e7b-27fc-4784-9f8b-1c11646b2288 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a15f2da1-460f-40e9-b060-dc55c950000b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:14 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cd4c3e7b-27fc-4784-9f8b-1c11646b2288 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a15f2da1-460f-40e9-b060-dc55c950000b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c62b2db-1251-4880-9268-2bb9bb74690d', 'volume_name': 'volume-3c62b2db-1251-4880-9268-2bb9bb74690d', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:14 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cd4c3e7b-27fc-4784-9f8b-1c11646b2288 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09ff48d7-a61c-445d-b58c-986a95226e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:14 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cd4c3e7b-27fc-4784-9f8b-1c11646b2288 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09ff48d7-a61c-445d-b58c-986a95226e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:14 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cd4c3e7b-27fc-4784-9f8b-1c11646b2288 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78d83eea-72b3-4a26-9b5f-c74275a29eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:14 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-cd4c3e7b-27fc-4784-9f8b-1c11646b2288 tempest-VolumesSnapshotTestJSON-522224620 None] Volume 3c62b2db-1251-4880-9268-2bb9bb74690d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c62b2db-1251-4880-9268-2bb9bb74690d', 'volume_size': 1} Nov 03 20:27:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-cd4c3e7b-27fc-4784-9f8b-1c11646b2288 tempest-VolumesSnapshotTestJSON-522224620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-cd4c3e7b-27fc-4784-9f8b-1c11646b2288 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:14 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-cd4c3e7b-27fc-4784-9f8b-1c11646b2288 tempest-VolumesSnapshotTestJSON-522224620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1911331807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c62b2db-1251-4880-9268-2bb9bb74690d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0eda3dd5b2d4d3bad6105060920664a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:14Z,use_quota=True,user_id='16b43c64364a4e9e9bf532514e566bc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:27:14 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-cd4c3e7b-27fc-4784-9f8b-1c11646b2288 tempest-VolumesSnapshotTestJSON-522224620 None] Creating volume 3c62b2db-1251-4880-9268-2bb9bb74690d {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:27:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-cd4c3e7b-27fc-4784-9f8b-1c11646b2288 tempest-VolumesSnapshotTestJSON-522224620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-cd4c3e7b-27fc-4784-9f8b-1c11646b2288 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:14 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-cd4c3e7b-27fc-4784-9f8b-1c11646b2288 tempest-VolumesSnapshotTestJSON-522224620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:14 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-cd4c3e7b-27fc-4784-9f8b-1c11646b2288 tempest-VolumesSnapshotTestJSON-522224620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-cd4c3e7b-27fc-4784-9f8b-1c11646b2288 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:14 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-cd4c3e7b-27fc-4784-9f8b-1c11646b2288 tempest-VolumesSnapshotTestJSON-522224620 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:27:14 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-cd4c3e7b-27fc-4784-9f8b-1c11646b2288 tempest-VolumesSnapshotTestJSON-522224620 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:27:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cd4c3e7b-27fc-4784-9f8b-1c11646b2288 tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:14 devstack sudo[99072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d 1073741824 Nov 03 20:27:14 devstack sudo[99072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:14 devstack sudo[99072]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cd4c3e7b-27fc-4784-9f8b-1c11646b2288 tempest-VolumesSnapshotTestJSON-522224620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d 1073741824" returned: 0 in 0.600s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cd4c3e7b-27fc-4784-9f8b-1c11646b2288 tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:15 devstack sudo[99080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d Nov 03 20:27:15 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:15 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cd4c3e7b-27fc-4784-9f8b-1c11646b2288 tempest-VolumesSnapshotTestJSON-522224620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d" returned: 0 in 0.505s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:15 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-cd4c3e7b-27fc-4784-9f8b-1c11646b2288 tempest-VolumesSnapshotTestJSON-522224620 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:27:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-cd4c3e7b-27fc-4784-9f8b-1c11646b2288 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cd4c3e7b-27fc-4784-9f8b-1c11646b2288 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78d83eea-72b3-4a26-9b5f-c74275a29eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c62b2db-1251-4880-9268-2bb9bb74690d', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cd4c3e7b-27fc-4784-9f8b-1c11646b2288 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7a711db-7730-4ced-856a-9f1ed6300fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:15 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-cd4c3e7b-27fc-4784-9f8b-1c11646b2288 tempest-VolumesSnapshotTestJSON-522224620 None] Volume volume-3c62b2db-1251-4880-9268-2bb9bb74690d (3c62b2db-1251-4880-9268-2bb9bb74690d): created successfully Nov 03 20:27:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cd4c3e7b-27fc-4784-9f8b-1c11646b2288 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7a711db-7730-4ced-856a-9f1ed6300fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cd4c3e7b-27fc-4784-9f8b-1c11646b2288 tempest-VolumesSnapshotTestJSON-522224620 None] Flow 'volume_create_manager' (6b46f6c5-acef-4c3e-88a3-0deca340e7d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:15 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-cd4c3e7b-27fc-4784-9f8b-1c11646b2288 tempest-VolumesSnapshotTestJSON-522224620 None] Created volume successfully. Nov 03 20:27:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-598df18b-a964-48e8-9c0a-092786efd294 tempest-VolumesSnapshotTestJSON-522224620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-598df18b-a964-48e8-9c0a-092786efd294 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:16 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-598df18b-a964-48e8-9c0a-092786efd294 tempest-VolumesSnapshotTestJSON-522224620 None] Creating offline snapshot 89c322bb-64bf-490f-8d70-0b3117c18ebe of volume 3c62b2db-1251-4880-9268-2bb9bb74690d {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:27:16 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3249bc1-4f40-4ca1-8ea6-b2c06143cb0e]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-598df18b-a964-48e8-9c0a-092786efd294 tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:16 devstack sudo[99087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d Nov 03 20:27:16 devstack sudo[99087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:17 devstack sudo[99087]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-598df18b-a964-48e8-9c0a-092786efd294 tempest-VolumesSnapshotTestJSON-522224620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d" returned: 0 in 0.642s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-598df18b-a964-48e8-9c0a-092786efd294 tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d.89c322bb-64bf-490f-8d70-0b3117c18ebe 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:17 devstack sudo[99094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d.89c322bb-64bf-490f-8d70-0b3117c18ebe 1G Nov 03 20:27:17 devstack sudo[99094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:18 devstack sudo[99094]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-598df18b-a964-48e8-9c0a-092786efd294 tempest-VolumesSnapshotTestJSON-522224620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d.89c322bb-64bf-490f-8d70-0b3117c18ebe 1G" returned: 0 in 0.657s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-598df18b-a964-48e8-9c0a-092786efd294 tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c62b2db-1251-4880-9268-2bb9bb74690d -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d.89c322bb-64bf-490f-8d70-0b3117c18ebe {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:18 devstack sudo[99103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c62b2db-1251-4880-9268-2bb9bb74690d -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d.89c322bb-64bf-490f-8d70-0b3117c18ebe Nov 03 20:27:18 devstack sudo[99103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:18 devstack sudo[99103]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-598df18b-a964-48e8-9c0a-092786efd294 tempest-VolumesSnapshotTestJSON-522224620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c62b2db-1251-4880-9268-2bb9bb74690d -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d.89c322bb-64bf-490f-8d70-0b3117c18ebe" returned: 0 in 0.545s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:18 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-598df18b-a964-48e8-9c0a-092786efd294 tempest-VolumesSnapshotTestJSON-522224620 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d.89c322bb-64bf-490f-8d70-0b3117c18ebe is being set with open permissions: ugo+rw Nov 03 20:27:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-598df18b-a964-48e8-9c0a-092786efd294 tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d.89c322bb-64bf-490f-8d70-0b3117c18ebe {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:18 devstack sudo[99116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d.89c322bb-64bf-490f-8d70-0b3117c18ebe Nov 03 20:27:18 devstack sudo[99116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:19 devstack sudo[99116]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-598df18b-a964-48e8-9c0a-092786efd294 tempest-VolumesSnapshotTestJSON-522224620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d.89c322bb-64bf-490f-8d70-0b3117c18ebe" returned: 0 in 0.486s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-598df18b-a964-48e8-9c0a-092786efd294 tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:19 devstack sudo[99125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d.info Nov 03 20:27:19 devstack sudo[99125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:19 devstack sudo[99125]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-598df18b-a964-48e8-9c0a-092786efd294 tempest-VolumesSnapshotTestJSON-522224620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d.info" returned: 0 in 0.417s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:19 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-598df18b-a964-48e8-9c0a-092786efd294 tempest-VolumesSnapshotTestJSON-522224620 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d.info is being set with open permissions: ugo+rw Nov 03 20:27:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-598df18b-a964-48e8-9c0a-092786efd294 tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:19 devstack sudo[99128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d.info Nov 03 20:27:19 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:19 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-598df18b-a964-48e8-9c0a-092786efd294 tempest-VolumesSnapshotTestJSON-522224620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d.info" returned: 0 in 0.343s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-598df18b-a964-48e8-9c0a-092786efd294 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.256s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:20 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-598df18b-a964-48e8-9c0a-092786efd294 tempest-VolumesSnapshotTestJSON-522224620 None] Create snapshot completed successfully Nov 03 20:27:21 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:27:21 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] Flow 'volume_create_manager' (30201187-1e8a-4d98-82a9-cf115ecd2315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:21 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96487f51-8103-4a4c-8ac4-5f9c3fe0dfdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:21 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96487f51-8103-4a4c-8ac4-5f9c3fe0dfdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1334392679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3637d9cb-12e5-456a-8daa-948a63603909,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0eda3dd5b2d4d3bad6105060920664a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=89c322bb-64bf-490f-8d70-0b3117c18ebe,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:22Z,use_quota=True,user_id='16b43c64364a4e9e9bf532514e566bc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:21 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f4d5c85-5469-45df-9a7b-2c521dfa9b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:21 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f4d5c85-5469-45df-9a7b-2c521dfa9b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:21 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (637eeacb-59c7-45a3-a642-4055ae2c215a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:21 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (637eeacb-59c7-45a3-a642-4055ae2c215a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3637d9cb-12e5-456a-8daa-948a63603909', 'volume_name': 'volume-3637d9cb-12e5-456a-8daa-948a63603909', 'volume_size': 1, 'snapshot_id': '89c322bb-64bf-490f-8d70-0b3117c18ebe'}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:21 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (745c599d-9d53-4847-9b80-6d435bba32a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:21 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (745c599d-9d53-4847-9b80-6d435bba32a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:21 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a34233d-5973-45c4-9363-f865e19436f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:21 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] Volume 3637d9cb-12e5-456a-8daa-948a63603909: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3637d9cb-12e5-456a-8daa-948a63603909', 'volume_size': 1, 'snapshot_id': '89c322bb-64bf-490f-8d70-0b3117c18ebe'} Nov 03 20:27:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:21 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] Acquiring lock "cinder-quobyte-89c322bb-64bf-490f-8d70-0b3117c18ebe-3637d9cb-12e5-456a-8daa-948a63603909" by "_create_volume_from_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:21 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "cinder-quobyte-89c322bb-64bf-490f-8d70-0b3117c18ebe-3637d9cb-12e5-456a-8daa-948a63603909" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] Creating volume 3637d9cb-12e5-456a-8daa-948a63603909 from snapshot 89c322bb-64bf-490f-8d70-0b3117c18ebe {{(pid=87248) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 20:27:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:27:21 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] Acquiring lock "cinder-quobyte-3637d9cb-12e5-456a-8daa-948a63603909" by "_copy_volume_from_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:21 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "cinder-quobyte-3637d9cb-12e5-456a-8daa-948a63603909" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] snapshot: 89c322bb-64bf-490f-8d70-0b3117c18ebe, volume: 3637d9cb-12e5-456a-8daa-948a63603909, {{(pid=87248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 20:27:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:21 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56a7e34-503d-4135-8256-7637df9a8a36]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d.89c322bb-64bf-490f-8d70-0b3117c18ebe {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:22 devstack sudo[99149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d.89c322bb-64bf-490f-8d70-0b3117c18ebe Nov 03 20:27:22 devstack sudo[99149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:22 devstack sudo[99149]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d.89c322bb-64bf-490f-8d70-0b3117c18ebe" returned: 0 in 0.499s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:22 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c62b2db-1251-4880-9268-2bb9bb74690d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:27:22 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1e0183-b3ba-4c9b-b496-591055679d83]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:22 devstack sudo[99155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d Nov 03 20:27:22 devstack sudo[99155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:22 devstack sudo[99155]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d" returned: 0 in 0.392s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:22 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d {{(pid=87248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 20:27:22 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] Creating direct copy from snapshot {{(pid=87248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 20:27:22 devstack cinder-volume[87248]: DEBUG cinder.utils [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] Path /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3637d9cb-12e5-456a-8daa-948a63603909 not found in is_blk_device check {{(pid=87248) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 20:27:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3637d9cb-12e5-456a-8daa-948a63603909 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:22 devstack sudo[99160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3637d9cb-12e5-456a-8daa-948a63603909 Nov 03 20:27:22 devstack sudo[99160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:28 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fb4e4c5-b628-4fd1-b167-ce5ae5f5faee tempest-TestInstancesWithCinderVolumes-1364232362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:27:28 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6fb4e4c5-b628-4fd1-b167-ce5ae5f5faee tempest-TestInstancesWithCinderVolumes-1364232362 None] Flow 'volume_create_manager' (792ea5d6-7080-4bae-bf9d-bd76504cb96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:28 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6fb4e4c5-b628-4fd1-b167-ce5ae5f5faee tempest-TestInstancesWithCinderVolumes-1364232362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12889481-9adb-4385-80f3-b0be02757c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:28 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6fb4e4c5-b628-4fd1-b167-ce5ae5f5faee tempest-TestInstancesWithCinderVolumes-1364232362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12889481-9adb-4385-80f3-b0be02757c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-8743234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a6e7754-b982-4708-9157-21b031d891f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b2281b411224c8b8f09460b67083407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:28Z,use_quota=True,user_id='8dad908086e94e26a823e5a6c068eeaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8cf2faea-ccbc-4937-90f4-08a122e3c7c8),volume_type_id=8cf2faea-ccbc-4937-90f4-08a122e3c7c8)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:28 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6fb4e4c5-b628-4fd1-b167-ce5ae5f5faee tempest-TestInstancesWithCinderVolumes-1364232362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd4ed17b-9ff9-4e66-be0e-45a3245148f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:28 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6fb4e4c5-b628-4fd1-b167-ce5ae5f5faee tempest-TestInstancesWithCinderVolumes-1364232362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd4ed17b-9ff9-4e66-be0e-45a3245148f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:28 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6fb4e4c5-b628-4fd1-b167-ce5ae5f5faee tempest-TestInstancesWithCinderVolumes-1364232362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb506b25-189e-4621-8f45-05d744047bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:28 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6fb4e4c5-b628-4fd1-b167-ce5ae5f5faee tempest-TestInstancesWithCinderVolumes-1364232362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb506b25-189e-4621-8f45-05d744047bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a6e7754-b982-4708-9157-21b031d891f3', 'volume_name': 'volume-8a6e7754-b982-4708-9157-21b031d891f3', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:28 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6fb4e4c5-b628-4fd1-b167-ce5ae5f5faee tempest-TestInstancesWithCinderVolumes-1364232362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b88a9e2e-c04e-4732-afc1-da1397509e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:28 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6fb4e4c5-b628-4fd1-b167-ce5ae5f5faee tempest-TestInstancesWithCinderVolumes-1364232362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b88a9e2e-c04e-4732-afc1-da1397509e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:28 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6fb4e4c5-b628-4fd1-b167-ce5ae5f5faee tempest-TestInstancesWithCinderVolumes-1364232362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01e90514-bbd5-482c-94f1-820149905165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:28 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-6fb4e4c5-b628-4fd1-b167-ce5ae5f5faee tempest-TestInstancesWithCinderVolumes-1364232362 None] Volume 8a6e7754-b982-4708-9157-21b031d891f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a6e7754-b982-4708-9157-21b031d891f3', 'volume_size': 1} Nov 03 20:27:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6fb4e4c5-b628-4fd1-b167-ce5ae5f5faee tempest-TestInstancesWithCinderVolumes-1364232362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:28 devstack cinder-volume[87248]: DEBUG oslo_service.periodic_task [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:27:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:28 devstack sudo[99257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:27:28 devstack sudo[99257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:29 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d2a01da-4a5e-4544-978b-c5a092987db3 tempest-TestInstancesWithCinderVolumes-1364232362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:27:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4d2a01da-4a5e-4544-978b-c5a092987db3 tempest-TestInstancesWithCinderVolumes-1364232362 None] Flow 'volume_create_manager' (25f8ce66-4a48-4fc4-a78f-8211a06f6b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:29 devstack sudo[99257]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4d2a01da-4a5e-4544-978b-c5a092987db3 tempest-TestInstancesWithCinderVolumes-1364232362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b7b2a8b-4157-494a-a649-dadd6e6ee0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 1.221s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:30 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:27:30 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4d2a01da-4a5e-4544-978b-c5a092987db3 tempest-TestInstancesWithCinderVolumes-1364232362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b7b2a8b-4157-494a-a649-dadd6e6ee0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-156780474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e012b197-88b6-4680-92de-40ca908ff3a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b2281b411224c8b8f09460b67083407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:30Z,use_quota=True,user_id='8dad908086e94e26a823e5a6c068eeaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e18fdf71-3356-4bf2-a102-c5861a3cc87e),volume_type_id=e18fdf71-3356-4bf2-a102-c5861a3cc87e)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:30 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4d2a01da-4a5e-4544-978b-c5a092987db3 tempest-TestInstancesWithCinderVolumes-1364232362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0119faa-490d-47e8-8550-20ba61042745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:30 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4d2a01da-4a5e-4544-978b-c5a092987db3 tempest-TestInstancesWithCinderVolumes-1364232362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0119faa-490d-47e8-8550-20ba61042745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:30 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4d2a01da-4a5e-4544-978b-c5a092987db3 tempest-TestInstancesWithCinderVolumes-1364232362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7c0d58c-b8ea-4cbc-8216-e94feb6dc9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:30 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4d2a01da-4a5e-4544-978b-c5a092987db3 tempest-TestInstancesWithCinderVolumes-1364232362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7c0d58c-b8ea-4cbc-8216-e94feb6dc9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e012b197-88b6-4680-92de-40ca908ff3a4', 'volume_name': 'volume-e012b197-88b6-4680-92de-40ca908ff3a4', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:30 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4d2a01da-4a5e-4544-978b-c5a092987db3 tempest-TestInstancesWithCinderVolumes-1364232362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f306c15-f130-49d9-900f-fc287026d1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:30 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4d2a01da-4a5e-4544-978b-c5a092987db3 tempest-TestInstancesWithCinderVolumes-1364232362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f306c15-f130-49d9-900f-fc287026d1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:30 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4d2a01da-4a5e-4544-978b-c5a092987db3 tempest-TestInstancesWithCinderVolumes-1364232362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bfc2d20-8a3d-4037-b119-8d63d37dc209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:30 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-4d2a01da-4a5e-4544-978b-c5a092987db3 tempest-TestInstancesWithCinderVolumes-1364232362 None] Volume e012b197-88b6-4680-92de-40ca908ff3a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e012b197-88b6-4680-92de-40ca908ff3a4', 'volume_size': 1} Nov 03 20:27:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4d2a01da-4a5e-4544-978b-c5a092987db3 tempest-TestInstancesWithCinderVolumes-1364232362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:30 devstack cinder-volume[87248]: DEBUG oslo_service.periodic_task [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running periodic task VolumeManager._thread_info {{(pid=87248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:27:30 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] thread count: 28 {{(pid=87248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:27:30 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] thread info: [<_MainThread(MainThread, started 124862067372160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:27:32 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:27:32 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Flow 'volume_create_manager' (2f1c44f2-f7c3-4b3b-8600-e211a1b6774e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:32 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67cb7cab-1c7c-4f91-b5f6-4c9c99d91f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:32 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67cb7cab-1c7c-4f91-b5f6-4c9c99d91f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-179166760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73b150f6-b10c-422d-9de8-3fac99321fe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b2281b411224c8b8f09460b67083407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:32Z,use_quota=True,user_id='8dad908086e94e26a823e5a6c068eeaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eebf51df-fba0-4a4e-b997-733cfce832f4),volume_type_id=eebf51df-fba0-4a4e-b997-733cfce832f4)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:32 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32534a68-306b-40e6-b39e-6bb022de895c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:32 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32534a68-306b-40e6-b39e-6bb022de895c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:32 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0abc728-d57a-4b4b-a287-d04cff3431fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:32 devstack cinder-volume[87248]: DEBUG cinder.image.glance [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Creating Keystone auth plugin from conf {{(pid=87248) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 20:27:33 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0abc728-d57a-4b4b-a287-d04cff3431fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '73b150f6-b10c-422d-9de8-3fac99321fe5', 'volume_name': 'volume-73b150f6-b10c-422d-9de8-3fac99321fe5', 'volume_size': 1, 'image_id': '8ee86bfb-a57f-4048-b83d-515011f348b5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8ee86bfb-a57f-4048-b83d-515011f348b5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2078603674', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9b2281b411224c8b8f09460b67083407', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8ee86bfb-a57f-4048-b83d-515011f348b5', 'created_at': datetime.datetime(2026, 11, 3, 19, 27, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 27, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8ee86bfb-a57f-4048-b83d-515011f348b5/file', 'properties': {}}, 'image_service': }' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:33 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (809ea12b-1edf-4245-88c7-d34c30cf5cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:33 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (809ea12b-1edf-4245-88c7-d34c30cf5cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:33 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd405baf-7761-4e29-941c-dc332ada6e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:33 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Volume 73b150f6-b10c-422d-9de8-3fac99321fe5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-73b150f6-b10c-422d-9de8-3fac99321fe5', 'volume_size': 1, 'image_id': '8ee86bfb-a57f-4048-b83d-515011f348b5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8ee86bfb-a57f-4048-b83d-515011f348b5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2078603674', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9b2281b411224c8b8f09460b67083407', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8ee86bfb-a57f-4048-b83d-515011f348b5', 'created_at': datetime.datetime(2026, 11, 3, 19, 27, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 27, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8ee86bfb-a57f-4048-b83d-515011f348b5/file', 'properties': {}}, 'image_service': } Nov 03 20:27:33 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Trying to clone 73b150f6-b10c-422d-9de8-3fac99321fe5 from image 8ee86bfb-a57f-4048-b83d-515011f348b5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8ee86bfb-a57f-4048-b83d-515011f348b5', 'metadata': {}}]). {{(pid=87248) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 20:27:35 devstack sudo[99160]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3637d9cb-12e5-456a-8daa-948a63603909" returned: 0 in 12.377s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:35 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] Image conversion details: src /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d, size 1024.00 MB, duration 12.38 sec, destination /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3637d9cb-12e5-456a-8daa-948a63603909 {{(pid=87248) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:27:35 devstack cinder-volume[87248]: INFO cinder.image.image_utils [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] Converted 1024.00 MB image at 82.72 MB/s Nov 03 20:27:35 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3637d9cb-12e5-456a-8daa-948a63603909 is being set with open permissions: ugo+rw Nov 03 20:27:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3637d9cb-12e5-456a-8daa-948a63603909 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:35 devstack sudo[99265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3637d9cb-12e5-456a-8daa-948a63603909 Nov 03 20:27:35 devstack sudo[99265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:35 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-65d0206e-917a-406a-953e-681e626e2938 tempest-AttachVolumeNegativeTest-1262133860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:27:35 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-65d0206e-917a-406a-953e-681e626e2938 tempest-AttachVolumeNegativeTest-1262133860 None] Flow 'volume_create_manager' (53f51414-6a34-4903-96f8-2c09894a877b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:35 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-65d0206e-917a-406a-953e-681e626e2938 tempest-AttachVolumeNegativeTest-1262133860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (090d1ffb-e527-46ab-8d55-69fb51f05b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:35 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-65d0206e-917a-406a-953e-681e626e2938 tempest-AttachVolumeNegativeTest-1262133860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (090d1ffb-e527-46ab-8d55-69fb51f05b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1059654169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3641d0eb-4eea-4cbd-9fcd-39ffed509e27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0ca15c601f747d395e8d184a9e0e0ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:35Z,use_quota=True,user_id='b397ba0c98774898b6e0048d127232da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:35 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-65d0206e-917a-406a-953e-681e626e2938 tempest-AttachVolumeNegativeTest-1262133860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75cbe022-a7c3-4118-b497-eec39420ef3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:35 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-65d0206e-917a-406a-953e-681e626e2938 tempest-AttachVolumeNegativeTest-1262133860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75cbe022-a7c3-4118-b497-eec39420ef3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:35 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-65d0206e-917a-406a-953e-681e626e2938 tempest-AttachVolumeNegativeTest-1262133860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a68e12a8-f76d-454a-9004-db5709f738f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:35 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-65d0206e-917a-406a-953e-681e626e2938 tempest-AttachVolumeNegativeTest-1262133860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a68e12a8-f76d-454a-9004-db5709f738f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3641d0eb-4eea-4cbd-9fcd-39ffed509e27', 'volume_name': 'volume-3641d0eb-4eea-4cbd-9fcd-39ffed509e27', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:35 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-65d0206e-917a-406a-953e-681e626e2938 tempest-AttachVolumeNegativeTest-1262133860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d66e5f50-1718-43c2-b86d-1f97b4695cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:35 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-65d0206e-917a-406a-953e-681e626e2938 tempest-AttachVolumeNegativeTest-1262133860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d66e5f50-1718-43c2-b86d-1f97b4695cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:35 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-65d0206e-917a-406a-953e-681e626e2938 tempest-AttachVolumeNegativeTest-1262133860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3d07199-6401-419a-8511-8fa4e18bfff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:35 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-65d0206e-917a-406a-953e-681e626e2938 tempest-AttachVolumeNegativeTest-1262133860 None] Volume 3641d0eb-4eea-4cbd-9fcd-39ffed509e27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3641d0eb-4eea-4cbd-9fcd-39ffed509e27', 'volume_size': 1} Nov 03 20:27:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-65d0206e-917a-406a-953e-681e626e2938 tempest-AttachVolumeNegativeTest-1262133860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:35 devstack sudo[99265]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3637d9cb-12e5-456a-8daa-948a63603909" returned: 0 in 0.262s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:35 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "cinder-quobyte-3637d9cb-12e5-456a-8daa-948a63603909" released by "_copy_volume_from_snapshot" :: held 13.636s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:35 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "cinder-quobyte-89c322bb-64bf-490f-8d70-0b3117c18ebe-3637d9cb-12e5-456a-8daa-948a63603909" released by "_create_volume_from_snapshot" :: held 13.727s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.752s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6fb4e4c5-b628-4fd1-b167-ce5ae5f5faee tempest-TestInstancesWithCinderVolumes-1364232362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.315s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:35 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-6fb4e4c5-b628-4fd1-b167-ce5ae5f5faee tempest-TestInstancesWithCinderVolumes-1364232362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-8743234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a6e7754-b982-4708-9157-21b031d891f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b2281b411224c8b8f09460b67083407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:28Z,use_quota=True,user_id='8dad908086e94e26a823e5a6c068eeaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8cf2faea-ccbc-4937-90f4-08a122e3c7c8),volume_type_id=8cf2faea-ccbc-4937-90f4-08a122e3c7c8)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:27:35 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-6fb4e4c5-b628-4fd1-b167-ce5ae5f5faee tempest-TestInstancesWithCinderVolumes-1364232362 None] Creating volume 8a6e7754-b982-4708-9157-21b031d891f3 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:27:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6fb4e4c5-b628-4fd1-b167-ce5ae5f5faee tempest-TestInstancesWithCinderVolumes-1364232362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6fb4e4c5-b628-4fd1-b167-ce5ae5f5faee tempest-TestInstancesWithCinderVolumes-1364232362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:35 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-6fb4e4c5-b628-4fd1-b167-ce5ae5f5faee tempest-TestInstancesWithCinderVolumes-1364232362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:35 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-6fb4e4c5-b628-4fd1-b167-ce5ae5f5faee tempest-TestInstancesWithCinderVolumes-1364232362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6fb4e4c5-b628-4fd1-b167-ce5ae5f5faee tempest-TestInstancesWithCinderVolumes-1364232362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:35 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-6fb4e4c5-b628-4fd1-b167-ce5ae5f5faee tempest-TestInstancesWithCinderVolumes-1364232362 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:27:35 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-6fb4e4c5-b628-4fd1-b167-ce5ae5f5faee tempest-TestInstancesWithCinderVolumes-1364232362 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:27:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6fb4e4c5-b628-4fd1-b167-ce5ae5f5faee tempest-TestInstancesWithCinderVolumes-1364232362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8a6e7754-b982-4708-9157-21b031d891f3 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:35 devstack sudo[99268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8a6e7754-b982-4708-9157-21b031d891f3 1073741824 Nov 03 20:27:35 devstack sudo[99268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:35 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a34233d-5973-45c4-9363-f865e19436f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3637d9cb-12e5-456a-8daa-948a63603909', 'volume_size': 1, 'snapshot_id': '89c322bb-64bf-490f-8d70-0b3117c18ebe'}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:35 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a03ef52-0bd2-4e47-84f6-5de8d6584b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:35 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] Volume volume-3637d9cb-12e5-456a-8daa-948a63603909 (3637d9cb-12e5-456a-8daa-948a63603909): created successfully Nov 03 20:27:35 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a03ef52-0bd2-4e47-84f6-5de8d6584b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:35 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] Flow 'volume_create_manager' (30201187-1e8a-4d98-82a9-cf115ecd2315) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:35 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-49a4071b-9f0f-48cb-992d-67aa0f2d4ee8 tempest-VolumesSnapshotTestJSON-522224620 None] Created volume successfully. Nov 03 20:27:36 devstack sudo[99268]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6fb4e4c5-b628-4fd1-b167-ce5ae5f5faee tempest-TestInstancesWithCinderVolumes-1364232362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8a6e7754-b982-4708-9157-21b031d891f3 1073741824" returned: 0 in 0.541s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6fb4e4c5-b628-4fd1-b167-ce5ae5f5faee tempest-TestInstancesWithCinderVolumes-1364232362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8a6e7754-b982-4708-9157-21b031d891f3 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:36 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b3542cfc-b6b4-46ba-8318-fed25e0eb016 tempest-VolumesSnapshotTestJSON-522224620 None] Acquiring lock "cinder-3637d9cb-12e5-456a-8daa-948a63603909-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:36 devstack sudo[99274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8a6e7754-b982-4708-9157-21b031d891f3 Nov 03 20:27:36 devstack sudo[99274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:36 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b3542cfc-b6b4-46ba-8318-fed25e0eb016 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "cinder-3637d9cb-12e5-456a-8daa-948a63603909-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:36 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b3542cfc-b6b4-46ba-8318-fed25e0eb016 tempest-VolumesSnapshotTestJSON-522224620 None] Acquiring lock "cinder-quobyte-3637d9cb-12e5-456a-8daa-948a63603909" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:36 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b3542cfc-b6b4-46ba-8318-fed25e0eb016 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "cinder-quobyte-3637d9cb-12e5-456a-8daa-948a63603909" acquired by "delete_volume" :: waited 0.028s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:36 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf112c62-deba-4887-9e1e-005d0d3b8f95]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b3542cfc-b6b4-46ba-8318-fed25e0eb016 tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3637d9cb-12e5-456a-8daa-948a63603909 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:36 devstack sudo[99276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3637d9cb-12e5-456a-8daa-948a63603909 Nov 03 20:27:36 devstack sudo[99276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:36 devstack sudo[99274]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6fb4e4c5-b628-4fd1-b167-ce5ae5f5faee tempest-TestInstancesWithCinderVolumes-1364232362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8a6e7754-b982-4708-9157-21b031d891f3" returned: 0 in 0.366s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:36 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-6fb4e4c5-b628-4fd1-b167-ce5ae5f5faee tempest-TestInstancesWithCinderVolumes-1364232362 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:27:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6fb4e4c5-b628-4fd1-b167-ce5ae5f5faee tempest-TestInstancesWithCinderVolumes-1364232362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4d2a01da-4a5e-4544-978b-c5a092987db3 tempest-TestInstancesWithCinderVolumes-1364232362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.273s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:36 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a01da-4a5e-4544-978b-c5a092987db3 tempest-TestInstancesWithCinderVolumes-1364232362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-156780474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e012b197-88b6-4680-92de-40ca908ff3a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b2281b411224c8b8f09460b67083407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:30Z,use_quota=True,user_id='8dad908086e94e26a823e5a6c068eeaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e18fdf71-3356-4bf2-a102-c5861a3cc87e),volume_type_id=e18fdf71-3356-4bf2-a102-c5861a3cc87e)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:27:36 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-4d2a01da-4a5e-4544-978b-c5a092987db3 tempest-TestInstancesWithCinderVolumes-1364232362 None] Creating volume e012b197-88b6-4680-92de-40ca908ff3a4 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:27:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4d2a01da-4a5e-4544-978b-c5a092987db3 tempest-TestInstancesWithCinderVolumes-1364232362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4d2a01da-4a5e-4544-978b-c5a092987db3 tempest-TestInstancesWithCinderVolumes-1364232362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:36 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a01da-4a5e-4544-978b-c5a092987db3 tempest-TestInstancesWithCinderVolumes-1364232362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:36 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a01da-4a5e-4544-978b-c5a092987db3 tempest-TestInstancesWithCinderVolumes-1364232362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4d2a01da-4a5e-4544-978b-c5a092987db3 tempest-TestInstancesWithCinderVolumes-1364232362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:36 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a01da-4a5e-4544-978b-c5a092987db3 tempest-TestInstancesWithCinderVolumes-1364232362 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:27:36 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-4d2a01da-4a5e-4544-978b-c5a092987db3 tempest-TestInstancesWithCinderVolumes-1364232362 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:27:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4d2a01da-4a5e-4544-978b-c5a092987db3 tempest-TestInstancesWithCinderVolumes-1364232362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e012b197-88b6-4680-92de-40ca908ff3a4 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:36 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6fb4e4c5-b628-4fd1-b167-ce5ae5f5faee tempest-TestInstancesWithCinderVolumes-1364232362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01e90514-bbd5-482c-94f1-820149905165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a6e7754-b982-4708-9157-21b031d891f3', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:36 devstack sudo[99279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e012b197-88b6-4680-92de-40ca908ff3a4 1073741824 Nov 03 20:27:36 devstack sudo[99279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:36 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6fb4e4c5-b628-4fd1-b167-ce5ae5f5faee tempest-TestInstancesWithCinderVolumes-1364232362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b06d761b-9531-47b3-ad82-a40b396c044e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:36 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-6fb4e4c5-b628-4fd1-b167-ce5ae5f5faee tempest-TestInstancesWithCinderVolumes-1364232362 None] Volume volume-8a6e7754-b982-4708-9157-21b031d891f3 (8a6e7754-b982-4708-9157-21b031d891f3): created successfully Nov 03 20:27:36 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6fb4e4c5-b628-4fd1-b167-ce5ae5f5faee tempest-TestInstancesWithCinderVolumes-1364232362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b06d761b-9531-47b3-ad82-a40b396c044e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:36 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6fb4e4c5-b628-4fd1-b167-ce5ae5f5faee tempest-TestInstancesWithCinderVolumes-1364232362 None] Flow 'volume_create_manager' (792ea5d6-7080-4bae-bf9d-bd76504cb96e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:36 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-6fb4e4c5-b628-4fd1-b167-ce5ae5f5faee tempest-TestInstancesWithCinderVolumes-1364232362 None] Created volume successfully. Nov 03 20:27:36 devstack sudo[99276]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b3542cfc-b6b4-46ba-8318-fed25e0eb016 tempest-VolumesSnapshotTestJSON-522224620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3637d9cb-12e5-456a-8daa-948a63603909" returned: 0 in 0.490s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b3542cfc-b6b4-46ba-8318-fed25e0eb016 tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3637d9cb-12e5-456a-8daa-948a63603909 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:36 devstack sudo[99285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3637d9cb-12e5-456a-8daa-948a63603909 Nov 03 20:27:36 devstack sudo[99285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:37 devstack sudo[99279]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4d2a01da-4a5e-4544-978b-c5a092987db3 tempest-TestInstancesWithCinderVolumes-1364232362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e012b197-88b6-4680-92de-40ca908ff3a4 1073741824" returned: 0 in 0.664s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:37 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:SELECT=60,cinder:UPDATE=61,cinder:INSERT=17,cinder:DELETE=4 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:27:37 devstack sudo[99285]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b3542cfc-b6b4-46ba-8318-fed25e0eb016 tempest-VolumesSnapshotTestJSON-522224620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3637d9cb-12e5-456a-8daa-948a63603909" returned: 0 in 0.399s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:37 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b3542cfc-b6b4-46ba-8318-fed25e0eb016 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "cinder-quobyte-3637d9cb-12e5-456a-8daa-948a63603909" released by "delete_volume" :: held 0.951s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4d2a01da-4a5e-4544-978b-c5a092987db3 tempest-TestInstancesWithCinderVolumes-1364232362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e012b197-88b6-4680-92de-40ca908ff3a4 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:37 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:SELECT=65,cinder:INSERT=11,cinder:UPDATE=56,cinder:DELETE=9 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:27:37 devstack sudo[99292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e012b197-88b6-4680-92de-40ca908ff3a4 Nov 03 20:27:37 devstack sudo[99292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:37 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-b3542cfc-b6b4-46ba-8318-fed25e0eb016 tempest-VolumesSnapshotTestJSON-522224620 None] Created reservations ['9b71b728-12a6-4f6c-98e9-178b5f4327e3', 'bc07a5c4-2b11-495d-b4d0-a46d06d6839e', 'a226492d-a6f7-4f7a-a53e-16c5ca8aa73e', 'dae97fce-f754-4e69-b0cd-54d3d5a7d3fb'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:27:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b3542cfc-b6b4-46ba-8318-fed25e0eb016 tempest-VolumesSnapshotTestJSON-522224620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b3542cfc-b6b4-46ba-8318-fed25e0eb016 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:37 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-b3542cfc-b6b4-46ba-8318-fed25e0eb016 tempest-VolumesSnapshotTestJSON-522224620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:37 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-b3542cfc-b6b4-46ba-8318-fed25e0eb016 tempest-VolumesSnapshotTestJSON-522224620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b3542cfc-b6b4-46ba-8318-fed25e0eb016 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b3542cfc-b6b4-46ba-8318-fed25e0eb016 tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:37 devstack sudo[99294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:27:37 devstack sudo[99294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:37 devstack sudo[99292]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4d2a01da-4a5e-4544-978b-c5a092987db3 tempest-TestInstancesWithCinderVolumes-1364232362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e012b197-88b6-4680-92de-40ca908ff3a4" returned: 0 in 0.341s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:37 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a01da-4a5e-4544-978b-c5a092987db3 tempest-TestInstancesWithCinderVolumes-1364232362 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:27:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4d2a01da-4a5e-4544-978b-c5a092987db3 tempest-TestInstancesWithCinderVolumes-1364232362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-65d0206e-917a-406a-953e-681e626e2938 tempest-AttachVolumeNegativeTest-1262133860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.165s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:37 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-65d0206e-917a-406a-953e-681e626e2938 tempest-AttachVolumeNegativeTest-1262133860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1059654169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3641d0eb-4eea-4cbd-9fcd-39ffed509e27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0ca15c601f747d395e8d184a9e0e0ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:35Z,use_quota=True,user_id='b397ba0c98774898b6e0048d127232da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:27:37 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-65d0206e-917a-406a-953e-681e626e2938 tempest-AttachVolumeNegativeTest-1262133860 None] Creating volume 3641d0eb-4eea-4cbd-9fcd-39ffed509e27 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:27:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-65d0206e-917a-406a-953e-681e626e2938 tempest-AttachVolumeNegativeTest-1262133860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-65d0206e-917a-406a-953e-681e626e2938 tempest-AttachVolumeNegativeTest-1262133860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:37 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-65d0206e-917a-406a-953e-681e626e2938 tempest-AttachVolumeNegativeTest-1262133860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:37 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-65d0206e-917a-406a-953e-681e626e2938 tempest-AttachVolumeNegativeTest-1262133860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-65d0206e-917a-406a-953e-681e626e2938 tempest-AttachVolumeNegativeTest-1262133860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:37 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-65d0206e-917a-406a-953e-681e626e2938 tempest-AttachVolumeNegativeTest-1262133860 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:27:37 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-65d0206e-917a-406a-953e-681e626e2938 tempest-AttachVolumeNegativeTest-1262133860 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:27:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-65d0206e-917a-406a-953e-681e626e2938 tempest-AttachVolumeNegativeTest-1262133860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3641d0eb-4eea-4cbd-9fcd-39ffed509e27 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4d2a01da-4a5e-4544-978b-c5a092987db3 tempest-TestInstancesWithCinderVolumes-1364232362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bfc2d20-8a3d-4037-b119-8d63d37dc209) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e012b197-88b6-4680-92de-40ca908ff3a4', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4d2a01da-4a5e-4544-978b-c5a092987db3 tempest-TestInstancesWithCinderVolumes-1364232362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f05ce076-eee4-4cbb-866f-5f2c0885b539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:37 devstack sudo[99297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3641d0eb-4eea-4cbd-9fcd-39ffed509e27 1073741824 Nov 03 20:27:37 devstack sudo[99297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:37 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-4d2a01da-4a5e-4544-978b-c5a092987db3 tempest-TestInstancesWithCinderVolumes-1364232362 None] Volume volume-e012b197-88b6-4680-92de-40ca908ff3a4 (e012b197-88b6-4680-92de-40ca908ff3a4): created successfully Nov 03 20:27:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4d2a01da-4a5e-4544-978b-c5a092987db3 tempest-TestInstancesWithCinderVolumes-1364232362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f05ce076-eee4-4cbb-866f-5f2c0885b539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4d2a01da-4a5e-4544-978b-c5a092987db3 tempest-TestInstancesWithCinderVolumes-1364232362 None] Flow 'volume_create_manager' (25f8ce66-4a48-4fc4-a78f-8211a06f6b23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:37 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-4d2a01da-4a5e-4544-978b-c5a092987db3 tempest-TestInstancesWithCinderVolumes-1364232362 None] Created volume successfully. Nov 03 20:27:37 devstack sudo[99294]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b3542cfc-b6b4-46ba-8318-fed25e0eb016 tempest-VolumesSnapshotTestJSON-522224620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.350s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:37 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-b3542cfc-b6b4-46ba-8318-fed25e0eb016 tempest-VolumesSnapshotTestJSON-522224620 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:27:37 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-b3542cfc-b6b4-46ba-8318-fed25e0eb016 tempest-VolumesSnapshotTestJSON-522224620 None] Deleted volume successfully. Nov 03 20:27:37 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b3542cfc-b6b4-46ba-8318-fed25e0eb016 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "cinder-3637d9cb-12e5-456a-8daa-948a63603909-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:38 devstack sudo[99297]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-65d0206e-917a-406a-953e-681e626e2938 tempest-AttachVolumeNegativeTest-1262133860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3641d0eb-4eea-4cbd-9fcd-39ffed509e27 1073741824" returned: 0 in 0.625s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-65d0206e-917a-406a-953e-681e626e2938 tempest-AttachVolumeNegativeTest-1262133860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3641d0eb-4eea-4cbd-9fcd-39ffed509e27 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:38 devstack sudo[99333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3641d0eb-4eea-4cbd-9fcd-39ffed509e27 Nov 03 20:27:38 devstack sudo[99333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:38 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-5ae329dd-e74e-4c7f-b313-a5fdb24b2e93 tempest-VolumesSnapshotTestJSON-522224620 None] Acquiring lock "cinder-89c322bb-64bf-490f-8d70-0b3117c18ebe-delete_snapshot" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:38 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-5ae329dd-e74e-4c7f-b313-a5fdb24b2e93 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "cinder-89c322bb-64bf-490f-8d70-0b3117c18ebe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:38 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-5ae329dd-e74e-4c7f-b313-a5fdb24b2e93 tempest-VolumesSnapshotTestJSON-522224620 None] Acquiring lock "cinder-quobyte-3c62b2db-1251-4880-9268-2bb9bb74690d" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:38 devstack sudo[99333]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:38 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-5ae329dd-e74e-4c7f-b313-a5fdb24b2e93 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "cinder-quobyte-3c62b2db-1251-4880-9268-2bb9bb74690d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:38 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-5ae329dd-e74e-4c7f-b313-a5fdb24b2e93 tempest-VolumesSnapshotTestJSON-522224620 None] Acquiring lock "cinder-quobyte-89c322bb-64bf-490f-8d70-0b3117c18ebe" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-65d0206e-917a-406a-953e-681e626e2938 tempest-AttachVolumeNegativeTest-1262133860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3641d0eb-4eea-4cbd-9fcd-39ffed509e27" returned: 0 in 0.314s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:38 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-65d0206e-917a-406a-953e-681e626e2938 tempest-AttachVolumeNegativeTest-1262133860 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:27:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-65d0206e-917a-406a-953e-681e626e2938 tempest-AttachVolumeNegativeTest-1262133860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:38 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-5ae329dd-e74e-4c7f-b313-a5fdb24b2e93 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "cinder-quobyte-89c322bb-64bf-490f-8d70-0b3117c18ebe" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:38 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-5ae329dd-e74e-4c7f-b313-a5fdb24b2e93 tempest-VolumesSnapshotTestJSON-522224620 None] Deleting offline snapshot 89c322bb-64bf-490f-8d70-0b3117c18ebe of volume 3c62b2db-1251-4880-9268-2bb9bb74690d {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:27:38 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-5ae329dd-e74e-4c7f-b313-a5fdb24b2e93 tempest-VolumesSnapshotTestJSON-522224620 None] snapshot_file for this snap is: volume-3c62b2db-1251-4880-9268-2bb9bb74690d.89c322bb-64bf-490f-8d70-0b3117c18ebe {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:27:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-65d0206e-917a-406a-953e-681e626e2938 tempest-AttachVolumeNegativeTest-1262133860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3d07199-6401-419a-8511-8fa4e18bfff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3641d0eb-4eea-4cbd-9fcd-39ffed509e27', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-65d0206e-917a-406a-953e-681e626e2938 tempest-AttachVolumeNegativeTest-1262133860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e560a612-d8e9-4e22-85c1-ee82c43dfb48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:38 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41fd4d2-78ea-4dcd-87a2-535fee536957]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5ae329dd-e74e-4c7f-b313-a5fdb24b2e93 tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d.89c322bb-64bf-490f-8d70-0b3117c18ebe {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:38 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-65d0206e-917a-406a-953e-681e626e2938 tempest-AttachVolumeNegativeTest-1262133860 None] Volume volume-3641d0eb-4eea-4cbd-9fcd-39ffed509e27 (3641d0eb-4eea-4cbd-9fcd-39ffed509e27): created successfully Nov 03 20:27:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-65d0206e-917a-406a-953e-681e626e2938 tempest-AttachVolumeNegativeTest-1262133860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e560a612-d8e9-4e22-85c1-ee82c43dfb48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-65d0206e-917a-406a-953e-681e626e2938 tempest-AttachVolumeNegativeTest-1262133860 None] Flow 'volume_create_manager' (53f51414-6a34-4903-96f8-2c09894a877b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:38 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-65d0206e-917a-406a-953e-681e626e2938 tempest-AttachVolumeNegativeTest-1262133860 None] Created volume successfully. Nov 03 20:27:38 devstack sudo[99336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d.89c322bb-64bf-490f-8d70-0b3117c18ebe Nov 03 20:27:38 devstack sudo[99336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:39 devstack sudo[99336]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5ae329dd-e74e-4c7f-b313-a5fdb24b2e93 tempest-VolumesSnapshotTestJSON-522224620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d.89c322bb-64bf-490f-8d70-0b3117c18ebe" returned: 0 in 0.390s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:39 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-5ae329dd-e74e-4c7f-b313-a5fdb24b2e93 tempest-VolumesSnapshotTestJSON-522224620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c62b2db-1251-4880-9268-2bb9bb74690d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:27:39 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5cebbb8-48c2-434c-9f53-2dae72c6a231]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5ae329dd-e74e-4c7f-b313-a5fdb24b2e93 tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:39 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8ee86bfb-a57f-4048-b83d-515011f348b5_p__2ec8xdevstack@QuobyteHD, size 20.69 MB, duration 5.82 sec {{(pid=87248) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 20:27:39 devstack cinder-volume[87248]: INFO cinder.image.image_utils [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Image download 20.69 MB at 3.56 MB/s Nov 03 20:27:39 devstack sudo[99341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d Nov 03 20:27:39 devstack sudo[99341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:39 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c8ab93-4995-4dc4-bf3d-c1ad7ef7f1b0]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ee86bfb-a57f-4048-b83d-515011f348b5_p__2ec8xdevstack@QuobyteHD {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:39 devstack sudo[99343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ee86bfb-a57f-4048-b83d-515011f348b5_p__2ec8xdevstack@QuobyteHD Nov 03 20:27:39 devstack sudo[99343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:39 devstack sudo[99343]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ee86bfb-a57f-4048-b83d-515011f348b5_p__2ec8xdevstack@QuobyteHD" returned: 0 in 0.337s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:39 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Temporary image 8ee86bfb-a57f-4048-b83d-515011f348b5 is fetched for user 8dad908086e94e26a823e5a6c068eeaf. {{(pid=87248) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 20:27:39 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a97646-f273-4986-b72c-484081d4d66f]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ee86bfb-a57f-4048-b83d-515011f348b5_p__2ec8xdevstack@QuobyteHD {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:39 devstack sudo[99341]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5ae329dd-e74e-4c7f-b313-a5fdb24b2e93 tempest-VolumesSnapshotTestJSON-522224620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d" returned: 0 in 0.612s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5ae329dd-e74e-4c7f-b313-a5fdb24b2e93 tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d.89c322bb-64bf-490f-8d70-0b3117c18ebe {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:39 devstack sudo[99354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d.89c322bb-64bf-490f-8d70-0b3117c18ebe Nov 03 20:27:39 devstack sudo[99354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:39 devstack sudo[99353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ee86bfb-a57f-4048-b83d-515011f348b5_p__2ec8xdevstack@QuobyteHD Nov 03 20:27:39 devstack sudo[99353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:40 devstack sudo[99353]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ee86bfb-a57f-4048-b83d-515011f348b5_p__2ec8xdevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:40 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-179166760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73b150f6-b10c-422d-9de8-3fac99321fe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b2281b411224c8b8f09460b67083407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:32Z,use_quota=True,user_id='8dad908086e94e26a823e5a6c068eeaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eebf51df-fba0-4a4e-b997-733cfce832f4),volume_type_id=eebf51df-fba0-4a4e-b997-733cfce832f4)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:27:40 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Creating volume 73b150f6-b10c-422d-9de8-3fac99321fe5 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:27:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:40 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:40 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:40 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:27:40 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:27:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-73b150f6-b10c-422d-9de8-3fac99321fe5 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:40 devstack sudo[99364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-73b150f6-b10c-422d-9de8-3fac99321fe5 1073741824 Nov 03 20:27:40 devstack sudo[99364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:40 devstack sudo[99354]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5ae329dd-e74e-4c7f-b313-a5fdb24b2e93 tempest-VolumesSnapshotTestJSON-522224620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d.89c322bb-64bf-490f-8d70-0b3117c18ebe" returned: 0 in 0.476s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5ae329dd-e74e-4c7f-b313-a5fdb24b2e93 tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d.89c322bb-64bf-490f-8d70-0b3117c18ebe {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:40 devstack sudo[99366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d.89c322bb-64bf-490f-8d70-0b3117c18ebe Nov 03 20:27:40 devstack sudo[99366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-91cfe5f6-7d5e-422e-8e9b-74dd27313614 req-8d6196d5-8383-4c92-8442-80fbabf4ac27 tempest-AttachVolumeNegativeTest-1262133860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:40 devstack sudo[99366]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5ae329dd-e74e-4c7f-b313-a5fdb24b2e93 tempest-VolumesSnapshotTestJSON-522224620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d.89c322bb-64bf-490f-8d70-0b3117c18ebe" returned: 0 in 0.271s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:40 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-5ae329dd-e74e-4c7f-b313-a5fdb24b2e93 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "cinder-quobyte-89c322bb-64bf-490f-8d70-0b3117c18ebe" released by "_delete_snapshot" :: held 1.859s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:40 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-5ae329dd-e74e-4c7f-b313-a5fdb24b2e93 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "cinder-quobyte-3c62b2db-1251-4880-9268-2bb9bb74690d" released by "delete_snapshot" :: held 1.886s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:40 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-5ae329dd-e74e-4c7f-b313-a5fdb24b2e93 tempest-VolumesSnapshotTestJSON-522224620 None] Created reservations ['1bebdd06-98c2-4c60-af86-6151aa2726a9', '3ff5c41f-5452-4c1e-b5ec-9ec293dd1435', '7eafc271-e79b-4b3b-a3b1-7d5ec690b56f', 'e28bb2eb-7e88-4412-b439-bc46b515a48e'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:27:40 devstack sudo[99364]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-73b150f6-b10c-422d-9de8-3fac99321fe5 1073741824" returned: 0 in 0.489s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:40 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-5ae329dd-e74e-4c7f-b313-a5fdb24b2e93 tempest-VolumesSnapshotTestJSON-522224620 None] Delete snapshot completed successfully. Nov 03 20:27:40 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-5ae329dd-e74e-4c7f-b313-a5fdb24b2e93 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "cinder-89c322bb-64bf-490f-8d70-0b3117c18ebe-delete_snapshot" released by "delete_snapshot" :: held 2.036s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-73b150f6-b10c-422d-9de8-3fac99321fe5 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:40 devstack sudo[99382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-73b150f6-b10c-422d-9de8-3fac99321fe5 Nov 03 20:27:40 devstack sudo[99382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:40 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7b15fe91-25e0-48c3-9ac8-f1593e051eb5 tempest-VolumesSnapshotTestJSON-522224620 None] Acquiring lock "cinder-3c62b2db-1251-4880-9268-2bb9bb74690d-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:40 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7b15fe91-25e0-48c3-9ac8-f1593e051eb5 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "cinder-3c62b2db-1251-4880-9268-2bb9bb74690d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:40 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7b15fe91-25e0-48c3-9ac8-f1593e051eb5 tempest-VolumesSnapshotTestJSON-522224620 None] Acquiring lock "cinder-quobyte-3c62b2db-1251-4880-9268-2bb9bb74690d" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:40 devstack sudo[99382]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-73b150f6-b10c-422d-9de8-3fac99321fe5" returned: 0 in 0.266s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:40 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:27:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:40 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7b15fe91-25e0-48c3-9ac8-f1593e051eb5 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "cinder-quobyte-3c62b2db-1251-4880-9268-2bb9bb74690d" acquired by "delete_volume" :: waited 0.014s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-91cfe5f6-7d5e-422e-8e9b-74dd27313614 req-8d6196d5-8383-4c92-8442-80fbabf4ac27 tempest-AttachVolumeNegativeTest-1262133860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.483s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-91cfe5f6-7d5e-422e-8e9b-74dd27313614 req-8d6196d5-8383-4c92-8442-80fbabf4ac27 tempest-AttachVolumeNegativeTest-1262133860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:40 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de878f0-60f3-4af2-81ec-66a3265b4748]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7b15fe91-25e0-48c3-9ac8-f1593e051eb5 tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:41 devstack cinder-volume[87248]: DEBUG cinder.volume.volume_utils [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Attempting download of 8ee86bfb-a57f-4048-b83d-515011f348b5 ((None, [{'url': 'file:///opt/stack/data/glance/images/8ee86bfb-a57f-4048-b83d-515011f348b5', 'metadata': {}}])) to volume 73b150f6-b10c-422d-9de8-3fac99321fe5. {{(pid=87248) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 20:27:41 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-91cfe5f6-7d5e-422e-8e9b-74dd27313614 req-8d6196d5-8383-4c92-8442-80fbabf4ac27 tempest-AttachVolumeNegativeTest-1262133860 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8', 'name': 'volume-3641d0eb-4eea-4cbd-9fcd-39ffed509e27', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd784e6e1-8753-4cbe-b03d-bbef5c4fb9f8', 'enforce_multipath': True} {{(pid=87248) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 20:27:41 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f69d43-5f5c-4f53-beaa-9ee8d21d5cd3]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8ee86bfb-a57f-4048-b83d-515011f348b5_wc1va9fb {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:41 devstack sudo[99385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d Nov 03 20:27:41 devstack sudo[99385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:41 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-91cfe5f6-7d5e-422e-8e9b-74dd27313614 req-8d6196d5-8383-4c92-8442-80fbabf4ac27 tempest-AttachVolumeNegativeTest-1262133860 None] attachment_update completed successfully. Nov 03 20:27:41 devstack sudo[99386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8ee86bfb-a57f-4048-b83d-515011f348b5_wc1va9fb Nov 03 20:27:41 devstack sudo[99386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:41 devstack sudo[99385]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7b15fe91-25e0-48c3-9ac8-f1593e051eb5 tempest-VolumesSnapshotTestJSON-522224620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d" returned: 0 in 0.423s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7b15fe91-25e0-48c3-9ac8-f1593e051eb5 tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:41 devstack sudo[99488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d Nov 03 20:27:41 devstack sudo[99488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:41 devstack sudo[99386]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8ee86bfb-a57f-4048-b83d-515011f348b5_wc1va9fb" returned: 0 in 0.416s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ee86bfb-a57f-4048-b83d-515011f348b5_wc1va9fb {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:41 devstack sudo[99538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ee86bfb-a57f-4048-b83d-515011f348b5_wc1va9fb Nov 03 20:27:41 devstack sudo[99538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:41 devstack sudo[99488]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7b15fe91-25e0-48c3-9ac8-f1593e051eb5 tempest-VolumesSnapshotTestJSON-522224620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c62b2db-1251-4880-9268-2bb9bb74690d" returned: 0 in 0.264s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:41 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7b15fe91-25e0-48c3-9ac8-f1593e051eb5 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "cinder-quobyte-3c62b2db-1251-4880-9268-2bb9bb74690d" released by "delete_volume" :: held 0.759s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:41 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-7b15fe91-25e0-48c3-9ac8-f1593e051eb5 tempest-VolumesSnapshotTestJSON-522224620 None] Created reservations ['a104247e-7e61-4719-abd6-9292a5cc7d6f', '468a3d68-8ee3-4329-85ab-1767fa53a92e', 'f9b98239-e904-4569-b30f-2acb2a108182', '4515fcc1-09db-44c3-a288-57dda81690f8'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:27:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7b15fe91-25e0-48c3-9ac8-f1593e051eb5 tempest-VolumesSnapshotTestJSON-522224620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7b15fe91-25e0-48c3-9ac8-f1593e051eb5 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:41 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-7b15fe91-25e0-48c3-9ac8-f1593e051eb5 tempest-VolumesSnapshotTestJSON-522224620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:41 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-7b15fe91-25e0-48c3-9ac8-f1593e051eb5 tempest-VolumesSnapshotTestJSON-522224620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7b15fe91-25e0-48c3-9ac8-f1593e051eb5 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7b15fe91-25e0-48c3-9ac8-f1593e051eb5 tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:41 devstack sudo[99538]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ee86bfb-a57f-4048-b83d-515011f348b5_wc1va9fb" returned: 1 in 0.386s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ee86bfb-a57f-4048-b83d-515011f348b5_wc1va9fb' failed. Not Retrying. {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 20:27:41 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[8723204c-dc40-449f-8f75-8cbe0a44c582]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ee86bfb-a57f-4048-b83d-515011f348b5_p__2ec8xdevstack@QuobyteHD {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:41 devstack sudo[99817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:27:41 devstack sudo[99817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:42 devstack sudo[99819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ee86bfb-a57f-4048-b83d-515011f348b5_p__2ec8xdevstack@QuobyteHD Nov 03 20:27:42 devstack sudo[99819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:42 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-dde614c9-6023-41e8-bacd-26f6c14abb9a tempest-VolumesSnapshotTestJSON-522224620 None] Acquiring lock "cinder-bf133c3c-76a1-4ce6-a029-cec57d450a31-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:42 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-dde614c9-6023-41e8-bacd-26f6c14abb9a tempest-VolumesSnapshotTestJSON-522224620 None] Lock "cinder-bf133c3c-76a1-4ce6-a029-cec57d450a31-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:42 devstack sudo[99817]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7b15fe91-25e0-48c3-9ac8-f1593e051eb5 tempest-VolumesSnapshotTestJSON-522224620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.340s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:42 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-dde614c9-6023-41e8-bacd-26f6c14abb9a tempest-VolumesSnapshotTestJSON-522224620 None] Acquiring lock "cinder-quobyte-bf133c3c-76a1-4ce6-a029-cec57d450a31" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:27:42 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-7b15fe91-25e0-48c3-9ac8-f1593e051eb5 tempest-VolumesSnapshotTestJSON-522224620 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:27:42 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-7b15fe91-25e0-48c3-9ac8-f1593e051eb5 tempest-VolumesSnapshotTestJSON-522224620 None] Deleted volume successfully. Nov 03 20:27:42 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-dde614c9-6023-41e8-bacd-26f6c14abb9a tempest-VolumesSnapshotTestJSON-522224620 None] Lock "cinder-quobyte-bf133c3c-76a1-4ce6-a029-cec57d450a31" acquired by "delete_volume" :: waited 0.027s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:27:42 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7b15fe91-25e0-48c3-9ac8-f1593e051eb5 tempest-VolumesSnapshotTestJSON-522224620 None] Lock "cinder-3c62b2db-1251-4880-9268-2bb9bb74690d-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:42 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[5465bc40-24a7-4387-8a13-8b9ccacb4e68]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:27:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-dde614c9-6023-41e8-bacd-26f6c14abb9a tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bf133c3c-76a1-4ce6-a029-cec57d450a31 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:42 devstack sudo[99819]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ee86bfb-a57f-4048-b83d-515011f348b5_p__2ec8xdevstack@QuobyteHD" returned: 0 in 0.434s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:42 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] 8ee86bfb-a57f-4048-b83d-515011f348b5 was qcow2, converting to qcow2 {{(pid=87248) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 20:27:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8ee86bfb-a57f-4048-b83d-515011f348b5_p__2ec8xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-73b150f6-b10c-422d-9de8-3fac99321fe5 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:42 devstack sudo[99827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8ee86bfb-a57f-4048-b83d-515011f348b5_p__2ec8xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-73b150f6-b10c-422d-9de8-3fac99321fe5 Nov 03 20:27:42 devstack sudo[99827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:42 devstack sudo[99826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bf133c3c-76a1-4ce6-a029-cec57d450a31 Nov 03 20:27:42 devstack sudo[99826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:42 devstack sudo[99826]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-dde614c9-6023-41e8-bacd-26f6c14abb9a tempest-VolumesSnapshotTestJSON-522224620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bf133c3c-76a1-4ce6-a029-cec57d450a31" returned: 0 in 0.399s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-dde614c9-6023-41e8-bacd-26f6c14abb9a tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bf133c3c-76a1-4ce6-a029-cec57d450a31 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:42 devstack sudo[99837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bf133c3c-76a1-4ce6-a029-cec57d450a31 Nov 03 20:27:42 devstack sudo[99837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:42 devstack sudo[99837]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-dde614c9-6023-41e8-bacd-26f6c14abb9a tempest-VolumesSnapshotTestJSON-522224620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bf133c3c-76a1-4ce6-a029-cec57d450a31" returned: 0 in 0.297s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:43 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-dde614c9-6023-41e8-bacd-26f6c14abb9a tempest-VolumesSnapshotTestJSON-522224620 None] Lock "cinder-quobyte-bf133c3c-76a1-4ce6-a029-cec57d450a31" released by "delete_volume" :: held 0.785s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:43 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-dde614c9-6023-41e8-bacd-26f6c14abb9a tempest-VolumesSnapshotTestJSON-522224620 None] Created reservations ['03c279f7-439b-431d-855a-ad80ea0c3744', '9a3f1066-04ad-4b78-856f-6967e97ad9bc', '2c3ff6fc-f045-4a5c-97ec-10867a6ed583', '4bf5c32f-65db-41cc-97bd-d1bddb011108'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:27:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-dde614c9-6023-41e8-bacd-26f6c14abb9a tempest-VolumesSnapshotTestJSON-522224620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-dde614c9-6023-41e8-bacd-26f6c14abb9a tempest-VolumesSnapshotTestJSON-522224620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:43 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-dde614c9-6023-41e8-bacd-26f6c14abb9a tempest-VolumesSnapshotTestJSON-522224620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:43 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-dde614c9-6023-41e8-bacd-26f6c14abb9a tempest-VolumesSnapshotTestJSON-522224620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-dde614c9-6023-41e8-bacd-26f6c14abb9a tempest-VolumesSnapshotTestJSON-522224620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-dde614c9-6023-41e8-bacd-26f6c14abb9a tempest-VolumesSnapshotTestJSON-522224620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:43 devstack sudo[99842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:27:43 devstack sudo[99842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:43 devstack sudo[99842]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-dde614c9-6023-41e8-bacd-26f6c14abb9a tempest-VolumesSnapshotTestJSON-522224620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.381s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:43 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-dde614c9-6023-41e8-bacd-26f6c14abb9a tempest-VolumesSnapshotTestJSON-522224620 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:27:43 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-dde614c9-6023-41e8-bacd-26f6c14abb9a tempest-VolumesSnapshotTestJSON-522224620 None] Deleted volume successfully. Nov 03 20:27:43 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-dde614c9-6023-41e8-bacd-26f6c14abb9a tempest-VolumesSnapshotTestJSON-522224620 None] Lock "cinder-bf133c3c-76a1-4ce6-a029-cec57d450a31-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:27:44 devstack sudo[99827]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8ee86bfb-a57f-4048-b83d-515011f348b5_p__2ec8xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-73b150f6-b10c-422d-9de8-3fac99321fe5" returned: 0 in 2.327s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:44 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8ee86bfb-a57f-4048-b83d-515011f348b5_p__2ec8xdevstack@QuobyteHD, size 112.00 MB, duration 2.33 sec, destination /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-73b150f6-b10c-422d-9de8-3fac99321fe5 {{(pid=87248) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:27:44 devstack cinder-volume[87248]: INFO cinder.image.image_utils [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Converted 112.00 MB image at 48.12 MB/s Nov 03 20:27:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-73b150f6-b10c-422d-9de8-3fac99321fe5 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:44 devstack sudo[99845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-73b150f6-b10c-422d-9de8-3fac99321fe5 1G Nov 03 20:27:44 devstack sudo[99845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:45 devstack sudo[99845]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-73b150f6-b10c-422d-9de8-3fac99321fe5 1G" returned: 0 in 0.458s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:45 devstack cinder-volume[87248]: DEBUG cinder.volume.volume_utils [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Downloaded image 8ee86bfb-a57f-4048-b83d-515011f348b5 ((None, [{'url': 'file:///opt/stack/data/glance/images/8ee86bfb-a57f-4048-b83d-515011f348b5', 'metadata': {}}])) to volume 73b150f6-b10c-422d-9de8-3fac99321fe5 successfully. {{(pid=87248) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 20:27:45 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Temporary image 8ee86bfb-a57f-4048-b83d-515011f348b5 for user 8dad908086e94e26a823e5a6c068eeaf is deleted. {{(pid=87248) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 20:27:45 devstack cinder-volume[87248]: DEBUG cinder.volume.volume_utils [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Marking volume 73b150f6-b10c-422d-9de8-3fac99321fe5 as bootable. {{(pid=87248) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 20:27:45 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Copying metadata from image 8ee86bfb-a57f-4048-b83d-515011f348b5 to 73b150f6-b10c-422d-9de8-3fac99321fe5. {{(pid=87248) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 20:27:45 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Creating volume glance metadata for volume 73b150f6-b10c-422d-9de8-3fac99321fe5 backed by image 8ee86bfb-a57f-4048-b83d-515011f348b5 with: {'image_id': '8ee86bfb-a57f-4048-b83d-515011f348b5', 'image_name': 'tempest-scenario-img--2078603674', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87248) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 20:27:45 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd405baf-7761-4e29-941c-dc332ada6e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73b150f6-b10c-422d-9de8-3fac99321fe5', 'volume_size': 1, 'image_id': '8ee86bfb-a57f-4048-b83d-515011f348b5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8ee86bfb-a57f-4048-b83d-515011f348b5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2078603674', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9b2281b411224c8b8f09460b67083407', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8ee86bfb-a57f-4048-b83d-515011f348b5', 'created_at': datetime.datetime(2026, 11, 3, 19, 27, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 27, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8ee86bfb-a57f-4048-b83d-515011f348b5/file', 'properties': {}}, 'image_service': }' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:45 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ee3f644-e4a0-4994-be7f-2bc920076023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:45 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Volume volume-73b150f6-b10c-422d-9de8-3fac99321fe5 (73b150f6-b10c-422d-9de8-3fac99321fe5): created successfully Nov 03 20:27:45 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ee3f644-e4a0-4994-be7f-2bc920076023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:45 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Flow 'volume_create_manager' (2f1c44f2-f7c3-4b3b-8600-e211a1b6774e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:45 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-6864434a-bf02-4e0a-957e-e53ee3dfceae tempest-TestInstancesWithCinderVolumes-1364232362 None] Created volume successfully. Nov 03 20:27:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-237e4c6d-8abd-4769-a527-d9977ba7d6bd req-e5c7bca9-7f4d-4212-aa6d-ff27b699ae7f tempest-TestInstancesWithCinderVolumes-1364232362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-237e4c6d-8abd-4769-a527-d9977ba7d6bd req-e5c7bca9-7f4d-4212-aa6d-ff27b699ae7f tempest-TestInstancesWithCinderVolumes-1364232362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-237e4c6d-8abd-4769-a527-d9977ba7d6bd req-e5c7bca9-7f4d-4212-aa6d-ff27b699ae7f tempest-TestInstancesWithCinderVolumes-1364232362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:49 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-237e4c6d-8abd-4769-a527-d9977ba7d6bd req-e5c7bca9-7f4d-4212-aa6d-ff27b699ae7f tempest-TestInstancesWithCinderVolumes-1364232362 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8', 'name': 'volume-73b150f6-b10c-422d-9de8-3fac99321fe5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '32481690-a1c0-4796-b8fe-39b64aec100f', 'enforce_multipath': True} {{(pid=87248) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 20:27:49 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-237e4c6d-8abd-4769-a527-d9977ba7d6bd req-e5c7bca9-7f4d-4212-aa6d-ff27b699ae7f tempest-TestInstancesWithCinderVolumes-1364232362 None] attachment_update completed successfully. Nov 03 20:27:53 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-a33768fd-dd1a-4af3-ac80-0ab07bb75044 tempest-CreateVolumesFromImageTest-698799358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:27:54 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a33768fd-dd1a-4af3-ac80-0ab07bb75044 tempest-CreateVolumesFromImageTest-698799358 None] Flow 'volume_create_manager' (863b57a9-804a-4066-b00b-1f954469815f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:54 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a33768fd-dd1a-4af3-ac80-0ab07bb75044 tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1368f993-f79c-4c5b-a24e-704c82e522a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:54 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a33768fd-dd1a-4af3-ac80-0ab07bb75044 tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1368f993-f79c-4c5b-a24e-704c82e522a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-526258569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70ba6e52-5eec-478a-a445-3341f010c842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17331119b8144fed81105498eb69de84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:54Z,use_quota=True,user_id='31e99db2c0a14559b072071476710f39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:54 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a33768fd-dd1a-4af3-ac80-0ab07bb75044 tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03e03999-3c21-4b37-8d3f-4df418f8e0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:54 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a33768fd-dd1a-4af3-ac80-0ab07bb75044 tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03e03999-3c21-4b37-8d3f-4df418f8e0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:54 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a33768fd-dd1a-4af3-ac80-0ab07bb75044 tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (597a85b9-31e3-43cc-ac78-9d667a946588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:54 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a33768fd-dd1a-4af3-ac80-0ab07bb75044 tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (597a85b9-31e3-43cc-ac78-9d667a946588) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70ba6e52-5eec-478a-a445-3341f010c842', 'volume_name': 'volume-70ba6e52-5eec-478a-a445-3341f010c842', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:54 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a33768fd-dd1a-4af3-ac80-0ab07bb75044 tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27ba5c45-493b-4876-b472-bd8c302b9c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:54 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a33768fd-dd1a-4af3-ac80-0ab07bb75044 tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27ba5c45-493b-4876-b472-bd8c302b9c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:54 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a33768fd-dd1a-4af3-ac80-0ab07bb75044 tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea78b85e-9e8e-47f3-816e-9ada6d7fa232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:54 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-a33768fd-dd1a-4af3-ac80-0ab07bb75044 tempest-CreateVolumesFromImageTest-698799358 None] Volume 70ba6e52-5eec-478a-a445-3341f010c842: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70ba6e52-5eec-478a-a445-3341f010c842', 'volume_size': 1} Nov 03 20:27:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a33768fd-dd1a-4af3-ac80-0ab07bb75044 tempest-CreateVolumesFromImageTest-698799358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a33768fd-dd1a-4af3-ac80-0ab07bb75044 tempest-CreateVolumesFromImageTest-698799358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:54 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a33768fd-dd1a-4af3-ac80-0ab07bb75044 tempest-CreateVolumesFromImageTest-698799358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-526258569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70ba6e52-5eec-478a-a445-3341f010c842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17331119b8144fed81105498eb69de84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:54Z,use_quota=True,user_id='31e99db2c0a14559b072071476710f39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:27:54 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-a33768fd-dd1a-4af3-ac80-0ab07bb75044 tempest-CreateVolumesFromImageTest-698799358 None] Creating volume 70ba6e52-5eec-478a-a445-3341f010c842 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:27:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a33768fd-dd1a-4af3-ac80-0ab07bb75044 tempest-CreateVolumesFromImageTest-698799358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a33768fd-dd1a-4af3-ac80-0ab07bb75044 tempest-CreateVolumesFromImageTest-698799358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:54 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a33768fd-dd1a-4af3-ac80-0ab07bb75044 tempest-CreateVolumesFromImageTest-698799358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:54 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a33768fd-dd1a-4af3-ac80-0ab07bb75044 tempest-CreateVolumesFromImageTest-698799358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a33768fd-dd1a-4af3-ac80-0ab07bb75044 tempest-CreateVolumesFromImageTest-698799358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:54 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a33768fd-dd1a-4af3-ac80-0ab07bb75044 tempest-CreateVolumesFromImageTest-698799358 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:27:54 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-a33768fd-dd1a-4af3-ac80-0ab07bb75044 tempest-CreateVolumesFromImageTest-698799358 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:27:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a33768fd-dd1a-4af3-ac80-0ab07bb75044 tempest-CreateVolumesFromImageTest-698799358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-70ba6e52-5eec-478a-a445-3341f010c842 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:54 devstack sudo[99945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-70ba6e52-5eec-478a-a445-3341f010c842 1073741824 Nov 03 20:27:54 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:55 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-8755beca-70fd-4dfa-8cd3-d8f3e21ae1ff tempest-CreateVolumesFromImageTest-698799358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:27:55 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8755beca-70fd-4dfa-8cd3-d8f3e21ae1ff tempest-CreateVolumesFromImageTest-698799358 None] Flow 'volume_create_manager' (43c530fb-19bc-446c-9b5d-58ce33c0acd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:55 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8755beca-70fd-4dfa-8cd3-d8f3e21ae1ff tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c472facb-66bf-49dd-a9ee-fc28e419639c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:55 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8755beca-70fd-4dfa-8cd3-d8f3e21ae1ff tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c472facb-66bf-49dd-a9ee-fc28e419639c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-510725155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00d26390-f0a4-49bc-90bf-3dc84edad41d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17331119b8144fed81105498eb69de84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:56Z,use_quota=True,user_id='31e99db2c0a14559b072071476710f39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:55 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8755beca-70fd-4dfa-8cd3-d8f3e21ae1ff tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afe344f0-14e5-4701-b709-dada82997b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:55 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8755beca-70fd-4dfa-8cd3-d8f3e21ae1ff tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afe344f0-14e5-4701-b709-dada82997b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:55 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8755beca-70fd-4dfa-8cd3-d8f3e21ae1ff tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d06bf21-2240-4e96-ba11-f0e584270e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8755beca-70fd-4dfa-8cd3-d8f3e21ae1ff tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d06bf21-2240-4e96-ba11-f0e584270e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00d26390-f0a4-49bc-90bf-3dc84edad41d', 'volume_name': 'volume-00d26390-f0a4-49bc-90bf-3dc84edad41d', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8755beca-70fd-4dfa-8cd3-d8f3e21ae1ff tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33861f3c-aef0-43e3-9b3b-f1ee25e349ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8755beca-70fd-4dfa-8cd3-d8f3e21ae1ff tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33861f3c-aef0-43e3-9b3b-f1ee25e349ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8755beca-70fd-4dfa-8cd3-d8f3e21ae1ff tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (010474d2-2f0d-4d2e-b2ca-f86777eb81d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:56 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-8755beca-70fd-4dfa-8cd3-d8f3e21ae1ff tempest-CreateVolumesFromImageTest-698799358 None] Volume 00d26390-f0a4-49bc-90bf-3dc84edad41d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00d26390-f0a4-49bc-90bf-3dc84edad41d', 'volume_size': 1} Nov 03 20:27:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8755beca-70fd-4dfa-8cd3-d8f3e21ae1ff tempest-CreateVolumesFromImageTest-698799358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:56 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a33768fd-dd1a-4af3-ac80-0ab07bb75044 tempest-CreateVolumesFromImageTest-698799358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-70ba6e52-5eec-478a-a445-3341f010c842 1073741824" returned: 0 in 1.825s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a33768fd-dd1a-4af3-ac80-0ab07bb75044 tempest-CreateVolumesFromImageTest-698799358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-70ba6e52-5eec-478a-a445-3341f010c842 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:56 devstack sudo[100001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-70ba6e52-5eec-478a-a445-3341f010c842 Nov 03 20:27:56 devstack sudo[100001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:56 devstack sudo[100001]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a33768fd-dd1a-4af3-ac80-0ab07bb75044 tempest-CreateVolumesFromImageTest-698799358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-70ba6e52-5eec-478a-a445-3341f010c842" returned: 0 in 0.588s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:56 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a33768fd-dd1a-4af3-ac80-0ab07bb75044 tempest-CreateVolumesFromImageTest-698799358 None] <== create_volume: return (2563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:27:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a33768fd-dd1a-4af3-ac80-0ab07bb75044 tempest-CreateVolumesFromImageTest-698799358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.580s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8755beca-70fd-4dfa-8cd3-d8f3e21ae1ff tempest-CreateVolumesFromImageTest-698799358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.825s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:56 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8755beca-70fd-4dfa-8cd3-d8f3e21ae1ff tempest-CreateVolumesFromImageTest-698799358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-510725155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00d26390-f0a4-49bc-90bf-3dc84edad41d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17331119b8144fed81105498eb69de84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:56Z,use_quota=True,user_id='31e99db2c0a14559b072071476710f39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:27:56 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-8755beca-70fd-4dfa-8cd3-d8f3e21ae1ff tempest-CreateVolumesFromImageTest-698799358 None] Creating volume 00d26390-f0a4-49bc-90bf-3dc84edad41d {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:27:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8755beca-70fd-4dfa-8cd3-d8f3e21ae1ff tempest-CreateVolumesFromImageTest-698799358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8755beca-70fd-4dfa-8cd3-d8f3e21ae1ff tempest-CreateVolumesFromImageTest-698799358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:56 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8755beca-70fd-4dfa-8cd3-d8f3e21ae1ff tempest-CreateVolumesFromImageTest-698799358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:56 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8755beca-70fd-4dfa-8cd3-d8f3e21ae1ff tempest-CreateVolumesFromImageTest-698799358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8755beca-70fd-4dfa-8cd3-d8f3e21ae1ff tempest-CreateVolumesFromImageTest-698799358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:56 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8755beca-70fd-4dfa-8cd3-d8f3e21ae1ff tempest-CreateVolumesFromImageTest-698799358 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:27:56 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-8755beca-70fd-4dfa-8cd3-d8f3e21ae1ff tempest-CreateVolumesFromImageTest-698799358 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:27:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8755beca-70fd-4dfa-8cd3-d8f3e21ae1ff tempest-CreateVolumesFromImageTest-698799358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00d26390-f0a4-49bc-90bf-3dc84edad41d 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:57 devstack sudo[100015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00d26390-f0a4-49bc-90bf-3dc84edad41d 1073741824 Nov 03 20:27:57 devstack sudo[100015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:57 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a33768fd-dd1a-4af3-ac80-0ab07bb75044 tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea78b85e-9e8e-47f3-816e-9ada6d7fa232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70ba6e52-5eec-478a-a445-3341f010c842', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:57 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a33768fd-dd1a-4af3-ac80-0ab07bb75044 tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0af573f-d702-41a3-98c7-1fa700d0fbef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:57 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-a33768fd-dd1a-4af3-ac80-0ab07bb75044 tempest-CreateVolumesFromImageTest-698799358 None] Volume volume-70ba6e52-5eec-478a-a445-3341f010c842 (70ba6e52-5eec-478a-a445-3341f010c842): created successfully Nov 03 20:27:57 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a33768fd-dd1a-4af3-ac80-0ab07bb75044 tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0af573f-d702-41a3-98c7-1fa700d0fbef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:57 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a33768fd-dd1a-4af3-ac80-0ab07bb75044 tempest-CreateVolumesFromImageTest-698799358 None] Flow 'volume_create_manager' (863b57a9-804a-4066-b00b-1f954469815f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:57 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-a33768fd-dd1a-4af3-ac80-0ab07bb75044 tempest-CreateVolumesFromImageTest-698799358 None] Created volume successfully. Nov 03 20:27:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-f54bd8a0-e7d2-49cb-bb73-be9faf4edc50 req-8d289d50-9931-4304-a90d-b4e8f5adbc8d tempest-TestServerVolumeAttachmentScenario-1934017498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:57 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ecd56a2-03a0-4a75-8894-bf5afa970417 tempest-CreateVolumesFromImageTest-698799358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:27:57 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2ecd56a2-03a0-4a75-8894-bf5afa970417 tempest-CreateVolumesFromImageTest-698799358 None] Flow 'volume_create_manager' (42e07aa3-9bcc-44ea-a17f-ccd3ee000676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:57 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2ecd56a2-03a0-4a75-8894-bf5afa970417 tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a343052d-29e3-4508-8f34-1b7e58a79f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:57 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2ecd56a2-03a0-4a75-8894-bf5afa970417 tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a343052d-29e3-4508-8f34-1b7e58a79f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2109228523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efeaad70-a625-44ed-8d67-277d65163a5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17331119b8144fed81105498eb69de84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:57Z,use_quota=True,user_id='31e99db2c0a14559b072071476710f39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:57 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2ecd56a2-03a0-4a75-8894-bf5afa970417 tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fef13e94-05a8-4d31-9268-b6bf075e6f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:57 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2ecd56a2-03a0-4a75-8894-bf5afa970417 tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fef13e94-05a8-4d31-9268-b6bf075e6f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:57 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2ecd56a2-03a0-4a75-8894-bf5afa970417 tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54ccbec6-7156-45a1-954e-3e7cfe5b252f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:57 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2ecd56a2-03a0-4a75-8894-bf5afa970417 tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54ccbec6-7156-45a1-954e-3e7cfe5b252f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efeaad70-a625-44ed-8d67-277d65163a5c', 'volume_name': 'volume-efeaad70-a625-44ed-8d67-277d65163a5c', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:57 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2ecd56a2-03a0-4a75-8894-bf5afa970417 tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb76c05c-7e05-479c-bd8a-67a1535de05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:57 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2ecd56a2-03a0-4a75-8894-bf5afa970417 tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb76c05c-7e05-479c-bd8a-67a1535de05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:57 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2ecd56a2-03a0-4a75-8894-bf5afa970417 tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (871a5c7c-436e-4076-b7b6-14c47ccda5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:57 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-2ecd56a2-03a0-4a75-8894-bf5afa970417 tempest-CreateVolumesFromImageTest-698799358 None] Volume efeaad70-a625-44ed-8d67-277d65163a5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efeaad70-a625-44ed-8d67-277d65163a5c', 'volume_size': 1} Nov 03 20:27:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2ecd56a2-03a0-4a75-8894-bf5afa970417 tempest-CreateVolumesFromImageTest-698799358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:58 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4fba007-6a03-4189-af21-298f321f8a7b tempest-CreateVolumesFromImageTest-698799358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:27:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f4fba007-6a03-4189-af21-298f321f8a7b tempest-CreateVolumesFromImageTest-698799358 None] Flow 'volume_create_manager' (762de78a-a3a2-4770-a5ec-03aa053a2ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f4fba007-6a03-4189-af21-298f321f8a7b tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07b6a1de-fe41-4285-b814-c273f3763cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:58 devstack sudo[100015]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f4fba007-6a03-4189-af21-298f321f8a7b tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07b6a1de-fe41-4285-b814-c273f3763cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1112077928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6eb85ca-4832-4f36-9997-03377bc90270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17331119b8144fed81105498eb69de84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:58Z,use_quota=True,user_id='31e99db2c0a14559b072071476710f39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f4fba007-6a03-4189-af21-298f321f8a7b tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c2456b8-4a2e-459d-9084-b623b1b1ae5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f4fba007-6a03-4189-af21-298f321f8a7b tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c2456b8-4a2e-459d-9084-b623b1b1ae5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f4fba007-6a03-4189-af21-298f321f8a7b tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a32d731-ba19-4d6b-aa3d-b0f5e1371571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f4fba007-6a03-4189-af21-298f321f8a7b tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a32d731-ba19-4d6b-aa3d-b0f5e1371571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6eb85ca-4832-4f36-9997-03377bc90270', 'volume_name': 'volume-e6eb85ca-4832-4f36-9997-03377bc90270', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f4fba007-6a03-4189-af21-298f321f8a7b tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c516cff-d527-4d2d-9780-a77f59f85e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f4fba007-6a03-4189-af21-298f321f8a7b tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c516cff-d527-4d2d-9780-a77f59f85e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f4fba007-6a03-4189-af21-298f321f8a7b tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2da3c9db-8b8f-4e85-8ef1-ad9aec2060a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:58 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-f4fba007-6a03-4189-af21-298f321f8a7b tempest-CreateVolumesFromImageTest-698799358 None] Volume e6eb85ca-4832-4f36-9997-03377bc90270: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6eb85ca-4832-4f36-9997-03377bc90270', 'volume_size': 1} Nov 03 20:27:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f4fba007-6a03-4189-af21-298f321f8a7b tempest-CreateVolumesFromImageTest-698799358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8755beca-70fd-4dfa-8cd3-d8f3e21ae1ff tempest-CreateVolumesFromImageTest-698799358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00d26390-f0a4-49bc-90bf-3dc84edad41d 1073741824" returned: 0 in 1.564s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8755beca-70fd-4dfa-8cd3-d8f3e21ae1ff tempest-CreateVolumesFromImageTest-698799358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00d26390-f0a4-49bc-90bf-3dc84edad41d {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:58 devstack sudo[100022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00d26390-f0a4-49bc-90bf-3dc84edad41d Nov 03 20:27:58 devstack sudo[100022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:59 devstack sudo[100022]: pam_unix(sudo:session): session closed for user root Nov 03 20:27:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8755beca-70fd-4dfa-8cd3-d8f3e21ae1ff tempest-CreateVolumesFromImageTest-698799358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00d26390-f0a4-49bc-90bf-3dc84edad41d" returned: 0 in 0.512s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:27:59 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8755beca-70fd-4dfa-8cd3-d8f3e21ae1ff tempest-CreateVolumesFromImageTest-698799358 None] <== create_volume: return (2200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:27:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8755beca-70fd-4dfa-8cd3-d8f3e21ae1ff tempest-CreateVolumesFromImageTest-698799358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.203s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-f54bd8a0-e7d2-49cb-bb73-be9faf4edc50 req-8d289d50-9931-4304-a90d-b4e8f5adbc8d tempest-TestServerVolumeAttachmentScenario-1934017498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.774s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:59 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8755beca-70fd-4dfa-8cd3-d8f3e21ae1ff tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (010474d2-2f0d-4d2e-b2ca-f86777eb81d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00d26390-f0a4-49bc-90bf-3dc84edad41d', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:59 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8755beca-70fd-4dfa-8cd3-d8f3e21ae1ff tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f509eb5b-33e0-40be-b90f-88527ee49ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-f54bd8a0-e7d2-49cb-bb73-be9faf4edc50 req-8d289d50-9931-4304-a90d-b4e8f5adbc8d tempest-TestServerVolumeAttachmentScenario-1934017498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.077s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2ecd56a2-03a0-4a75-8894-bf5afa970417 tempest-CreateVolumesFromImageTest-698799358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.435s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:59 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2ecd56a2-03a0-4a75-8894-bf5afa970417 tempest-CreateVolumesFromImageTest-698799358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2109228523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efeaad70-a625-44ed-8d67-277d65163a5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17331119b8144fed81105498eb69de84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:57Z,use_quota=True,user_id='31e99db2c0a14559b072071476710f39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:27:59 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-2ecd56a2-03a0-4a75-8894-bf5afa970417 tempest-CreateVolumesFromImageTest-698799358 None] Creating volume efeaad70-a625-44ed-8d67-277d65163a5c {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:27:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2ecd56a2-03a0-4a75-8894-bf5afa970417 tempest-CreateVolumesFromImageTest-698799358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:27:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2ecd56a2-03a0-4a75-8894-bf5afa970417 tempest-CreateVolumesFromImageTest-698799358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:27:59 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2ecd56a2-03a0-4a75-8894-bf5afa970417 tempest-CreateVolumesFromImageTest-698799358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:27:59 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2ecd56a2-03a0-4a75-8894-bf5afa970417 tempest-CreateVolumesFromImageTest-698799358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:27:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2ecd56a2-03a0-4a75-8894-bf5afa970417 tempest-CreateVolumesFromImageTest-698799358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:27:59 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2ecd56a2-03a0-4a75-8894-bf5afa970417 tempest-CreateVolumesFromImageTest-698799358 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:27:59 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-2ecd56a2-03a0-4a75-8894-bf5afa970417 tempest-CreateVolumesFromImageTest-698799358 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:27:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2ecd56a2-03a0-4a75-8894-bf5afa970417 tempest-CreateVolumesFromImageTest-698799358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-efeaad70-a625-44ed-8d67-277d65163a5c 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:27:59 devstack sudo[100025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-efeaad70-a625-44ed-8d67-277d65163a5c 1073741824 Nov 03 20:27:59 devstack sudo[100025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:27:59 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-8755beca-70fd-4dfa-8cd3-d8f3e21ae1ff tempest-CreateVolumesFromImageTest-698799358 None] Volume volume-00d26390-f0a4-49bc-90bf-3dc84edad41d (00d26390-f0a4-49bc-90bf-3dc84edad41d): created successfully Nov 03 20:27:59 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8755beca-70fd-4dfa-8cd3-d8f3e21ae1ff tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f509eb5b-33e0-40be-b90f-88527ee49ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:59 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8755beca-70fd-4dfa-8cd3-d8f3e21ae1ff tempest-CreateVolumesFromImageTest-698799358 None] Flow 'volume_create_manager' (43c530fb-19bc-446c-9b5d-58ce33c0acd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:59 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-8755beca-70fd-4dfa-8cd3-d8f3e21ae1ff tempest-CreateVolumesFromImageTest-698799358 None] Created volume successfully. Nov 03 20:27:59 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-f54bd8a0-e7d2-49cb-bb73-be9faf4edc50 req-8d289d50-9931-4304-a90d-b4e8f5adbc8d tempest-TestServerVolumeAttachmentScenario-1934017498 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8', 'name': 'volume-32f63e3e-a888-48e8-82aa-6d035c6360fa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '50030463-753f-42cc-b34e-783a088df3f6', 'enforce_multipath': True} {{(pid=87248) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 20:27:59 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-f54bd8a0-e7d2-49cb-bb73-be9faf4edc50 req-8d289d50-9931-4304-a90d-b4e8f5adbc8d tempest-TestServerVolumeAttachmentScenario-1934017498 None] attachment_update completed successfully. Nov 03 20:27:59 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-78a7acff-a750-45f0-ad74-44f2c6bf3ad2 tempest-CreateVolumesFromImageTest-698799358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:27:59 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-78a7acff-a750-45f0-ad74-44f2c6bf3ad2 tempest-CreateVolumesFromImageTest-698799358 None] Flow 'volume_create_manager' (5d0e9358-726a-4208-8983-912f683026ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:27:59 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-78a7acff-a750-45f0-ad74-44f2c6bf3ad2 tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3c3a760-7ebc-429e-9da7-5e1c82900b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:59 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-78a7acff-a750-45f0-ad74-44f2c6bf3ad2 tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3c3a760-7ebc-429e-9da7-5e1c82900b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1090426560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3290f843-eb59-4470-b6ec-de67242de727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17331119b8144fed81105498eb69de84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:28:00Z,use_quota=True,user_id='31e99db2c0a14559b072071476710f39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:27:59 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-78a7acff-a750-45f0-ad74-44f2c6bf3ad2 tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8be7d98c-ce1e-4843-bac2-b23654885309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:27:59 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-78a7acff-a750-45f0-ad74-44f2c6bf3ad2 tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8be7d98c-ce1e-4843-bac2-b23654885309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-78a7acff-a750-45f0-ad74-44f2c6bf3ad2 tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f2a5772-ffa7-4a5a-8b89-0ae51ad2a056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-78a7acff-a750-45f0-ad74-44f2c6bf3ad2 tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f2a5772-ffa7-4a5a-8b89-0ae51ad2a056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3290f843-eb59-4470-b6ec-de67242de727', 'volume_name': 'volume-3290f843-eb59-4470-b6ec-de67242de727', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-78a7acff-a750-45f0-ad74-44f2c6bf3ad2 tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd733ada-142a-49f5-bb6d-eb4b337e19ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-78a7acff-a750-45f0-ad74-44f2c6bf3ad2 tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd733ada-142a-49f5-bb6d-eb4b337e19ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-78a7acff-a750-45f0-ad74-44f2c6bf3ad2 tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40dd4c38-4bbb-47de-9b10-2a6e8d2c632f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:00 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-78a7acff-a750-45f0-ad74-44f2c6bf3ad2 tempest-CreateVolumesFromImageTest-698799358 None] Volume 3290f843-eb59-4470-b6ec-de67242de727: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3290f843-eb59-4470-b6ec-de67242de727', 'volume_size': 1} Nov 03 20:28:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-78a7acff-a750-45f0-ad74-44f2c6bf3ad2 tempest-CreateVolumesFromImageTest-698799358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:28:00 devstack sudo[100025]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2ecd56a2-03a0-4a75-8894-bf5afa970417 tempest-CreateVolumesFromImageTest-698799358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-efeaad70-a625-44ed-8d67-277d65163a5c 1073741824" returned: 0 in 1.280s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2ecd56a2-03a0-4a75-8894-bf5afa970417 tempest-CreateVolumesFromImageTest-698799358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-efeaad70-a625-44ed-8d67-277d65163a5c {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:00 devstack sudo[100034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-efeaad70-a625-44ed-8d67-277d65163a5c Nov 03 20:28:00 devstack sudo[100034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:01 devstack sudo[100034]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2ecd56a2-03a0-4a75-8894-bf5afa970417 tempest-CreateVolumesFromImageTest-698799358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-efeaad70-a625-44ed-8d67-277d65163a5c" returned: 0 in 0.469s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:01 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2ecd56a2-03a0-4a75-8894-bf5afa970417 tempest-CreateVolumesFromImageTest-698799358 None] <== create_volume: return (1915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:28:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2ecd56a2-03a0-4a75-8894-bf5afa970417 tempest-CreateVolumesFromImageTest-698799358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.929s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:28:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f4fba007-6a03-4189-af21-298f321f8a7b tempest-CreateVolumesFromImageTest-698799358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.656s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:28:01 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-f4fba007-6a03-4189-af21-298f321f8a7b tempest-CreateVolumesFromImageTest-698799358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1112077928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6eb85ca-4832-4f36-9997-03377bc90270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17331119b8144fed81105498eb69de84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:27:58Z,use_quota=True,user_id='31e99db2c0a14559b072071476710f39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:28:01 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-f4fba007-6a03-4189-af21-298f321f8a7b tempest-CreateVolumesFromImageTest-698799358 None] Creating volume e6eb85ca-4832-4f36-9997-03377bc90270 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:28:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f4fba007-6a03-4189-af21-298f321f8a7b tempest-CreateVolumesFromImageTest-698799358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:28:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f4fba007-6a03-4189-af21-298f321f8a7b tempest-CreateVolumesFromImageTest-698799358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:28:01 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-f4fba007-6a03-4189-af21-298f321f8a7b tempest-CreateVolumesFromImageTest-698799358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:28:01 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-f4fba007-6a03-4189-af21-298f321f8a7b tempest-CreateVolumesFromImageTest-698799358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:28:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f4fba007-6a03-4189-af21-298f321f8a7b tempest-CreateVolumesFromImageTest-698799358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:28:01 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-f4fba007-6a03-4189-af21-298f321f8a7b tempest-CreateVolumesFromImageTest-698799358 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:28:01 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-f4fba007-6a03-4189-af21-298f321f8a7b tempest-CreateVolumesFromImageTest-698799358 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:28:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f4fba007-6a03-4189-af21-298f321f8a7b tempest-CreateVolumesFromImageTest-698799358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e6eb85ca-4832-4f36-9997-03377bc90270 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:01 devstack sudo[100038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e6eb85ca-4832-4f36-9997-03377bc90270 1073741824 Nov 03 20:28:01 devstack sudo[100038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2ecd56a2-03a0-4a75-8894-bf5afa970417 tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (871a5c7c-436e-4076-b7b6-14c47ccda5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efeaad70-a625-44ed-8d67-277d65163a5c', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2ecd56a2-03a0-4a75-8894-bf5afa970417 tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62557f94-a282-4116-bc6e-ca694ba7d3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:01 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-2ecd56a2-03a0-4a75-8894-bf5afa970417 tempest-CreateVolumesFromImageTest-698799358 None] Volume volume-efeaad70-a625-44ed-8d67-277d65163a5c (efeaad70-a625-44ed-8d67-277d65163a5c): created successfully Nov 03 20:28:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2ecd56a2-03a0-4a75-8894-bf5afa970417 tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62557f94-a282-4116-bc6e-ca694ba7d3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2ecd56a2-03a0-4a75-8894-bf5afa970417 tempest-CreateVolumesFromImageTest-698799358 None] Flow 'volume_create_manager' (42e07aa3-9bcc-44ea-a17f-ccd3ee000676) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:28:01 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-2ecd56a2-03a0-4a75-8894-bf5afa970417 tempest-CreateVolumesFromImageTest-698799358 None] Created volume successfully. Nov 03 20:28:02 devstack sudo[100038]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f4fba007-6a03-4189-af21-298f321f8a7b tempest-CreateVolumesFromImageTest-698799358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e6eb85ca-4832-4f36-9997-03377bc90270 1073741824" returned: 0 in 1.005s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f4fba007-6a03-4189-af21-298f321f8a7b tempest-CreateVolumesFromImageTest-698799358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e6eb85ca-4832-4f36-9997-03377bc90270 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:02 devstack sudo[100075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e6eb85ca-4832-4f36-9997-03377bc90270 Nov 03 20:28:02 devstack sudo[100075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:02 devstack sudo[100075]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f4fba007-6a03-4189-af21-298f321f8a7b tempest-CreateVolumesFromImageTest-698799358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e6eb85ca-4832-4f36-9997-03377bc90270" returned: 0 in 0.716s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:02 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-f4fba007-6a03-4189-af21-298f321f8a7b tempest-CreateVolumesFromImageTest-698799358 None] <== create_volume: return (1834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:28:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f4fba007-6a03-4189-af21-298f321f8a7b tempest-CreateVolumesFromImageTest-698799358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.839s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:28:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-78a7acff-a750-45f0-ad74-44f2c6bf3ad2 tempest-CreateVolumesFromImageTest-698799358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.879s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:28:03 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-78a7acff-a750-45f0-ad74-44f2c6bf3ad2 tempest-CreateVolumesFromImageTest-698799358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1090426560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3290f843-eb59-4470-b6ec-de67242de727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17331119b8144fed81105498eb69de84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:28:00Z,use_quota=True,user_id='31e99db2c0a14559b072071476710f39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:28:03 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-78a7acff-a750-45f0-ad74-44f2c6bf3ad2 tempest-CreateVolumesFromImageTest-698799358 None] Creating volume 3290f843-eb59-4470-b6ec-de67242de727 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:28:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-78a7acff-a750-45f0-ad74-44f2c6bf3ad2 tempest-CreateVolumesFromImageTest-698799358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:28:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-78a7acff-a750-45f0-ad74-44f2c6bf3ad2 tempest-CreateVolumesFromImageTest-698799358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:28:03 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-78a7acff-a750-45f0-ad74-44f2c6bf3ad2 tempest-CreateVolumesFromImageTest-698799358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:28:03 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-78a7acff-a750-45f0-ad74-44f2c6bf3ad2 tempest-CreateVolumesFromImageTest-698799358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:28:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-78a7acff-a750-45f0-ad74-44f2c6bf3ad2 tempest-CreateVolumesFromImageTest-698799358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:28:03 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-78a7acff-a750-45f0-ad74-44f2c6bf3ad2 tempest-CreateVolumesFromImageTest-698799358 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:28:03 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-78a7acff-a750-45f0-ad74-44f2c6bf3ad2 tempest-CreateVolumesFromImageTest-698799358 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:28:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-78a7acff-a750-45f0-ad74-44f2c6bf3ad2 tempest-CreateVolumesFromImageTest-698799358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3290f843-eb59-4470-b6ec-de67242de727 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:03 devstack sudo[100078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3290f843-eb59-4470-b6ec-de67242de727 1073741824 Nov 03 20:28:03 devstack sudo[100078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:03 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f4fba007-6a03-4189-af21-298f321f8a7b tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2da3c9db-8b8f-4e85-8ef1-ad9aec2060a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6eb85ca-4832-4f36-9997-03377bc90270', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:03 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f4fba007-6a03-4189-af21-298f321f8a7b tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1e7a0a0-c4b7-46d5-93f3-5c0f19f7dba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:03 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-f4fba007-6a03-4189-af21-298f321f8a7b tempest-CreateVolumesFromImageTest-698799358 None] Volume volume-e6eb85ca-4832-4f36-9997-03377bc90270 (e6eb85ca-4832-4f36-9997-03377bc90270): created successfully Nov 03 20:28:03 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f4fba007-6a03-4189-af21-298f321f8a7b tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1e7a0a0-c4b7-46d5-93f3-5c0f19f7dba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:03 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f4fba007-6a03-4189-af21-298f321f8a7b tempest-CreateVolumesFromImageTest-698799358 None] Flow 'volume_create_manager' (762de78a-a3a2-4770-a5ec-03aa053a2ece) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:28:03 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-f4fba007-6a03-4189-af21-298f321f8a7b tempest-CreateVolumesFromImageTest-698799358 None] Created volume successfully. Nov 03 20:28:04 devstack sudo[100078]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-78a7acff-a750-45f0-ad74-44f2c6bf3ad2 tempest-CreateVolumesFromImageTest-698799358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3290f843-eb59-4470-b6ec-de67242de727 1073741824" returned: 0 in 1.024s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-78a7acff-a750-45f0-ad74-44f2c6bf3ad2 tempest-CreateVolumesFromImageTest-698799358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3290f843-eb59-4470-b6ec-de67242de727 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:04 devstack sudo[100085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3290f843-eb59-4470-b6ec-de67242de727 Nov 03 20:28:04 devstack sudo[100085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:04 devstack sudo[100085]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-78a7acff-a750-45f0-ad74-44f2c6bf3ad2 tempest-CreateVolumesFromImageTest-698799358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3290f843-eb59-4470-b6ec-de67242de727" returned: 0 in 0.439s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:04 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-78a7acff-a750-45f0-ad74-44f2c6bf3ad2 tempest-CreateVolumesFromImageTest-698799358 None] <== create_volume: return (1573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:28:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-78a7acff-a750-45f0-ad74-44f2c6bf3ad2 tempest-CreateVolumesFromImageTest-698799358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:28:04 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-78a7acff-a750-45f0-ad74-44f2c6bf3ad2 tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40dd4c38-4bbb-47de-9b10-2a6e8d2c632f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3290f843-eb59-4470-b6ec-de67242de727', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:04 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-78a7acff-a750-45f0-ad74-44f2c6bf3ad2 tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42437d87-642c-4e70-be0a-6105af8ad766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:04 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-78a7acff-a750-45f0-ad74-44f2c6bf3ad2 tempest-CreateVolumesFromImageTest-698799358 None] Volume volume-3290f843-eb59-4470-b6ec-de67242de727 (3290f843-eb59-4470-b6ec-de67242de727): created successfully Nov 03 20:28:04 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-78a7acff-a750-45f0-ad74-44f2c6bf3ad2 tempest-CreateVolumesFromImageTest-698799358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42437d87-642c-4e70-be0a-6105af8ad766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:04 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-78a7acff-a750-45f0-ad74-44f2c6bf3ad2 tempest-CreateVolumesFromImageTest-698799358 None] Flow 'volume_create_manager' (5d0e9358-726a-4208-8983-912f683026ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:28:04 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-78a7acff-a750-45f0-ad74-44f2c6bf3ad2 tempest-CreateVolumesFromImageTest-698799358 None] Created volume successfully. Nov 03 20:28:05 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e7357f0a-0484-4ff5-b5f8-dca406de6c29 tempest-CreateVolumesFromImageTest-698799358 None] Acquiring lock "cinder-3290f843-eb59-4470-b6ec-de67242de727-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:28:05 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e7357f0a-0484-4ff5-b5f8-dca406de6c29 tempest-CreateVolumesFromImageTest-698799358 None] Lock "cinder-3290f843-eb59-4470-b6ec-de67242de727-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:28:05 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e7357f0a-0484-4ff5-b5f8-dca406de6c29 tempest-CreateVolumesFromImageTest-698799358 None] Acquiring lock "cinder-quobyte-3290f843-eb59-4470-b6ec-de67242de727" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:28:05 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e7357f0a-0484-4ff5-b5f8-dca406de6c29 tempest-CreateVolumesFromImageTest-698799358 None] Lock "cinder-quobyte-3290f843-eb59-4470-b6ec-de67242de727" acquired by "delete_volume" :: waited 0.054s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:28:05 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a93a4be-2fc4-4d4f-bbfc-f23cd116af68]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:28:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e7357f0a-0484-4ff5-b5f8-dca406de6c29 tempest-CreateVolumesFromImageTest-698799358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3290f843-eb59-4470-b6ec-de67242de727 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:06 devstack sudo[100123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3290f843-eb59-4470-b6ec-de67242de727 Nov 03 20:28:06 devstack sudo[100123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:07 devstack sudo[100123]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e7357f0a-0484-4ff5-b5f8-dca406de6c29 tempest-CreateVolumesFromImageTest-698799358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3290f843-eb59-4470-b6ec-de67242de727" returned: 0 in 1.113s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e7357f0a-0484-4ff5-b5f8-dca406de6c29 tempest-CreateVolumesFromImageTest-698799358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3290f843-eb59-4470-b6ec-de67242de727 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:07 devstack sudo[100130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3290f843-eb59-4470-b6ec-de67242de727 Nov 03 20:28:07 devstack sudo[100130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:07 devstack sudo[100130]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e7357f0a-0484-4ff5-b5f8-dca406de6c29 tempest-CreateVolumesFromImageTest-698799358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3290f843-eb59-4470-b6ec-de67242de727" returned: 0 in 0.484s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:07 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e7357f0a-0484-4ff5-b5f8-dca406de6c29 tempest-CreateVolumesFromImageTest-698799358 None] Lock "cinder-quobyte-3290f843-eb59-4470-b6ec-de67242de727" released by "delete_volume" :: held 1.737s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:28:07 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-e7357f0a-0484-4ff5-b5f8-dca406de6c29 tempest-CreateVolumesFromImageTest-698799358 None] Created reservations ['3019a454-111a-4559-a2f9-1276b5620fe0', '3c7b7222-54c7-48d0-b95b-248f0f092da6', '24b37eb9-fa26-44b8-a7c7-f8e85f39b2ae', '21242be3-5ad0-4d0e-87e6-3be66c6d3e28'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:28:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e7357f0a-0484-4ff5-b5f8-dca406de6c29 tempest-CreateVolumesFromImageTest-698799358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:28:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e7357f0a-0484-4ff5-b5f8-dca406de6c29 tempest-CreateVolumesFromImageTest-698799358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:28:07 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e7357f0a-0484-4ff5-b5f8-dca406de6c29 tempest-CreateVolumesFromImageTest-698799358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:28:07 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e7357f0a-0484-4ff5-b5f8-dca406de6c29 tempest-CreateVolumesFromImageTest-698799358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:28:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e7357f0a-0484-4ff5-b5f8-dca406de6c29 tempest-CreateVolumesFromImageTest-698799358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:28:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e7357f0a-0484-4ff5-b5f8-dca406de6c29 tempest-CreateVolumesFromImageTest-698799358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:07 devstack sudo[100136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:28:07 devstack sudo[100136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:08 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-76db7a63-add9-4612-b770-7d0fdacea11a tempest-CreateVolumesFromImageTest-698799358 None] Acquiring lock "cinder-e6eb85ca-4832-4f36-9997-03377bc90270-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:28:08 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-76db7a63-add9-4612-b770-7d0fdacea11a tempest-CreateVolumesFromImageTest-698799358 None] Lock "cinder-e6eb85ca-4832-4f36-9997-03377bc90270-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:28:08 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-76db7a63-add9-4612-b770-7d0fdacea11a tempest-CreateVolumesFromImageTest-698799358 None] Acquiring lock "cinder-quobyte-e6eb85ca-4832-4f36-9997-03377bc90270" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:28:08 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-76db7a63-add9-4612-b770-7d0fdacea11a tempest-CreateVolumesFromImageTest-698799358 None] Lock "cinder-quobyte-e6eb85ca-4832-4f36-9997-03377bc90270" acquired by "delete_volume" :: waited 0.035s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:28:08 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[28daa8cc-22fe-436e-b83e-6908ffb32cec]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:28:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-76db7a63-add9-4612-b770-7d0fdacea11a tempest-CreateVolumesFromImageTest-698799358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e6eb85ca-4832-4f36-9997-03377bc90270 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:08 devstack sudo[100138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e6eb85ca-4832-4f36-9997-03377bc90270 Nov 03 20:28:08 devstack sudo[100138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:08 devstack sudo[100136]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e7357f0a-0484-4ff5-b5f8-dca406de6c29 tempest-CreateVolumesFromImageTest-698799358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.714s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:08 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-e7357f0a-0484-4ff5-b5f8-dca406de6c29 tempest-CreateVolumesFromImageTest-698799358 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:28:08 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-e7357f0a-0484-4ff5-b5f8-dca406de6c29 tempest-CreateVolumesFromImageTest-698799358 None] Deleted volume successfully. Nov 03 20:28:08 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e7357f0a-0484-4ff5-b5f8-dca406de6c29 tempest-CreateVolumesFromImageTest-698799358 None] Lock "cinder-3290f843-eb59-4470-b6ec-de67242de727-delete_volume" released by "delete_volume" :: held 3.034s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:28:09 devstack sudo[100138]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-76db7a63-add9-4612-b770-7d0fdacea11a tempest-CreateVolumesFromImageTest-698799358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e6eb85ca-4832-4f36-9997-03377bc90270" returned: 0 in 0.839s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-76db7a63-add9-4612-b770-7d0fdacea11a tempest-CreateVolumesFromImageTest-698799358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e6eb85ca-4832-4f36-9997-03377bc90270 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-6052a370-ff50-4907-995e-5b384072ff97 req-fab28a61-6383-49f2-8b95-619df2073d9b tempest-TestServerVolumeAttachmentScenario-1934017498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:28:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-6052a370-ff50-4907-995e-5b384072ff97 req-fab28a61-6383-49f2-8b95-619df2073d9b tempest-TestServerVolumeAttachmentScenario-1934017498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:28:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-6052a370-ff50-4907-995e-5b384072ff97 req-fab28a61-6383-49f2-8b95-619df2073d9b tempest-TestServerVolumeAttachmentScenario-1934017498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:28:09 devstack sudo[100154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e6eb85ca-4832-4f36-9997-03377bc90270 Nov 03 20:28:09 devstack sudo[100154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:09 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-6052a370-ff50-4907-995e-5b384072ff97 req-fab28a61-6383-49f2-8b95-619df2073d9b tempest-TestServerVolumeAttachmentScenario-1934017498 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8', 'name': 'volume-13f7bb77-4aed-4900-89e2-dd8a858c05df', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6b15b1ad-fd2b-4bf5-ab07-4ae1f1c20255', 'enforce_multipath': True} {{(pid=87248) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 20:28:09 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-6052a370-ff50-4907-995e-5b384072ff97 req-fab28a61-6383-49f2-8b95-619df2073d9b tempest-TestServerVolumeAttachmentScenario-1934017498 None] attachment_update completed successfully. Nov 03 20:28:09 devstack sudo[100154]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-76db7a63-add9-4612-b770-7d0fdacea11a tempest-CreateVolumesFromImageTest-698799358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e6eb85ca-4832-4f36-9997-03377bc90270" returned: 0 in 0.510s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:09 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-76db7a63-add9-4612-b770-7d0fdacea11a tempest-CreateVolumesFromImageTest-698799358 None] Lock "cinder-quobyte-e6eb85ca-4832-4f36-9997-03377bc90270" released by "delete_volume" :: held 1.463s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:28:09 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-76db7a63-add9-4612-b770-7d0fdacea11a tempest-CreateVolumesFromImageTest-698799358 None] Created reservations ['6170c3ad-6215-44cf-af04-f35d87f2b235', '690f80b9-0c14-4a9d-9383-b2ef2399a354', '9abfd1ab-9da2-43de-bc0d-67d68c07b247', '497d93e8-06e4-46cd-9fac-47c88e6c8629'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:28:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-76db7a63-add9-4612-b770-7d0fdacea11a tempest-CreateVolumesFromImageTest-698799358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:28:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-76db7a63-add9-4612-b770-7d0fdacea11a tempest-CreateVolumesFromImageTest-698799358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:28:09 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-76db7a63-add9-4612-b770-7d0fdacea11a tempest-CreateVolumesFromImageTest-698799358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:28:09 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-76db7a63-add9-4612-b770-7d0fdacea11a tempest-CreateVolumesFromImageTest-698799358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:28:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-76db7a63-add9-4612-b770-7d0fdacea11a tempest-CreateVolumesFromImageTest-698799358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:28:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-76db7a63-add9-4612-b770-7d0fdacea11a tempest-CreateVolumesFromImageTest-698799358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:10 devstack sudo[100185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:28:10 devstack sudo[100185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:10 devstack sudo[100185]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-76db7a63-add9-4612-b770-7d0fdacea11a tempest-CreateVolumesFromImageTest-698799358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.406s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:10 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-76db7a63-add9-4612-b770-7d0fdacea11a tempest-CreateVolumesFromImageTest-698799358 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:28:10 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-76db7a63-add9-4612-b770-7d0fdacea11a tempest-CreateVolumesFromImageTest-698799358 None] Deleted volume successfully. Nov 03 20:28:10 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-76db7a63-add9-4612-b770-7d0fdacea11a tempest-CreateVolumesFromImageTest-698799358 None] Lock "cinder-e6eb85ca-4832-4f36-9997-03377bc90270-delete_volume" released by "delete_volume" :: held 2.416s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:28:10 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ab025a42-290a-4142-9de8-02ea5d01aa5d tempest-CreateVolumesFromImageTest-698799358 None] Acquiring lock "cinder-efeaad70-a625-44ed-8d67-277d65163a5c-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:28:10 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ab025a42-290a-4142-9de8-02ea5d01aa5d tempest-CreateVolumesFromImageTest-698799358 None] Lock "cinder-efeaad70-a625-44ed-8d67-277d65163a5c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:28:10 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ab025a42-290a-4142-9de8-02ea5d01aa5d tempest-CreateVolumesFromImageTest-698799358 None] Acquiring lock "cinder-quobyte-efeaad70-a625-44ed-8d67-277d65163a5c" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:28:10 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ab025a42-290a-4142-9de8-02ea5d01aa5d tempest-CreateVolumesFromImageTest-698799358 None] Lock "cinder-quobyte-efeaad70-a625-44ed-8d67-277d65163a5c" acquired by "delete_volume" :: waited 0.030s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:28:10 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d47a3af-2345-4ec3-b76b-469c074ab699]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:28:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ab025a42-290a-4142-9de8-02ea5d01aa5d tempest-CreateVolumesFromImageTest-698799358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-efeaad70-a625-44ed-8d67-277d65163a5c {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:10 devstack sudo[100188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-efeaad70-a625-44ed-8d67-277d65163a5c Nov 03 20:28:10 devstack sudo[100188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:11 devstack sudo[100188]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ab025a42-290a-4142-9de8-02ea5d01aa5d tempest-CreateVolumesFromImageTest-698799358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-efeaad70-a625-44ed-8d67-277d65163a5c" returned: 0 in 0.626s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ab025a42-290a-4142-9de8-02ea5d01aa5d tempest-CreateVolumesFromImageTest-698799358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-efeaad70-a625-44ed-8d67-277d65163a5c {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:11 devstack sudo[100193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-efeaad70-a625-44ed-8d67-277d65163a5c Nov 03 20:28:11 devstack sudo[100193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:11 devstack sudo[100193]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ab025a42-290a-4142-9de8-02ea5d01aa5d tempest-CreateVolumesFromImageTest-698799358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-efeaad70-a625-44ed-8d67-277d65163a5c" returned: 0 in 0.369s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:11 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-c0b01836-a095-4097-b6b0-3de41e7ff852 req-5a67cd5b-61d5-4e01-b9f2-c3c975bf7576 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Terminate volume connection completed successfully. Nov 03 20:28:11 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-c0b01836-a095-4097-b6b0-3de41e7ff852 req-5a67cd5b-61d5-4e01-b9f2-c3c975bf7576 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Deleting attachment 6b15b1ad-fd2b-4bf5-ab07-4ae1f1c20255. {{(pid=87248) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 20:28:11 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ab025a42-290a-4142-9de8-02ea5d01aa5d tempest-CreateVolumesFromImageTest-698799358 None] Lock "cinder-quobyte-efeaad70-a625-44ed-8d67-277d65163a5c" released by "delete_volume" :: held 1.092s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:28:11 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-ab025a42-290a-4142-9de8-02ea5d01aa5d tempest-CreateVolumesFromImageTest-698799358 None] Created reservations ['bfb7426a-185e-422f-aedd-13090f86673c', '084b475a-888a-4cab-b91f-6ebe0b160a50', '5f4e523d-df56-42d2-9430-d206f16839ea', 'b0ed12bc-34ef-434e-83a8-f690fc27145c'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:28:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ab025a42-290a-4142-9de8-02ea5d01aa5d tempest-CreateVolumesFromImageTest-698799358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:28:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ab025a42-290a-4142-9de8-02ea5d01aa5d tempest-CreateVolumesFromImageTest-698799358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:28:11 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-ab025a42-290a-4142-9de8-02ea5d01aa5d tempest-CreateVolumesFromImageTest-698799358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:28:11 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-ab025a42-290a-4142-9de8-02ea5d01aa5d tempest-CreateVolumesFromImageTest-698799358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:28:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ab025a42-290a-4142-9de8-02ea5d01aa5d tempest-CreateVolumesFromImageTest-698799358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:28:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ab025a42-290a-4142-9de8-02ea5d01aa5d tempest-CreateVolumesFromImageTest-698799358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:12 devstack sudo[100200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:28:12 devstack sudo[100200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:12 devstack sudo[100200]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ab025a42-290a-4142-9de8-02ea5d01aa5d tempest-CreateVolumesFromImageTest-698799358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.360s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:12 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-ab025a42-290a-4142-9de8-02ea5d01aa5d tempest-CreateVolumesFromImageTest-698799358 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:28:12 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-ab025a42-290a-4142-9de8-02ea5d01aa5d tempest-CreateVolumesFromImageTest-698799358 None] Deleted volume successfully. Nov 03 20:28:12 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ab025a42-290a-4142-9de8-02ea5d01aa5d tempest-CreateVolumesFromImageTest-698799358 None] Lock "cinder-efeaad70-a625-44ed-8d67-277d65163a5c-delete_volume" released by "delete_volume" :: held 1.775s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:28:12 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-861ccfe0-d009-4d0e-bec1-d8e708c0f62c tempest-CreateVolumesFromImageTest-698799358 None] Acquiring lock "cinder-00d26390-f0a4-49bc-90bf-3dc84edad41d-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:28:12 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-861ccfe0-d009-4d0e-bec1-d8e708c0f62c tempest-CreateVolumesFromImageTest-698799358 None] Lock "cinder-00d26390-f0a4-49bc-90bf-3dc84edad41d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:28:13 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-861ccfe0-d009-4d0e-bec1-d8e708c0f62c tempest-CreateVolumesFromImageTest-698799358 None] Acquiring lock "cinder-quobyte-00d26390-f0a4-49bc-90bf-3dc84edad41d" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:28:13 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-861ccfe0-d009-4d0e-bec1-d8e708c0f62c tempest-CreateVolumesFromImageTest-698799358 None] Lock "cinder-quobyte-00d26390-f0a4-49bc-90bf-3dc84edad41d" acquired by "delete_volume" :: waited 0.019s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:28:13 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90f094a-8774-45ca-8708-29b8208a523d]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:28:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-861ccfe0-d009-4d0e-bec1-d8e708c0f62c tempest-CreateVolumesFromImageTest-698799358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00d26390-f0a4-49bc-90bf-3dc84edad41d {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:13 devstack sudo[100204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00d26390-f0a4-49bc-90bf-3dc84edad41d Nov 03 20:28:13 devstack sudo[100204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:13 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-d26ef06d-bd58-4a3e-abd2-e0ee8776ad89 req-99b96bda-0605-42f6-be4f-c3b7c18ddcb9 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Terminate volume connection completed successfully. Nov 03 20:28:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-d26ef06d-bd58-4a3e-abd2-e0ee8776ad89 req-99b96bda-0605-42f6-be4f-c3b7c18ddcb9 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Deleting attachment 50030463-753f-42cc-b34e-783a088df3f6. {{(pid=87248) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 20:28:13 devstack sudo[100204]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-861ccfe0-d009-4d0e-bec1-d8e708c0f62c tempest-CreateVolumesFromImageTest-698799358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00d26390-f0a4-49bc-90bf-3dc84edad41d" returned: 0 in 0.428s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-861ccfe0-d009-4d0e-bec1-d8e708c0f62c tempest-CreateVolumesFromImageTest-698799358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00d26390-f0a4-49bc-90bf-3dc84edad41d {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:13 devstack sudo[100212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00d26390-f0a4-49bc-90bf-3dc84edad41d Nov 03 20:28:13 devstack sudo[100212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:13 devstack sudo[100212]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-861ccfe0-d009-4d0e-bec1-d8e708c0f62c tempest-CreateVolumesFromImageTest-698799358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00d26390-f0a4-49bc-90bf-3dc84edad41d" returned: 0 in 0.259s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:13 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-861ccfe0-d009-4d0e-bec1-d8e708c0f62c tempest-CreateVolumesFromImageTest-698799358 None] Lock "cinder-quobyte-00d26390-f0a4-49bc-90bf-3dc84edad41d" released by "delete_volume" :: held 0.736s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:28:13 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-861ccfe0-d009-4d0e-bec1-d8e708c0f62c tempest-CreateVolumesFromImageTest-698799358 None] Created reservations ['5db7c5e2-531a-49b4-b67d-a30000272aa6', '7e9c3f35-ef02-455d-be07-9e92d360b1ea', 'c7638757-97eb-4d41-a9d0-084304c4d3a5', '9c39ad48-9fef-499d-ba46-0bdc5fadf14f'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:28:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-861ccfe0-d009-4d0e-bec1-d8e708c0f62c tempest-CreateVolumesFromImageTest-698799358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:28:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-861ccfe0-d009-4d0e-bec1-d8e708c0f62c tempest-CreateVolumesFromImageTest-698799358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:28:13 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-861ccfe0-d009-4d0e-bec1-d8e708c0f62c tempest-CreateVolumesFromImageTest-698799358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:28:13 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-861ccfe0-d009-4d0e-bec1-d8e708c0f62c tempest-CreateVolumesFromImageTest-698799358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:28:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-861ccfe0-d009-4d0e-bec1-d8e708c0f62c tempest-CreateVolumesFromImageTest-698799358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:28:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-861ccfe0-d009-4d0e-bec1-d8e708c0f62c tempest-CreateVolumesFromImageTest-698799358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:13 devstack sudo[100215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:28:13 devstack sudo[100215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:14 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-0e565210-2fd6-48a8-a3b1-ecf6592c6b25 tempest-CreateVolumesFromImageTest-698799358 None] Acquiring lock "cinder-70ba6e52-5eec-478a-a445-3341f010c842-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:28:14 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-0e565210-2fd6-48a8-a3b1-ecf6592c6b25 tempest-CreateVolumesFromImageTest-698799358 None] Lock "cinder-70ba6e52-5eec-478a-a445-3341f010c842-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:28:14 devstack sudo[100215]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-861ccfe0-d009-4d0e-bec1-d8e708c0f62c tempest-CreateVolumesFromImageTest-698799358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.329s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:14 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-861ccfe0-d009-4d0e-bec1-d8e708c0f62c tempest-CreateVolumesFromImageTest-698799358 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:28:14 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-861ccfe0-d009-4d0e-bec1-d8e708c0f62c tempest-CreateVolumesFromImageTest-698799358 None] Deleted volume successfully. Nov 03 20:28:14 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-861ccfe0-d009-4d0e-bec1-d8e708c0f62c tempest-CreateVolumesFromImageTest-698799358 None] Lock "cinder-00d26390-f0a4-49bc-90bf-3dc84edad41d-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:28:14 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-0e565210-2fd6-48a8-a3b1-ecf6592c6b25 tempest-CreateVolumesFromImageTest-698799358 None] Acquiring lock "cinder-quobyte-70ba6e52-5eec-478a-a445-3341f010c842" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:28:14 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-0e565210-2fd6-48a8-a3b1-ecf6592c6b25 tempest-CreateVolumesFromImageTest-698799358 None] Lock "cinder-quobyte-70ba6e52-5eec-478a-a445-3341f010c842" acquired by "delete_volume" :: waited 0.015s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:28:14 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[60045b08-c921-4c9b-af40-d5def1a40322]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:28:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-0e565210-2fd6-48a8-a3b1-ecf6592c6b25 tempest-CreateVolumesFromImageTest-698799358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-70ba6e52-5eec-478a-a445-3341f010c842 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:14 devstack sudo[100218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-70ba6e52-5eec-478a-a445-3341f010c842 Nov 03 20:28:14 devstack sudo[100218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:14 devstack sudo[100218]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-0e565210-2fd6-48a8-a3b1-ecf6592c6b25 tempest-CreateVolumesFromImageTest-698799358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-70ba6e52-5eec-478a-a445-3341f010c842" returned: 0 in 0.481s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-0e565210-2fd6-48a8-a3b1-ecf6592c6b25 tempest-CreateVolumesFromImageTest-698799358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-70ba6e52-5eec-478a-a445-3341f010c842 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:14 devstack sudo[100235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-70ba6e52-5eec-478a-a445-3341f010c842 Nov 03 20:28:14 devstack sudo[100235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:15 devstack sudo[100235]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-0e565210-2fd6-48a8-a3b1-ecf6592c6b25 tempest-CreateVolumesFromImageTest-698799358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-70ba6e52-5eec-478a-a445-3341f010c842" returned: 0 in 0.479s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:15 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-0e565210-2fd6-48a8-a3b1-ecf6592c6b25 tempest-CreateVolumesFromImageTest-698799358 None] Lock "cinder-quobyte-70ba6e52-5eec-478a-a445-3341f010c842" released by "delete_volume" :: held 1.035s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:28:15 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-0e565210-2fd6-48a8-a3b1-ecf6592c6b25 tempest-CreateVolumesFromImageTest-698799358 None] Created reservations ['d724f4e5-fd55-4b4c-a158-53dc6d45deed', '39d24eed-7f6e-4e98-b50e-81e7d189c8cd', '8a5a14a2-62c0-4e7c-8d35-3b7e631a29d2', '1a06ce97-94c5-4aae-bef4-9c2025b4e7c7'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:28:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-0e565210-2fd6-48a8-a3b1-ecf6592c6b25 tempest-CreateVolumesFromImageTest-698799358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:28:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-0e565210-2fd6-48a8-a3b1-ecf6592c6b25 tempest-CreateVolumesFromImageTest-698799358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:28:15 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-0e565210-2fd6-48a8-a3b1-ecf6592c6b25 tempest-CreateVolumesFromImageTest-698799358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:28:15 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-0e565210-2fd6-48a8-a3b1-ecf6592c6b25 tempest-CreateVolumesFromImageTest-698799358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:28:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-0e565210-2fd6-48a8-a3b1-ecf6592c6b25 tempest-CreateVolumesFromImageTest-698799358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:28:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-0e565210-2fd6-48a8-a3b1-ecf6592c6b25 tempest-CreateVolumesFromImageTest-698799358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:15 devstack sudo[100249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:28:15 devstack sudo[100249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:16 devstack sudo[100249]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-0e565210-2fd6-48a8-a3b1-ecf6592c6b25 tempest-CreateVolumesFromImageTest-698799358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.462s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:16 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-0e565210-2fd6-48a8-a3b1-ecf6592c6b25 tempest-CreateVolumesFromImageTest-698799358 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:28:16 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-0e565210-2fd6-48a8-a3b1-ecf6592c6b25 tempest-CreateVolumesFromImageTest-698799358 None] Deleted volume successfully. Nov 03 20:28:16 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-0e565210-2fd6-48a8-a3b1-ecf6592c6b25 tempest-CreateVolumesFromImageTest-698799358 None] Lock "cinder-70ba6e52-5eec-478a-a445-3341f010c842-delete_volume" released by "delete_volume" :: held 1.947s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:28:19 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-47d66b0c-834e-4efc-9a30-f1d0ffb128e7 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Acquiring lock "cinder-13f7bb77-4aed-4900-89e2-dd8a858c05df-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:28:19 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-47d66b0c-834e-4efc-9a30-f1d0ffb128e7 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Lock "cinder-13f7bb77-4aed-4900-89e2-dd8a858c05df-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:28:19 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-47d66b0c-834e-4efc-9a30-f1d0ffb128e7 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Acquiring lock "cinder-quobyte-13f7bb77-4aed-4900-89e2-dd8a858c05df" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:28:19 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-47d66b0c-834e-4efc-9a30-f1d0ffb128e7 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Lock "cinder-quobyte-13f7bb77-4aed-4900-89e2-dd8a858c05df" acquired by "delete_volume" :: waited 0.015s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:28:19 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb7d426-c7dd-4e17-87a7-6d3f89d302f5]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:28:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-47d66b0c-834e-4efc-9a30-f1d0ffb128e7 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-13f7bb77-4aed-4900-89e2-dd8a858c05df {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:19 devstack sudo[100271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-13f7bb77-4aed-4900-89e2-dd8a858c05df Nov 03 20:28:19 devstack sudo[100271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:20 devstack sudo[100271]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-47d66b0c-834e-4efc-9a30-f1d0ffb128e7 tempest-TestServerVolumeAttachmentScenario-1934017498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-13f7bb77-4aed-4900-89e2-dd8a858c05df" returned: 0 in 0.445s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-47d66b0c-834e-4efc-9a30-f1d0ffb128e7 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-13f7bb77-4aed-4900-89e2-dd8a858c05df {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:20 devstack sudo[100278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-13f7bb77-4aed-4900-89e2-dd8a858c05df Nov 03 20:28:20 devstack sudo[100278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:20 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-107a207a-0223-4825-94b2-b4df4be438ee tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:28:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-107a207a-0223-4825-94b2-b4df4be438ee tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Flow 'volume_create_manager' (774b02f5-3f55-424c-88c6-92b2283a63fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:28:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-107a207a-0223-4825-94b2-b4df4be438ee tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c73d9f7-4d62-4e15-8100-4c27d5f68ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-107a207a-0223-4825-94b2-b4df4be438ee tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c73d9f7-4d62-4e15-8100-4c27d5f68ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-861562542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61eeb189-d60c-40ee-ba63-21e83d4aed80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc569c70a0134cbc88cf12869b1e6ece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:28:20Z,use_quota=True,user_id='db0ed3d309854e9d8bb5db6a488f5e77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-107a207a-0223-4825-94b2-b4df4be438ee tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a9c10e0-01aa-4c16-abef-6e6e2e0b6bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-107a207a-0223-4825-94b2-b4df4be438ee tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a9c10e0-01aa-4c16-abef-6e6e2e0b6bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-107a207a-0223-4825-94b2-b4df4be438ee tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (377d9466-b7a1-4b7e-bb99-0bbd6819b2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-107a207a-0223-4825-94b2-b4df4be438ee tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (377d9466-b7a1-4b7e-bb99-0bbd6819b2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61eeb189-d60c-40ee-ba63-21e83d4aed80', 'volume_name': 'volume-61eeb189-d60c-40ee-ba63-21e83d4aed80', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-107a207a-0223-4825-94b2-b4df4be438ee tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f213963-e0d2-4c3d-8169-6812f795604d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-107a207a-0223-4825-94b2-b4df4be438ee tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f213963-e0d2-4c3d-8169-6812f795604d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-107a207a-0223-4825-94b2-b4df4be438ee tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7375a773-6a4b-4492-8655-436d6a23af86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:20 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-107a207a-0223-4825-94b2-b4df4be438ee tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Volume 61eeb189-d60c-40ee-ba63-21e83d4aed80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61eeb189-d60c-40ee-ba63-21e83d4aed80', 'volume_size': 1} Nov 03 20:28:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-107a207a-0223-4825-94b2-b4df4be438ee tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:28:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-107a207a-0223-4825-94b2-b4df4be438ee tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:28:20 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-107a207a-0223-4825-94b2-b4df4be438ee tempest-CreateVolumesFromSourceVolumeTest-567487042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-861562542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61eeb189-d60c-40ee-ba63-21e83d4aed80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc569c70a0134cbc88cf12869b1e6ece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:28:20Z,use_quota=True,user_id='db0ed3d309854e9d8bb5db6a488f5e77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:28:20 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-107a207a-0223-4825-94b2-b4df4be438ee tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Creating volume 61eeb189-d60c-40ee-ba63-21e83d4aed80 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:28:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-107a207a-0223-4825-94b2-b4df4be438ee tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:28:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-107a207a-0223-4825-94b2-b4df4be438ee tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:28:20 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-107a207a-0223-4825-94b2-b4df4be438ee tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:28:20 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-107a207a-0223-4825-94b2-b4df4be438ee tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:28:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-107a207a-0223-4825-94b2-b4df4be438ee tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:28:20 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-107a207a-0223-4825-94b2-b4df4be438ee tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:28:20 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-107a207a-0223-4825-94b2-b4df4be438ee tempest-CreateVolumesFromSourceVolumeTest-567487042 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:28:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-107a207a-0223-4825-94b2-b4df4be438ee tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-61eeb189-d60c-40ee-ba63-21e83d4aed80 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:20 devstack sudo[100281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-61eeb189-d60c-40ee-ba63-21e83d4aed80 1073741824 Nov 03 20:28:20 devstack sudo[100281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:20 devstack sudo[100278]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-47d66b0c-834e-4efc-9a30-f1d0ffb128e7 tempest-TestServerVolumeAttachmentScenario-1934017498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-13f7bb77-4aed-4900-89e2-dd8a858c05df" returned: 0 in 0.289s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:20 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-47d66b0c-834e-4efc-9a30-f1d0ffb128e7 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Lock "cinder-quobyte-13f7bb77-4aed-4900-89e2-dd8a858c05df" released by "delete_volume" :: held 0.788s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:28:20 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-47d66b0c-834e-4efc-9a30-f1d0ffb128e7 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Created reservations ['df15c2ba-130d-4f30-94bc-8ec5e633b46b', 'ab3ef9dc-6f1c-4d0d-bdaa-b50c00a16fcb', 'cf0df9b5-717b-469b-a2a7-28a982a19df7', 'bf9a6059-d053-4746-aec1-74d7eb600be1'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:28:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-47d66b0c-834e-4efc-9a30-f1d0ffb128e7 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:28:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-47d66b0c-834e-4efc-9a30-f1d0ffb128e7 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:28:20 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-47d66b0c-834e-4efc-9a30-f1d0ffb128e7 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:28:20 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-47d66b0c-834e-4efc-9a30-f1d0ffb128e7 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:28:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-47d66b0c-834e-4efc-9a30-f1d0ffb128e7 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:28:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-47d66b0c-834e-4efc-9a30-f1d0ffb128e7 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:20 devstack sudo[100284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:28:20 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:20 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a443d9d7-2037-4553-98fc-fc29d70462d8 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Acquiring lock "cinder-32f63e3e-a888-48e8-82aa-6d035c6360fa-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:28:20 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a443d9d7-2037-4553-98fc-fc29d70462d8 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Lock "cinder-32f63e3e-a888-48e8-82aa-6d035c6360fa-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:28:20 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a443d9d7-2037-4553-98fc-fc29d70462d8 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Acquiring lock "cinder-quobyte-32f63e3e-a888-48e8-82aa-6d035c6360fa" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:28:21 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a443d9d7-2037-4553-98fc-fc29d70462d8 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Lock "cinder-quobyte-32f63e3e-a888-48e8-82aa-6d035c6360fa" acquired by "delete_volume" :: waited 0.038s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:28:21 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[1823823e-99dc-4878-97c3-89885f90e31b]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:28:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a443d9d7-2037-4553-98fc-fc29d70462d8 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-32f63e3e-a888-48e8-82aa-6d035c6360fa {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:21 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-47d66b0c-834e-4efc-9a30-f1d0ffb128e7 tempest-TestServerVolumeAttachmentScenario-1934017498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.505s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:21 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-47d66b0c-834e-4efc-9a30-f1d0ffb128e7 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:28:21 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-47d66b0c-834e-4efc-9a30-f1d0ffb128e7 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Deleted volume successfully. Nov 03 20:28:21 devstack sudo[100281]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-107a207a-0223-4825-94b2-b4df4be438ee tempest-CreateVolumesFromSourceVolumeTest-567487042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-61eeb189-d60c-40ee-ba63-21e83d4aed80 1073741824" returned: 0 in 0.823s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:21 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-47d66b0c-834e-4efc-9a30-f1d0ffb128e7 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Lock "cinder-13f7bb77-4aed-4900-89e2-dd8a858c05df-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:28:21 devstack sudo[100303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-32f63e3e-a888-48e8-82aa-6d035c6360fa Nov 03 20:28:21 devstack sudo[100303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-107a207a-0223-4825-94b2-b4df4be438ee tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-61eeb189-d60c-40ee-ba63-21e83d4aed80 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:21 devstack sudo[100312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-61eeb189-d60c-40ee-ba63-21e83d4aed80 Nov 03 20:28:21 devstack sudo[100312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:21 devstack sudo[100312]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-107a207a-0223-4825-94b2-b4df4be438ee tempest-CreateVolumesFromSourceVolumeTest-567487042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-61eeb189-d60c-40ee-ba63-21e83d4aed80" returned: 0 in 0.343s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-107a207a-0223-4825-94b2-b4df4be438ee tempest-CreateVolumesFromSourceVolumeTest-567487042 None] <== create_volume: return (1246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:28:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-107a207a-0223-4825-94b2-b4df4be438ee tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:28:21 devstack sudo[100303]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a443d9d7-2037-4553-98fc-fc29d70462d8 tempest-TestServerVolumeAttachmentScenario-1934017498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-32f63e3e-a888-48e8-82aa-6d035c6360fa" returned: 0 in 0.625s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a443d9d7-2037-4553-98fc-fc29d70462d8 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-32f63e3e-a888-48e8-82aa-6d035c6360fa {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:21 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-107a207a-0223-4825-94b2-b4df4be438ee tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7375a773-6a4b-4492-8655-436d6a23af86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61eeb189-d60c-40ee-ba63-21e83d4aed80', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:21 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-107a207a-0223-4825-94b2-b4df4be438ee tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77056217-9efb-4926-a18d-36850e68c361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:21 devstack sudo[100322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-32f63e3e-a888-48e8-82aa-6d035c6360fa Nov 03 20:28:21 devstack sudo[100322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:21 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-107a207a-0223-4825-94b2-b4df4be438ee tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Volume volume-61eeb189-d60c-40ee-ba63-21e83d4aed80 (61eeb189-d60c-40ee-ba63-21e83d4aed80): created successfully Nov 03 20:28:21 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-107a207a-0223-4825-94b2-b4df4be438ee tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77056217-9efb-4926-a18d-36850e68c361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:21 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-107a207a-0223-4825-94b2-b4df4be438ee tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Flow 'volume_create_manager' (774b02f5-3f55-424c-88c6-92b2283a63fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:28:21 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-107a207a-0223-4825-94b2-b4df4be438ee tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Created volume successfully. Nov 03 20:28:22 devstack sudo[100322]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a443d9d7-2037-4553-98fc-fc29d70462d8 tempest-TestServerVolumeAttachmentScenario-1934017498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-32f63e3e-a888-48e8-82aa-6d035c6360fa" returned: 0 in 0.302s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:22 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a443d9d7-2037-4553-98fc-fc29d70462d8 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Lock "cinder-quobyte-32f63e3e-a888-48e8-82aa-6d035c6360fa" released by "delete_volume" :: held 1.020s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:28:22 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-a443d9d7-2037-4553-98fc-fc29d70462d8 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Created reservations ['1afd942a-dee5-4be5-8660-4ba60b8dcb7a', '84edaccb-8697-4a09-8d46-fd1acac0be8e', '7ab907fa-fcc7-4e6e-91d5-bc5e79ef4a46', '0068c8ba-b692-4df4-9b9c-8fac92ede8e6'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:28:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a443d9d7-2037-4553-98fc-fc29d70462d8 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:28:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a443d9d7-2037-4553-98fc-fc29d70462d8 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:28:22 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a443d9d7-2037-4553-98fc-fc29d70462d8 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:28:22 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a443d9d7-2037-4553-98fc-fc29d70462d8 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:28:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a443d9d7-2037-4553-98fc-fc29d70462d8 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:28:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a443d9d7-2037-4553-98fc-fc29d70462d8 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:22 devstack sudo[100328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:28:22 devstack sudo[100328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:22 devstack sudo[100328]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a443d9d7-2037-4553-98fc-fc29d70462d8 tempest-TestServerVolumeAttachmentScenario-1934017498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.346s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:22 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-a443d9d7-2037-4553-98fc-fc29d70462d8 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:28:22 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-a443d9d7-2037-4553-98fc-fc29d70462d8 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Deleted volume successfully. Nov 03 20:28:22 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a443d9d7-2037-4553-98fc-fc29d70462d8 tempest-TestServerVolumeAttachmentScenario-1934017498 None] Lock "cinder-32f63e3e-a888-48e8-82aa-6d035c6360fa-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:28:23 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2f420c5-1f29-4a0c-98ea-8f9fd4435a99 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:28:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a2f420c5-1f29-4a0c-98ea-8f9fd4435a99 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Flow 'volume_create_manager' (446075fc-2df8-47a0-ab98-34c088d440d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:28:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a2f420c5-1f29-4a0c-98ea-8f9fd4435a99 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36ecc8a7-5258-4ea1-aa44-42b963839e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a2f420c5-1f29-4a0c-98ea-8f9fd4435a99 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36ecc8a7-5258-4ea1-aa44-42b963839e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1979444841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04a6d814-3a85-4cc9-8f04-b5fcaa0d2eb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc569c70a0134cbc88cf12869b1e6ece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:28:23Z,use_quota=True,user_id='db0ed3d309854e9d8bb5db6a488f5e77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a2f420c5-1f29-4a0c-98ea-8f9fd4435a99 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96dcd13f-0cc4-4367-8e04-3861e4bfa164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a2f420c5-1f29-4a0c-98ea-8f9fd4435a99 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96dcd13f-0cc4-4367-8e04-3861e4bfa164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a2f420c5-1f29-4a0c-98ea-8f9fd4435a99 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (687f6c3f-c540-4674-b44b-6fbf7b61433f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a2f420c5-1f29-4a0c-98ea-8f9fd4435a99 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (687f6c3f-c540-4674-b44b-6fbf7b61433f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04a6d814-3a85-4cc9-8f04-b5fcaa0d2eb9', 'volume_name': 'volume-04a6d814-3a85-4cc9-8f04-b5fcaa0d2eb9', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a2f420c5-1f29-4a0c-98ea-8f9fd4435a99 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5bb31d8-35a7-416e-9ac2-4f4392d979e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a2f420c5-1f29-4a0c-98ea-8f9fd4435a99 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5bb31d8-35a7-416e-9ac2-4f4392d979e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a2f420c5-1f29-4a0c-98ea-8f9fd4435a99 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b99d313-3246-49a0-83b2-f4e53cbfc00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:23 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-a2f420c5-1f29-4a0c-98ea-8f9fd4435a99 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Volume 04a6d814-3a85-4cc9-8f04-b5fcaa0d2eb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04a6d814-3a85-4cc9-8f04-b5fcaa0d2eb9', 'volume_size': 1} Nov 03 20:28:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a2f420c5-1f29-4a0c-98ea-8f9fd4435a99 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:28:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a2f420c5-1f29-4a0c-98ea-8f9fd4435a99 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:28:23 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a2f420c5-1f29-4a0c-98ea-8f9fd4435a99 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1979444841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04a6d814-3a85-4cc9-8f04-b5fcaa0d2eb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc569c70a0134cbc88cf12869b1e6ece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:28:23Z,use_quota=True,user_id='db0ed3d309854e9d8bb5db6a488f5e77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:28:23 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-a2f420c5-1f29-4a0c-98ea-8f9fd4435a99 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Creating volume 04a6d814-3a85-4cc9-8f04-b5fcaa0d2eb9 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:28:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a2f420c5-1f29-4a0c-98ea-8f9fd4435a99 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:28:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a2f420c5-1f29-4a0c-98ea-8f9fd4435a99 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:28:23 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a2f420c5-1f29-4a0c-98ea-8f9fd4435a99 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:28:23 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a2f420c5-1f29-4a0c-98ea-8f9fd4435a99 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:28:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a2f420c5-1f29-4a0c-98ea-8f9fd4435a99 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:28:23 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a2f420c5-1f29-4a0c-98ea-8f9fd4435a99 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:28:23 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-a2f420c5-1f29-4a0c-98ea-8f9fd4435a99 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:28:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a2f420c5-1f29-4a0c-98ea-8f9fd4435a99 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-04a6d814-3a85-4cc9-8f04-b5fcaa0d2eb9 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:23 devstack sudo[100332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-04a6d814-3a85-4cc9-8f04-b5fcaa0d2eb9 1073741824 Nov 03 20:28:23 devstack sudo[100332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:23 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9d85f58-bba1-4a38-b2b0-430ffb0add12 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:28:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e9d85f58-bba1-4a38-b2b0-430ffb0add12 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Flow 'volume_create_manager' (535b481c-7434-4c76-ac17-41e7e92b3b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:28:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e9d85f58-bba1-4a38-b2b0-430ffb0add12 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd31365b-d681-49ab-b4e2-1e54063f9b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e9d85f58-bba1-4a38-b2b0-430ffb0add12 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd31365b-d681-49ab-b4e2-1e54063f9b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1513880615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cad7285-4352-4a07-80d4-dd5f95e5dd83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc569c70a0134cbc88cf12869b1e6ece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:28:23Z,use_quota=True,user_id='db0ed3d309854e9d8bb5db6a488f5e77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e9d85f58-bba1-4a38-b2b0-430ffb0add12 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f13c303-adba-4853-9023-9d69c5a5280d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e9d85f58-bba1-4a38-b2b0-430ffb0add12 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f13c303-adba-4853-9023-9d69c5a5280d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e9d85f58-bba1-4a38-b2b0-430ffb0add12 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef53e4be-49bb-42ed-8534-c22e14554442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e9d85f58-bba1-4a38-b2b0-430ffb0add12 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef53e4be-49bb-42ed-8534-c22e14554442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cad7285-4352-4a07-80d4-dd5f95e5dd83', 'volume_name': 'volume-0cad7285-4352-4a07-80d4-dd5f95e5dd83', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e9d85f58-bba1-4a38-b2b0-430ffb0add12 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab305c1d-2a77-4f86-bdff-b497e7e78350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e9d85f58-bba1-4a38-b2b0-430ffb0add12 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab305c1d-2a77-4f86-bdff-b497e7e78350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e9d85f58-bba1-4a38-b2b0-430ffb0add12 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eb1ff41-f8fb-4cbd-8f85-c92785dff0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:23 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-e9d85f58-bba1-4a38-b2b0-430ffb0add12 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Volume 0cad7285-4352-4a07-80d4-dd5f95e5dd83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cad7285-4352-4a07-80d4-dd5f95e5dd83', 'volume_size': 1} Nov 03 20:28:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e9d85f58-bba1-4a38-b2b0-430ffb0add12 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:28:23 devstack sudo[100332]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a2f420c5-1f29-4a0c-98ea-8f9fd4435a99 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-04a6d814-3a85-4cc9-8f04-b5fcaa0d2eb9 1073741824" returned: 0 in 0.696s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a2f420c5-1f29-4a0c-98ea-8f9fd4435a99 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-04a6d814-3a85-4cc9-8f04-b5fcaa0d2eb9 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:23 devstack sudo[100338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-04a6d814-3a85-4cc9-8f04-b5fcaa0d2eb9 Nov 03 20:28:23 devstack sudo[100338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:24 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bd8ad45-9f4c-48c3-9a8e-18530205cc0e tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:28:24 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7bd8ad45-9f4c-48c3-9a8e-18530205cc0e tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Flow 'volume_create_manager' (9c8399be-b4f1-4908-a10c-7ed59a518c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:28:24 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7bd8ad45-9f4c-48c3-9a8e-18530205cc0e tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5314f9c3-ef12-4c71-b69e-5b935604266b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:24 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7bd8ad45-9f4c-48c3-9a8e-18530205cc0e tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5314f9c3-ef12-4c71-b69e-5b935604266b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1433833131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39e35a61-329e-439f-8996-81bfa7ba6c49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc569c70a0134cbc88cf12869b1e6ece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:28:24Z,use_quota=True,user_id='db0ed3d309854e9d8bb5db6a488f5e77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:24 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7bd8ad45-9f4c-48c3-9a8e-18530205cc0e tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b94be56-4576-4592-ad02-7c412f98000b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:24 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7bd8ad45-9f4c-48c3-9a8e-18530205cc0e tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b94be56-4576-4592-ad02-7c412f98000b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:24 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7bd8ad45-9f4c-48c3-9a8e-18530205cc0e tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6d9095e-90e1-4dee-ac8f-5eaed028ce1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:24 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7bd8ad45-9f4c-48c3-9a8e-18530205cc0e tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6d9095e-90e1-4dee-ac8f-5eaed028ce1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39e35a61-329e-439f-8996-81bfa7ba6c49', 'volume_name': 'volume-39e35a61-329e-439f-8996-81bfa7ba6c49', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:24 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7bd8ad45-9f4c-48c3-9a8e-18530205cc0e tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39cebda6-f486-417e-9d2c-2b77af90ffac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:24 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7bd8ad45-9f4c-48c3-9a8e-18530205cc0e tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39cebda6-f486-417e-9d2c-2b77af90ffac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:24 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7bd8ad45-9f4c-48c3-9a8e-18530205cc0e tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a84b6872-bb84-4256-b2a6-80fd26ac1356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:24 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-7bd8ad45-9f4c-48c3-9a8e-18530205cc0e tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Volume 39e35a61-329e-439f-8996-81bfa7ba6c49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39e35a61-329e-439f-8996-81bfa7ba6c49', 'volume_size': 1} Nov 03 20:28:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7bd8ad45-9f4c-48c3-9a8e-18530205cc0e tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:28:24 devstack sudo[100338]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a2f420c5-1f29-4a0c-98ea-8f9fd4435a99 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-04a6d814-3a85-4cc9-8f04-b5fcaa0d2eb9" returned: 0 in 0.529s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:24 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a2f420c5-1f29-4a0c-98ea-8f9fd4435a99 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] <== create_volume: return (1305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:28:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a2f420c5-1f29-4a0c-98ea-8f9fd4435a99 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.308s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:28:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e9d85f58-bba1-4a38-b2b0-430ffb0add12 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.770s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:28:24 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e9d85f58-bba1-4a38-b2b0-430ffb0add12 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1513880615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cad7285-4352-4a07-80d4-dd5f95e5dd83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc569c70a0134cbc88cf12869b1e6ece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:28:23Z,use_quota=True,user_id='db0ed3d309854e9d8bb5db6a488f5e77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:28:24 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-e9d85f58-bba1-4a38-b2b0-430ffb0add12 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Creating volume 0cad7285-4352-4a07-80d4-dd5f95e5dd83 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:28:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e9d85f58-bba1-4a38-b2b0-430ffb0add12 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:28:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e9d85f58-bba1-4a38-b2b0-430ffb0add12 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:28:24 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e9d85f58-bba1-4a38-b2b0-430ffb0add12 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:28:24 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e9d85f58-bba1-4a38-b2b0-430ffb0add12 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:28:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e9d85f58-bba1-4a38-b2b0-430ffb0add12 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:28:24 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e9d85f58-bba1-4a38-b2b0-430ffb0add12 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:28:24 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-e9d85f58-bba1-4a38-b2b0-430ffb0add12 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:28:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e9d85f58-bba1-4a38-b2b0-430ffb0add12 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0cad7285-4352-4a07-80d4-dd5f95e5dd83 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:24 devstack sudo[100341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0cad7285-4352-4a07-80d4-dd5f95e5dd83 1073741824 Nov 03 20:28:24 devstack sudo[100341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:24 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a2f420c5-1f29-4a0c-98ea-8f9fd4435a99 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b99d313-3246-49a0-83b2-f4e53cbfc00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04a6d814-3a85-4cc9-8f04-b5fcaa0d2eb9', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:24 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a2f420c5-1f29-4a0c-98ea-8f9fd4435a99 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aae5535-781d-4b65-923f-1fc98a09156c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:24 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-a2f420c5-1f29-4a0c-98ea-8f9fd4435a99 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Volume volume-04a6d814-3a85-4cc9-8f04-b5fcaa0d2eb9 (04a6d814-3a85-4cc9-8f04-b5fcaa0d2eb9): created successfully Nov 03 20:28:24 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a2f420c5-1f29-4a0c-98ea-8f9fd4435a99 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aae5535-781d-4b65-923f-1fc98a09156c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:24 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a2f420c5-1f29-4a0c-98ea-8f9fd4435a99 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Flow 'volume_create_manager' (446075fc-2df8-47a0-ab98-34c088d440d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:28:24 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-a2f420c5-1f29-4a0c-98ea-8f9fd4435a99 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Created volume successfully. Nov 03 20:28:24 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-5251e509-5695-4f44-8739-7e82fc47f349 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:28:24 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5251e509-5695-4f44-8739-7e82fc47f349 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Flow 'volume_create_manager' (c92d200d-c414-456f-8a73-8a671af8e194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:28:24 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5251e509-5695-4f44-8739-7e82fc47f349 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e29bc4d-41f8-4cfc-882f-17bef1bcf77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:24 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5251e509-5695-4f44-8739-7e82fc47f349 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e29bc4d-41f8-4cfc-882f-17bef1bcf77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-436091384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cccdfd86-a7fd-489c-a048-00cd169c65fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc569c70a0134cbc88cf12869b1e6ece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:28:25Z,use_quota=True,user_id='db0ed3d309854e9d8bb5db6a488f5e77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:24 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5251e509-5695-4f44-8739-7e82fc47f349 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78ac809b-d2ae-4a48-87a1-6849dc133025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:24 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5251e509-5695-4f44-8739-7e82fc47f349 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78ac809b-d2ae-4a48-87a1-6849dc133025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:24 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5251e509-5695-4f44-8739-7e82fc47f349 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b173b8b9-e752-4f0b-b7ab-363981272c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:24 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5251e509-5695-4f44-8739-7e82fc47f349 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b173b8b9-e752-4f0b-b7ab-363981272c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cccdfd86-a7fd-489c-a048-00cd169c65fd', 'volume_name': 'volume-cccdfd86-a7fd-489c-a048-00cd169c65fd', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:24 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5251e509-5695-4f44-8739-7e82fc47f349 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fea132d0-afe8-4a12-9647-e581416528a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:24 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5251e509-5695-4f44-8739-7e82fc47f349 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fea132d0-afe8-4a12-9647-e581416528a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:24 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5251e509-5695-4f44-8739-7e82fc47f349 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (481ecbf9-1c5b-497d-ba16-bccc41f103ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:24 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-5251e509-5695-4f44-8739-7e82fc47f349 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Volume cccdfd86-a7fd-489c-a048-00cd169c65fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cccdfd86-a7fd-489c-a048-00cd169c65fd', 'volume_size': 1} Nov 03 20:28:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-5251e509-5695-4f44-8739-7e82fc47f349 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:28:25 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9e8d50a-7833-4ce9-a5b0-e62978b8421d tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:28:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a9e8d50a-7833-4ce9-a5b0-e62978b8421d tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Flow 'volume_create_manager' (376de4be-e014-4605-8f70-86c483dbd9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:28:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a9e8d50a-7833-4ce9-a5b0-e62978b8421d tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1652a04-35f2-4fd9-85b2-ecb006ea2c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a9e8d50a-7833-4ce9-a5b0-e62978b8421d tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1652a04-35f2-4fd9-85b2-ecb006ea2c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1490646407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f6d4727-5c38-470f-84c8-a74b972215f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc569c70a0134cbc88cf12869b1e6ece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:28:25Z,use_quota=True,user_id='db0ed3d309854e9d8bb5db6a488f5e77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a9e8d50a-7833-4ce9-a5b0-e62978b8421d tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (252bd69e-984b-4b13-a202-39abe7b3e301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a9e8d50a-7833-4ce9-a5b0-e62978b8421d tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (252bd69e-984b-4b13-a202-39abe7b3e301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a9e8d50a-7833-4ce9-a5b0-e62978b8421d tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (927bbfa4-d90b-443c-ae64-13287479da2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a9e8d50a-7833-4ce9-a5b0-e62978b8421d tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (927bbfa4-d90b-443c-ae64-13287479da2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f6d4727-5c38-470f-84c8-a74b972215f9', 'volume_name': 'volume-3f6d4727-5c38-470f-84c8-a74b972215f9', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a9e8d50a-7833-4ce9-a5b0-e62978b8421d tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b677acd-c507-462e-a09e-6a6b739b97e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a9e8d50a-7833-4ce9-a5b0-e62978b8421d tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b677acd-c507-462e-a09e-6a6b739b97e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a9e8d50a-7833-4ce9-a5b0-e62978b8421d tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa99c18c-acb7-42c4-b0a2-0f10856b197b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:25 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-a9e8d50a-7833-4ce9-a5b0-e62978b8421d tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Volume 3f6d4727-5c38-470f-84c8-a74b972215f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f6d4727-5c38-470f-84c8-a74b972215f9', 'volume_size': 1} Nov 03 20:28:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a9e8d50a-7833-4ce9-a5b0-e62978b8421d tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:28:25 devstack sudo[100341]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e9d85f58-bba1-4a38-b2b0-430ffb0add12 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0cad7285-4352-4a07-80d4-dd5f95e5dd83 1073741824" returned: 0 in 0.776s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e9d85f58-bba1-4a38-b2b0-430ffb0add12 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0cad7285-4352-4a07-80d4-dd5f95e5dd83 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:25 devstack sudo[100347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0cad7285-4352-4a07-80d4-dd5f95e5dd83 Nov 03 20:28:25 devstack sudo[100347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:25 devstack sudo[100347]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e9d85f58-bba1-4a38-b2b0-430ffb0add12 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0cad7285-4352-4a07-80d4-dd5f95e5dd83" returned: 0 in 0.310s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:25 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e9d85f58-bba1-4a38-b2b0-430ffb0add12 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:28:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e9d85f58-bba1-4a38-b2b0-430ffb0add12 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:28:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7bd8ad45-9f4c-48c3-9a8e-18530205cc0e tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.431s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:28:25 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-7bd8ad45-9f4c-48c3-9a8e-18530205cc0e tempest-CreateVolumesFromSourceVolumeTest-567487042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1433833131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39e35a61-329e-439f-8996-81bfa7ba6c49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc569c70a0134cbc88cf12869b1e6ece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:28:24Z,use_quota=True,user_id='db0ed3d309854e9d8bb5db6a488f5e77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:28:25 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-7bd8ad45-9f4c-48c3-9a8e-18530205cc0e tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Creating volume 39e35a61-329e-439f-8996-81bfa7ba6c49 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:28:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7bd8ad45-9f4c-48c3-9a8e-18530205cc0e tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:28:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7bd8ad45-9f4c-48c3-9a8e-18530205cc0e tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:28:25 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-7bd8ad45-9f4c-48c3-9a8e-18530205cc0e tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:28:25 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-7bd8ad45-9f4c-48c3-9a8e-18530205cc0e tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:28:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7bd8ad45-9f4c-48c3-9a8e-18530205cc0e tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:28:25 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-7bd8ad45-9f4c-48c3-9a8e-18530205cc0e tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:28:25 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-7bd8ad45-9f4c-48c3-9a8e-18530205cc0e tempest-CreateVolumesFromSourceVolumeTest-567487042 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:28:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7bd8ad45-9f4c-48c3-9a8e-18530205cc0e tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-39e35a61-329e-439f-8996-81bfa7ba6c49 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e9d85f58-bba1-4a38-b2b0-430ffb0add12 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eb1ff41-f8fb-4cbd-8f85-c92785dff0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cad7285-4352-4a07-80d4-dd5f95e5dd83', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e9d85f58-bba1-4a38-b2b0-430ffb0add12 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5245dc45-7d03-4d8c-8bdb-d3d2501c1beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:25 devstack sudo[100352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-39e35a61-329e-439f-8996-81bfa7ba6c49 1073741824 Nov 03 20:28:25 devstack sudo[100352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:25 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-e9d85f58-bba1-4a38-b2b0-430ffb0add12 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Volume volume-0cad7285-4352-4a07-80d4-dd5f95e5dd83 (0cad7285-4352-4a07-80d4-dd5f95e5dd83): created successfully Nov 03 20:28:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e9d85f58-bba1-4a38-b2b0-430ffb0add12 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5245dc45-7d03-4d8c-8bdb-d3d2501c1beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e9d85f58-bba1-4a38-b2b0-430ffb0add12 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Flow 'volume_create_manager' (535b481c-7434-4c76-ac17-41e7e92b3b52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:28:25 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-e9d85f58-bba1-4a38-b2b0-430ffb0add12 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Created volume successfully. Nov 03 20:28:25 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-7e001f8f-d8ee-4d8f-9f6f-1bbe739b154c req-6f989898-8bff-4bcb-81e0-627cb08e7c84 tempest-AttachVolumeNegativeTest-1262133860 None] Terminate volume connection completed successfully. Nov 03 20:28:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-7e001f8f-d8ee-4d8f-9f6f-1bbe739b154c req-6f989898-8bff-4bcb-81e0-627cb08e7c84 tempest-AttachVolumeNegativeTest-1262133860 None] Deleting attachment d784e6e1-8753-4cbe-b03d-bbef5c4fb9f8. {{(pid=87248) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 20:28:26 devstack sudo[100352]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7bd8ad45-9f4c-48c3-9a8e-18530205cc0e tempest-CreateVolumesFromSourceVolumeTest-567487042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-39e35a61-329e-439f-8996-81bfa7ba6c49 1073741824" returned: 0 in 0.707s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7bd8ad45-9f4c-48c3-9a8e-18530205cc0e tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-39e35a61-329e-439f-8996-81bfa7ba6c49 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:26 devstack sudo[100364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-39e35a61-329e-439f-8996-81bfa7ba6c49 Nov 03 20:28:26 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:26 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7bd8ad45-9f4c-48c3-9a8e-18530205cc0e tempest-CreateVolumesFromSourceVolumeTest-567487042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-39e35a61-329e-439f-8996-81bfa7ba6c49" returned: 0 in 0.378s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:26 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-7bd8ad45-9f4c-48c3-9a8e-18530205cc0e tempest-CreateVolumesFromSourceVolumeTest-567487042 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:28:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7bd8ad45-9f4c-48c3-9a8e-18530205cc0e tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:28:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-5251e509-5695-4f44-8739-7e82fc47f349 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.103s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:28:26 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-5251e509-5695-4f44-8739-7e82fc47f349 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-436091384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cccdfd86-a7fd-489c-a048-00cd169c65fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc569c70a0134cbc88cf12869b1e6ece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:28:25Z,use_quota=True,user_id='db0ed3d309854e9d8bb5db6a488f5e77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:28:26 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-5251e509-5695-4f44-8739-7e82fc47f349 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Creating volume cccdfd86-a7fd-489c-a048-00cd169c65fd {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:28:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-5251e509-5695-4f44-8739-7e82fc47f349 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:28:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-5251e509-5695-4f44-8739-7e82fc47f349 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:28:26 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-5251e509-5695-4f44-8739-7e82fc47f349 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:28:26 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-5251e509-5695-4f44-8739-7e82fc47f349 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:28:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-5251e509-5695-4f44-8739-7e82fc47f349 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:28:26 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-5251e509-5695-4f44-8739-7e82fc47f349 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:28:26 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-5251e509-5695-4f44-8739-7e82fc47f349 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:28:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5251e509-5695-4f44-8739-7e82fc47f349 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cccdfd86-a7fd-489c-a048-00cd169c65fd 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7bd8ad45-9f4c-48c3-9a8e-18530205cc0e tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a84b6872-bb84-4256-b2a6-80fd26ac1356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39e35a61-329e-439f-8996-81bfa7ba6c49', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:26 devstack sudo[100371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cccdfd86-a7fd-489c-a048-00cd169c65fd 1073741824 Nov 03 20:28:26 devstack sudo[100371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7bd8ad45-9f4c-48c3-9a8e-18530205cc0e tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd1844c3-6049-4fe2-877b-8dc95031fac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:27 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-7bd8ad45-9f4c-48c3-9a8e-18530205cc0e tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Volume volume-39e35a61-329e-439f-8996-81bfa7ba6c49 (39e35a61-329e-439f-8996-81bfa7ba6c49): created successfully Nov 03 20:28:27 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7bd8ad45-9f4c-48c3-9a8e-18530205cc0e tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd1844c3-6049-4fe2-877b-8dc95031fac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:27 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7bd8ad45-9f4c-48c3-9a8e-18530205cc0e tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Flow 'volume_create_manager' (9c8399be-b4f1-4908-a10c-7ed59a518c7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:28:27 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-7bd8ad45-9f4c-48c3-9a8e-18530205cc0e tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Created volume successfully. Nov 03 20:28:27 devstack sudo[100371]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5251e509-5695-4f44-8739-7e82fc47f349 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cccdfd86-a7fd-489c-a048-00cd169c65fd 1073741824" returned: 0 in 0.877s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5251e509-5695-4f44-8739-7e82fc47f349 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cccdfd86-a7fd-489c-a048-00cd169c65fd {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:27 devstack sudo[100397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cccdfd86-a7fd-489c-a048-00cd169c65fd Nov 03 20:28:27 devstack sudo[100397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:28 devstack sudo[100397]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5251e509-5695-4f44-8739-7e82fc47f349 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cccdfd86-a7fd-489c-a048-00cd169c65fd" returned: 0 in 0.288s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-5251e509-5695-4f44-8739-7e82fc47f349 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:28:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-5251e509-5695-4f44-8739-7e82fc47f349 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:28:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a9e8d50a-7833-4ce9-a5b0-e62978b8421d tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.933s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:28:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a9e8d50a-7833-4ce9-a5b0-e62978b8421d tempest-CreateVolumesFromSourceVolumeTest-567487042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1490646407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f6d4727-5c38-470f-84c8-a74b972215f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc569c70a0134cbc88cf12869b1e6ece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:28:25Z,use_quota=True,user_id='db0ed3d309854e9d8bb5db6a488f5e77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:28:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-a9e8d50a-7833-4ce9-a5b0-e62978b8421d tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Creating volume 3f6d4727-5c38-470f-84c8-a74b972215f9 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:28:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a9e8d50a-7833-4ce9-a5b0-e62978b8421d tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:28:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a9e8d50a-7833-4ce9-a5b0-e62978b8421d tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:28:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a9e8d50a-7833-4ce9-a5b0-e62978b8421d tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:28:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a9e8d50a-7833-4ce9-a5b0-e62978b8421d tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:28:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a9e8d50a-7833-4ce9-a5b0-e62978b8421d tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:28:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a9e8d50a-7833-4ce9-a5b0-e62978b8421d tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:28:28 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-a9e8d50a-7833-4ce9-a5b0-e62978b8421d tempest-CreateVolumesFromSourceVolumeTest-567487042 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:28:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a9e8d50a-7833-4ce9-a5b0-e62978b8421d tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3f6d4727-5c38-470f-84c8-a74b972215f9 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:28 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5251e509-5695-4f44-8739-7e82fc47f349 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (481ecbf9-1c5b-497d-ba16-bccc41f103ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cccdfd86-a7fd-489c-a048-00cd169c65fd', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:28 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5251e509-5695-4f44-8739-7e82fc47f349 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (299d3613-5d0f-42c4-98d1-c6c615509794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:28 devstack sudo[100406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3f6d4727-5c38-470f-84c8-a74b972215f9 1073741824 Nov 03 20:28:28 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:28 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-5251e509-5695-4f44-8739-7e82fc47f349 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Volume volume-cccdfd86-a7fd-489c-a048-00cd169c65fd (cccdfd86-a7fd-489c-a048-00cd169c65fd): created successfully Nov 03 20:28:28 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5251e509-5695-4f44-8739-7e82fc47f349 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (299d3613-5d0f-42c4-98d1-c6c615509794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:28 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5251e509-5695-4f44-8739-7e82fc47f349 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Flow 'volume_create_manager' (c92d200d-c414-456f-8a73-8a671af8e194) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:28:28 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-5251e509-5695-4f44-8739-7e82fc47f349 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Created volume successfully. Nov 03 20:28:28 devstack cinder-volume[87248]: DEBUG oslo_service.periodic_task [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:28:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:28:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:28:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:28:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:28:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:28:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:28 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a9e8d50a-7833-4ce9-a5b0-e62978b8421d tempest-CreateVolumesFromSourceVolumeTest-567487042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3f6d4727-5c38-470f-84c8-a74b972215f9 1073741824" returned: 0 in 0.665s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:28 devstack sudo[100414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:28:28 devstack sudo[100414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a9e8d50a-7833-4ce9-a5b0-e62978b8421d tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3f6d4727-5c38-470f-84c8-a74b972215f9 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:28 devstack sudo[100416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3f6d4727-5c38-470f-84c8-a74b972215f9 Nov 03 20:28:28 devstack sudo[100416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:29 devstack sudo[100414]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.384s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:29 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:28:29 devstack cinder-volume[87248]: DEBUG oslo_service.periodic_task [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running periodic task VolumeManager._thread_info {{(pid=87248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:28:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] thread count: 28 {{(pid=87248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:28:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] thread info: [<_MainThread(MainThread, started 124862067372160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:28:29 devstack sudo[100416]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a9e8d50a-7833-4ce9-a5b0-e62978b8421d tempest-CreateVolumesFromSourceVolumeTest-567487042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3f6d4727-5c38-470f-84c8-a74b972215f9" returned: 0 in 0.435s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:29 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a9e8d50a-7833-4ce9-a5b0-e62978b8421d tempest-CreateVolumesFromSourceVolumeTest-567487042 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:28:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a9e8d50a-7833-4ce9-a5b0-e62978b8421d tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:28:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a9e8d50a-7833-4ce9-a5b0-e62978b8421d tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa99c18c-acb7-42c4-b0a2-0f10856b197b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f6d4727-5c38-470f-84c8-a74b972215f9', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a9e8d50a-7833-4ce9-a5b0-e62978b8421d tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbfa7779-36e2-4635-840e-fd134599963c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:29 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-a9e8d50a-7833-4ce9-a5b0-e62978b8421d tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Volume volume-3f6d4727-5c38-470f-84c8-a74b972215f9 (3f6d4727-5c38-470f-84c8-a74b972215f9): created successfully Nov 03 20:28:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a9e8d50a-7833-4ce9-a5b0-e62978b8421d tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbfa7779-36e2-4635-840e-fd134599963c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a9e8d50a-7833-4ce9-a5b0-e62978b8421d tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Flow 'volume_create_manager' (376de4be-e014-4605-8f70-86c483dbd9b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:28:29 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-a9e8d50a-7833-4ce9-a5b0-e62978b8421d tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Created volume successfully. Nov 03 20:28:29 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2931e788-cade-4bce-9b5e-416d3d56a5a6 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Acquiring lock "cinder-3f6d4727-5c38-470f-84c8-a74b972215f9-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:28:30 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2931e788-cade-4bce-9b5e-416d3d56a5a6 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "cinder-3f6d4727-5c38-470f-84c8-a74b972215f9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:28:30 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2931e788-cade-4bce-9b5e-416d3d56a5a6 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Acquiring lock "cinder-quobyte-3f6d4727-5c38-470f-84c8-a74b972215f9" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:28:30 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2931e788-cade-4bce-9b5e-416d3d56a5a6 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "cinder-quobyte-3f6d4727-5c38-470f-84c8-a74b972215f9" acquired by "delete_volume" :: waited 0.027s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:28:30 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[87da652a-9785-4280-af4f-2513b355df17]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:28:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2931e788-cade-4bce-9b5e-416d3d56a5a6 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3f6d4727-5c38-470f-84c8-a74b972215f9 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:30 devstack sudo[100421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3f6d4727-5c38-470f-84c8-a74b972215f9 Nov 03 20:28:30 devstack sudo[100421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:30 devstack sudo[100421]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2931e788-cade-4bce-9b5e-416d3d56a5a6 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3f6d4727-5c38-470f-84c8-a74b972215f9" returned: 0 in 0.448s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2931e788-cade-4bce-9b5e-416d3d56a5a6 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3f6d4727-5c38-470f-84c8-a74b972215f9 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:30 devstack sudo[100427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3f6d4727-5c38-470f-84c8-a74b972215f9 Nov 03 20:28:30 devstack sudo[100427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:30 devstack sudo[100427]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2931e788-cade-4bce-9b5e-416d3d56a5a6 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3f6d4727-5c38-470f-84c8-a74b972215f9" returned: 0 in 0.283s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:30 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2931e788-cade-4bce-9b5e-416d3d56a5a6 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "cinder-quobyte-3f6d4727-5c38-470f-84c8-a74b972215f9" released by "delete_volume" :: held 0.788s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:28:30 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-2931e788-cade-4bce-9b5e-416d3d56a5a6 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Created reservations ['670ec61b-5f1d-4763-9a42-0be0d20ac4d0', 'c97f411d-c59c-4449-bc95-ac9e01b3e224', '2233ada2-07e7-401e-8a47-dcbb9d74b8e4', '16714aa2-6fd1-4c0f-b284-d79c0d5efaf6'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:28:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2931e788-cade-4bce-9b5e-416d3d56a5a6 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:28:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2931e788-cade-4bce-9b5e-416d3d56a5a6 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:28:31 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2931e788-cade-4bce-9b5e-416d3d56a5a6 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:28:31 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2931e788-cade-4bce-9b5e-416d3d56a5a6 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:28:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2931e788-cade-4bce-9b5e-416d3d56a5a6 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:28:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2931e788-cade-4bce-9b5e-416d3d56a5a6 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:31 devstack sudo[100430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:28:31 devstack sudo[100430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:31 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a6256914-ce8e-420f-9490-3e6764a73eec tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Acquiring lock "cinder-cccdfd86-a7fd-489c-a048-00cd169c65fd-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:28:31 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a6256914-ce8e-420f-9490-3e6764a73eec tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "cinder-cccdfd86-a7fd-489c-a048-00cd169c65fd-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:28:31 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a6256914-ce8e-420f-9490-3e6764a73eec tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Acquiring lock "cinder-quobyte-cccdfd86-a7fd-489c-a048-00cd169c65fd" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:28:31 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a6256914-ce8e-420f-9490-3e6764a73eec tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "cinder-quobyte-cccdfd86-a7fd-489c-a048-00cd169c65fd" acquired by "delete_volume" :: waited 0.024s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:28:31 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee5cd70-1b96-479e-a308-45c620c5b22c]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:28:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a6256914-ce8e-420f-9490-3e6764a73eec tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cccdfd86-a7fd-489c-a048-00cd169c65fd {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:31 devstack sudo[100430]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2931e788-cade-4bce-9b5e-416d3d56a5a6 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.421s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:31 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-2931e788-cade-4bce-9b5e-416d3d56a5a6 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:28:31 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-2931e788-cade-4bce-9b5e-416d3d56a5a6 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Deleted volume successfully. Nov 03 20:28:31 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2931e788-cade-4bce-9b5e-416d3d56a5a6 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "cinder-3f6d4727-5c38-470f-84c8-a74b972215f9-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:28:31 devstack sudo[100433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cccdfd86-a7fd-489c-a048-00cd169c65fd Nov 03 20:28:31 devstack sudo[100433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:31 devstack sudo[100433]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a6256914-ce8e-420f-9490-3e6764a73eec tempest-CreateVolumesFromSourceVolumeTest-567487042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cccdfd86-a7fd-489c-a048-00cd169c65fd" returned: 0 in 0.471s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a6256914-ce8e-420f-9490-3e6764a73eec tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cccdfd86-a7fd-489c-a048-00cd169c65fd {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:31 devstack sudo[100441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cccdfd86-a7fd-489c-a048-00cd169c65fd Nov 03 20:28:31 devstack sudo[100441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:32 devstack sudo[100441]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a6256914-ce8e-420f-9490-3e6764a73eec tempest-CreateVolumesFromSourceVolumeTest-567487042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-cccdfd86-a7fd-489c-a048-00cd169c65fd" returned: 0 in 0.395s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:32 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a6256914-ce8e-420f-9490-3e6764a73eec tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "cinder-quobyte-cccdfd86-a7fd-489c-a048-00cd169c65fd" released by "delete_volume" :: held 0.951s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:28:32 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-a6256914-ce8e-420f-9490-3e6764a73eec tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Created reservations ['299ebfce-eae5-4bf9-a5ef-b26d6598e613', '90a1c197-2c96-4694-9e33-669a678b2033', 'a5a4ecec-f0f9-4989-ac9f-226de2114a94', '54b5a968-bbb6-4a01-891a-0cd18f15517c'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:28:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a6256914-ce8e-420f-9490-3e6764a73eec tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:28:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a6256914-ce8e-420f-9490-3e6764a73eec tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:28:32 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a6256914-ce8e-420f-9490-3e6764a73eec tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:28:32 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a6256914-ce8e-420f-9490-3e6764a73eec tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:28:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a6256914-ce8e-420f-9490-3e6764a73eec tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:28:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a6256914-ce8e-420f-9490-3e6764a73eec tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:32 devstack sudo[100450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:28:32 devstack sudo[100450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:32 devstack sudo[100450]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a6256914-ce8e-420f-9490-3e6764a73eec tempest-CreateVolumesFromSourceVolumeTest-567487042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.330s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:32 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-a6256914-ce8e-420f-9490-3e6764a73eec tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:28:32 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-a6256914-ce8e-420f-9490-3e6764a73eec tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Deleted volume successfully. Nov 03 20:28:32 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a6256914-ce8e-420f-9490-3e6764a73eec tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "cinder-cccdfd86-a7fd-489c-a048-00cd169c65fd-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:28:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-918e91c3-2a61-4eaa-9d97-0d17bda30f74 req-fec19fbd-36df-4a5c-a792-d772bc14056a tempest-TestInstancesWithCinderVolumes-1364232362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:28:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-918e91c3-2a61-4eaa-9d97-0d17bda30f74 req-fec19fbd-36df-4a5c-a792-d772bc14056a tempest-TestInstancesWithCinderVolumes-1364232362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:28:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-918e91c3-2a61-4eaa-9d97-0d17bda30f74 req-fec19fbd-36df-4a5c-a792-d772bc14056a tempest-TestInstancesWithCinderVolumes-1364232362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:28:33 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-918e91c3-2a61-4eaa-9d97-0d17bda30f74 req-fec19fbd-36df-4a5c-a792-d772bc14056a tempest-TestInstancesWithCinderVolumes-1364232362 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8', 'name': 'volume-8a6e7754-b982-4708-9157-21b031d891f3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '20aa325d-c4d9-41e9-9f61-2807d720829f', 'enforce_multipath': True} {{(pid=87248) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 20:28:33 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-918e91c3-2a61-4eaa-9d97-0d17bda30f74 req-fec19fbd-36df-4a5c-a792-d772bc14056a tempest-TestInstancesWithCinderVolumes-1364232362 None] attachment_update completed successfully. Nov 03 20:28:33 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7d94456c-9c01-4e1a-b5b8-2e5723b17034 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Acquiring lock "cinder-39e35a61-329e-439f-8996-81bfa7ba6c49-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:28:33 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7d94456c-9c01-4e1a-b5b8-2e5723b17034 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "cinder-39e35a61-329e-439f-8996-81bfa7ba6c49-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:28:33 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7d94456c-9c01-4e1a-b5b8-2e5723b17034 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Acquiring lock "cinder-quobyte-39e35a61-329e-439f-8996-81bfa7ba6c49" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:28:33 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7d94456c-9c01-4e1a-b5b8-2e5723b17034 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "cinder-quobyte-39e35a61-329e-439f-8996-81bfa7ba6c49" acquired by "delete_volume" :: waited 0.017s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:28:33 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee09194-0332-49f7-8665-3ab1c582df13]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:28:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7d94456c-9c01-4e1a-b5b8-2e5723b17034 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-39e35a61-329e-439f-8996-81bfa7ba6c49 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:33 devstack sudo[100463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-39e35a61-329e-439f-8996-81bfa7ba6c49 Nov 03 20:28:33 devstack sudo[100463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:34 devstack sudo[100463]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7d94456c-9c01-4e1a-b5b8-2e5723b17034 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-39e35a61-329e-439f-8996-81bfa7ba6c49" returned: 0 in 0.414s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7d94456c-9c01-4e1a-b5b8-2e5723b17034 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-39e35a61-329e-439f-8996-81bfa7ba6c49 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:34 devstack sudo[100468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-39e35a61-329e-439f-8996-81bfa7ba6c49 Nov 03 20:28:34 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:34 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7d94456c-9c01-4e1a-b5b8-2e5723b17034 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-39e35a61-329e-439f-8996-81bfa7ba6c49" returned: 0 in 0.288s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:34 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7d94456c-9c01-4e1a-b5b8-2e5723b17034 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "cinder-quobyte-39e35a61-329e-439f-8996-81bfa7ba6c49" released by "delete_volume" :: held 0.766s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:28:34 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-7d94456c-9c01-4e1a-b5b8-2e5723b17034 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Created reservations ['906702da-5f9f-4799-b448-afb48a7bbdd3', 'b2e8e4eb-cfc6-4ee2-8291-d2df63c05f26', '7c538876-1172-4248-a98e-002dea2dde12', 'b55f1faa-2404-444d-bdec-5f3ae0538eb6'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:28:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7d94456c-9c01-4e1a-b5b8-2e5723b17034 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:28:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7d94456c-9c01-4e1a-b5b8-2e5723b17034 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:28:34 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-7d94456c-9c01-4e1a-b5b8-2e5723b17034 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:28:34 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-7d94456c-9c01-4e1a-b5b8-2e5723b17034 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:28:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7d94456c-9c01-4e1a-b5b8-2e5723b17034 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:28:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7d94456c-9c01-4e1a-b5b8-2e5723b17034 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:34 devstack sudo[100471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:28:34 devstack sudo[100471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:34 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-65a8ae5c-c711-4a20-93c3-68871dc45a05 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Acquiring lock "cinder-0cad7285-4352-4a07-80d4-dd5f95e5dd83-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:28:35 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-65a8ae5c-c711-4a20-93c3-68871dc45a05 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "cinder-0cad7285-4352-4a07-80d4-dd5f95e5dd83-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:28:35 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-65a8ae5c-c711-4a20-93c3-68871dc45a05 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Acquiring lock "cinder-quobyte-0cad7285-4352-4a07-80d4-dd5f95e5dd83" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:28:35 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-65a8ae5c-c711-4a20-93c3-68871dc45a05 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "cinder-quobyte-0cad7285-4352-4a07-80d4-dd5f95e5dd83" acquired by "delete_volume" :: waited 0.031s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:28:35 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc13a746-9179-46eb-a591-ea633deabcc3]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:28:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-65a8ae5c-c711-4a20-93c3-68871dc45a05 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0cad7285-4352-4a07-80d4-dd5f95e5dd83 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:35 devstack sudo[100471]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7d94456c-9c01-4e1a-b5b8-2e5723b17034 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.517s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:35 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-7d94456c-9c01-4e1a-b5b8-2e5723b17034 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:28:35 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-7d94456c-9c01-4e1a-b5b8-2e5723b17034 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Deleted volume successfully. Nov 03 20:28:35 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7d94456c-9c01-4e1a-b5b8-2e5723b17034 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "cinder-39e35a61-329e-439f-8996-81bfa7ba6c49-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:28:35 devstack sudo[100473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0cad7285-4352-4a07-80d4-dd5f95e5dd83 Nov 03 20:28:35 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:35 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-65a8ae5c-c711-4a20-93c3-68871dc45a05 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0cad7285-4352-4a07-80d4-dd5f95e5dd83" returned: 0 in 0.522s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-65a8ae5c-c711-4a20-93c3-68871dc45a05 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0cad7285-4352-4a07-80d4-dd5f95e5dd83 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:35 devstack sudo[100485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0cad7285-4352-4a07-80d4-dd5f95e5dd83 Nov 03 20:28:35 devstack sudo[100485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:36 devstack sudo[100485]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-65a8ae5c-c711-4a20-93c3-68871dc45a05 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0cad7285-4352-4a07-80d4-dd5f95e5dd83" returned: 0 in 0.542s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:36 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-65a8ae5c-c711-4a20-93c3-68871dc45a05 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "cinder-quobyte-0cad7285-4352-4a07-80d4-dd5f95e5dd83" released by "delete_volume" :: held 1.156s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:28:36 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-65a8ae5c-c711-4a20-93c3-68871dc45a05 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Created reservations ['aa2b7fd1-27cd-415c-b487-3d7ecc19610c', 'e9507390-da95-4c3d-bb3f-b2a38f29ae47', '128b635f-1f7d-40a9-8ecb-2f524999c39b', 'e05fd559-ac2b-4716-a3f8-2887c18caeff'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:28:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-65a8ae5c-c711-4a20-93c3-68871dc45a05 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:28:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-65a8ae5c-c711-4a20-93c3-68871dc45a05 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:28:36 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-65a8ae5c-c711-4a20-93c3-68871dc45a05 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:28:36 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-65a8ae5c-c711-4a20-93c3-68871dc45a05 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:28:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-65a8ae5c-c711-4a20-93c3-68871dc45a05 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:28:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-65a8ae5c-c711-4a20-93c3-68871dc45a05 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:36 devstack sudo[100495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:28:36 devstack sudo[100495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:36 devstack sudo[100495]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-65a8ae5c-c711-4a20-93c3-68871dc45a05 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.360s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:36 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-65a8ae5c-c711-4a20-93c3-68871dc45a05 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:28:36 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-65a8ae5c-c711-4a20-93c3-68871dc45a05 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Deleted volume successfully. Nov 03 20:28:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-840d2451-04d1-4102-8e4e-c308793c5923 req-af91c9c9-0ae9-4bcd-a44f-d0dc647dac1a tempest-TestInstancesWithCinderVolumes-1364232362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:28:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-840d2451-04d1-4102-8e4e-c308793c5923 req-af91c9c9-0ae9-4bcd-a44f-d0dc647dac1a tempest-TestInstancesWithCinderVolumes-1364232362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:28:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-840d2451-04d1-4102-8e4e-c308793c5923 req-af91c9c9-0ae9-4bcd-a44f-d0dc647dac1a tempest-TestInstancesWithCinderVolumes-1364232362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:28:36 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-65a8ae5c-c711-4a20-93c3-68871dc45a05 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "cinder-0cad7285-4352-4a07-80d4-dd5f95e5dd83-delete_volume" released by "delete_volume" :: held 1.943s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:28:36 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-840d2451-04d1-4102-8e4e-c308793c5923 req-af91c9c9-0ae9-4bcd-a44f-d0dc647dac1a tempest-TestInstancesWithCinderVolumes-1364232362 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8', 'name': 'volume-e012b197-88b6-4680-92de-40ca908ff3a4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '562ee45e-af89-4ecf-9852-73025b749e24', 'enforce_multipath': True} {{(pid=87248) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 20:28:37 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-840d2451-04d1-4102-8e4e-c308793c5923 req-af91c9c9-0ae9-4bcd-a44f-d0dc647dac1a tempest-TestInstancesWithCinderVolumes-1364232362 None] attachment_update completed successfully. Nov 03 20:28:37 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c81866bb-83a4-48ca-9964-e74bf459c865 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Acquiring lock "cinder-04a6d814-3a85-4cc9-8f04-b5fcaa0d2eb9-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:28:37 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c81866bb-83a4-48ca-9964-e74bf459c865 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "cinder-04a6d814-3a85-4cc9-8f04-b5fcaa0d2eb9-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:28:37 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:SELECT=154,cinder:INSERT=46,cinder:UPDATE=160,cinder:DELETE=13 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:28:37 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:UPDATE=176,cinder:DELETE=15,cinder:SELECT=137,cinder:INSERT=36 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:28:37 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c81866bb-83a4-48ca-9964-e74bf459c865 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Acquiring lock "cinder-quobyte-04a6d814-3a85-4cc9-8f04-b5fcaa0d2eb9" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:28:37 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c81866bb-83a4-48ca-9964-e74bf459c865 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "cinder-quobyte-04a6d814-3a85-4cc9-8f04-b5fcaa0d2eb9" acquired by "delete_volume" :: waited 0.039s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:28:37 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbad257-ea3e-468b-abe0-f0130adf5e82]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:28:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c81866bb-83a4-48ca-9964-e74bf459c865 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-04a6d814-3a85-4cc9-8f04-b5fcaa0d2eb9 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:37 devstack sudo[100509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-04a6d814-3a85-4cc9-8f04-b5fcaa0d2eb9 Nov 03 20:28:37 devstack sudo[100509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:38 devstack sudo[100509]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c81866bb-83a4-48ca-9964-e74bf459c865 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-04a6d814-3a85-4cc9-8f04-b5fcaa0d2eb9" returned: 0 in 0.555s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c81866bb-83a4-48ca-9964-e74bf459c865 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-04a6d814-3a85-4cc9-8f04-b5fcaa0d2eb9 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:38 devstack sudo[100515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-04a6d814-3a85-4cc9-8f04-b5fcaa0d2eb9 Nov 03 20:28:38 devstack sudo[100515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:38 devstack sudo[100515]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c81866bb-83a4-48ca-9964-e74bf459c865 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-04a6d814-3a85-4cc9-8f04-b5fcaa0d2eb9" returned: 0 in 0.394s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:38 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c81866bb-83a4-48ca-9964-e74bf459c865 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "cinder-quobyte-04a6d814-3a85-4cc9-8f04-b5fcaa0d2eb9" released by "delete_volume" :: held 1.030s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:28:38 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-c81866bb-83a4-48ca-9964-e74bf459c865 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Created reservations ['f8b995f6-b779-473c-ab3c-9515d67e89ed', 'b488b1ef-9154-483b-8ea3-27f13f6061a1', '82fc8a03-5160-4bc1-a9cb-603372db8989', '87bb3d92-19a4-4294-9e3b-5f84f1d4e293'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:28:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c81866bb-83a4-48ca-9964-e74bf459c865 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:28:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c81866bb-83a4-48ca-9964-e74bf459c865 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:28:38 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c81866bb-83a4-48ca-9964-e74bf459c865 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:28:38 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c81866bb-83a4-48ca-9964-e74bf459c865 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:28:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c81866bb-83a4-48ca-9964-e74bf459c865 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:28:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c81866bb-83a4-48ca-9964-e74bf459c865 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:39 devstack sudo[100531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:28:39 devstack sudo[100531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:39 devstack sudo[100531]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c81866bb-83a4-48ca-9964-e74bf459c865 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.396s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:39 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-c81866bb-83a4-48ca-9964-e74bf459c865 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:28:39 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-c81866bb-83a4-48ca-9964-e74bf459c865 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Deleted volume successfully. Nov 03 20:28:39 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c81866bb-83a4-48ca-9964-e74bf459c865 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "cinder-04a6d814-3a85-4cc9-8f04-b5fcaa0d2eb9-delete_volume" released by "delete_volume" :: held 1.853s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:28:39 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1db06eeb-9849-4927-b7ce-282122edd631 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Acquiring lock "cinder-61eeb189-d60c-40ee-ba63-21e83d4aed80-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:28:40 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1db06eeb-9849-4927-b7ce-282122edd631 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "cinder-61eeb189-d60c-40ee-ba63-21e83d4aed80-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:28:40 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1db06eeb-9849-4927-b7ce-282122edd631 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Acquiring lock "cinder-quobyte-61eeb189-d60c-40ee-ba63-21e83d4aed80" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:28:40 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1db06eeb-9849-4927-b7ce-282122edd631 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "cinder-quobyte-61eeb189-d60c-40ee-ba63-21e83d4aed80" acquired by "delete_volume" :: waited 0.020s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:28:40 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe3864f-8286-4ab5-89d3-2ae99298c43b]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:28:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1db06eeb-9849-4927-b7ce-282122edd631 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-61eeb189-d60c-40ee-ba63-21e83d4aed80 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:40 devstack sudo[100544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-61eeb189-d60c-40ee-ba63-21e83d4aed80 Nov 03 20:28:40 devstack sudo[100544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:40 devstack sudo[100544]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1db06eeb-9849-4927-b7ce-282122edd631 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-61eeb189-d60c-40ee-ba63-21e83d4aed80" returned: 0 in 0.445s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1db06eeb-9849-4927-b7ce-282122edd631 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-61eeb189-d60c-40ee-ba63-21e83d4aed80 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:40 devstack sudo[100550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-61eeb189-d60c-40ee-ba63-21e83d4aed80 Nov 03 20:28:40 devstack sudo[100550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:40 devstack sudo[100550]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1db06eeb-9849-4927-b7ce-282122edd631 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-61eeb189-d60c-40ee-ba63-21e83d4aed80" returned: 0 in 0.302s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:40 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1db06eeb-9849-4927-b7ce-282122edd631 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "cinder-quobyte-61eeb189-d60c-40ee-ba63-21e83d4aed80" released by "delete_volume" :: held 0.803s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:28:40 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-1db06eeb-9849-4927-b7ce-282122edd631 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Created reservations ['38ccffdb-bbd2-4d49-8983-c489726560c8', 'c51924d7-e848-4f89-a99e-f5d9479f320b', 'abc2410e-c6ff-43b7-a5f9-f7ae29ee276a', 'd45e2e8d-7eff-4daa-ab5f-1f05eb5d8c48'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:28:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1db06eeb-9849-4927-b7ce-282122edd631 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:28:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1db06eeb-9849-4927-b7ce-282122edd631 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:28:41 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-1db06eeb-9849-4927-b7ce-282122edd631 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:28:41 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-1db06eeb-9849-4927-b7ce-282122edd631 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:28:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1db06eeb-9849-4927-b7ce-282122edd631 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:28:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1db06eeb-9849-4927-b7ce-282122edd631 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:41 devstack sudo[100554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:28:41 devstack sudo[100554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:41 devstack sudo[100554]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1db06eeb-9849-4927-b7ce-282122edd631 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.353s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:41 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-1db06eeb-9849-4927-b7ce-282122edd631 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:28:41 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-1db06eeb-9849-4927-b7ce-282122edd631 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Deleted volume successfully. Nov 03 20:28:41 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1db06eeb-9849-4927-b7ce-282122edd631 tempest-CreateVolumesFromSourceVolumeTest-567487042 None] Lock "cinder-61eeb189-d60c-40ee-ba63-21e83d4aed80-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:28:45 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-4b68c1db-5f6e-424a-a08f-301d4564a25a req-af5ba7de-a65c-43a7-bdc7-8e6b5d53376c tempest-TestInstancesWithCinderVolumes-1364232362 None] Terminate volume connection completed successfully. Nov 03 20:28:45 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-4b68c1db-5f6e-424a-a08f-301d4564a25a req-af5ba7de-a65c-43a7-bdc7-8e6b5d53376c tempest-TestInstancesWithCinderVolumes-1364232362 None] Deleting attachment 20aa325d-c4d9-41e9-9f61-2807d720829f. {{(pid=87248) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 20:28:45 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-131e4f02-7290-470c-b4a1-bf6fe86221cd tempest-TestInstancesWithCinderVolumes-1364232362 None] Acquiring lock "cinder-8a6e7754-b982-4708-9157-21b031d891f3-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:28:45 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-131e4f02-7290-470c-b4a1-bf6fe86221cd tempest-TestInstancesWithCinderVolumes-1364232362 None] Lock "cinder-8a6e7754-b982-4708-9157-21b031d891f3-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:28:45 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-131e4f02-7290-470c-b4a1-bf6fe86221cd tempest-TestInstancesWithCinderVolumes-1364232362 None] Acquiring lock "cinder-quobyte-8a6e7754-b982-4708-9157-21b031d891f3" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:28:45 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-131e4f02-7290-470c-b4a1-bf6fe86221cd tempest-TestInstancesWithCinderVolumes-1364232362 None] Lock "cinder-quobyte-8a6e7754-b982-4708-9157-21b031d891f3" acquired by "delete_volume" :: waited 0.019s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:28:45 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[b110ac39-aecf-4148-ad3f-00e2633d841f]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:28:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-131e4f02-7290-470c-b4a1-bf6fe86221cd tempest-TestInstancesWithCinderVolumes-1364232362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8a6e7754-b982-4708-9157-21b031d891f3 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:46 devstack sudo[100656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8a6e7754-b982-4708-9157-21b031d891f3 Nov 03 20:28:46 devstack sudo[100656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:46 devstack sudo[100656]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-131e4f02-7290-470c-b4a1-bf6fe86221cd tempest-TestInstancesWithCinderVolumes-1364232362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8a6e7754-b982-4708-9157-21b031d891f3" returned: 0 in 0.823s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-131e4f02-7290-470c-b4a1-bf6fe86221cd tempest-TestInstancesWithCinderVolumes-1364232362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8a6e7754-b982-4708-9157-21b031d891f3 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:46 devstack sudo[100662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8a6e7754-b982-4708-9157-21b031d891f3 Nov 03 20:28:46 devstack sudo[100662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:47 devstack sudo[100662]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-131e4f02-7290-470c-b4a1-bf6fe86221cd tempest-TestInstancesWithCinderVolumes-1364232362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8a6e7754-b982-4708-9157-21b031d891f3" returned: 0 in 0.698s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:47 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-131e4f02-7290-470c-b4a1-bf6fe86221cd tempest-TestInstancesWithCinderVolumes-1364232362 None] Lock "cinder-quobyte-8a6e7754-b982-4708-9157-21b031d891f3" released by "delete_volume" :: held 1.628s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:28:47 devstack cinder-volume[87248]: WARNING cinder.quota [None req-131e4f02-7290-470c-b4a1-bf6fe86221cd tempest-TestInstancesWithCinderVolumes-1364232362 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1717019031-1638763733 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1717019031-1638763733, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:28:47 devstack cinder-volume[87248]: WARNING cinder.quota [None req-131e4f02-7290-470c-b4a1-bf6fe86221cd tempest-TestInstancesWithCinderVolumes-1364232362 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1717019031-1638763733 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1717019031-1638763733, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:28:47 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-131e4f02-7290-470c-b4a1-bf6fe86221cd tempest-TestInstancesWithCinderVolumes-1364232362 None] Created reservations ['ba08bdde-c59c-4813-b068-bb70c631a1d8', '381571c5-f7ff-43f0-be68-9a0e3e91c8cd', 'db16aa49-e02a-43c9-a632-19f580958033', '7c7ba180-873f-4f3a-8337-d762e9aff6dd'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:28:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-131e4f02-7290-470c-b4a1-bf6fe86221cd tempest-TestInstancesWithCinderVolumes-1364232362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:28:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-131e4f02-7290-470c-b4a1-bf6fe86221cd tempest-TestInstancesWithCinderVolumes-1364232362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:28:47 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-131e4f02-7290-470c-b4a1-bf6fe86221cd tempest-TestInstancesWithCinderVolumes-1364232362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:28:47 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-131e4f02-7290-470c-b4a1-bf6fe86221cd tempest-TestInstancesWithCinderVolumes-1364232362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:28:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-131e4f02-7290-470c-b4a1-bf6fe86221cd tempest-TestInstancesWithCinderVolumes-1364232362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:28:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-131e4f02-7290-470c-b4a1-bf6fe86221cd tempest-TestInstancesWithCinderVolumes-1364232362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:47 devstack sudo[100665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:28:47 devstack sudo[100665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:48 devstack sudo[100665]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-131e4f02-7290-470c-b4a1-bf6fe86221cd tempest-TestInstancesWithCinderVolumes-1364232362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.478s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:48 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-131e4f02-7290-470c-b4a1-bf6fe86221cd tempest-TestInstancesWithCinderVolumes-1364232362 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:28:48 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-131e4f02-7290-470c-b4a1-bf6fe86221cd tempest-TestInstancesWithCinderVolumes-1364232362 None] Deleted volume successfully. Nov 03 20:28:48 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-131e4f02-7290-470c-b4a1-bf6fe86221cd tempest-TestInstancesWithCinderVolumes-1364232362 None] Lock "cinder-8a6e7754-b982-4708-9157-21b031d891f3-delete_volume" released by "delete_volume" :: held 2.545s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:28:51 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-eec891d6-bb77-4b5d-8779-b72292b3e8af req-3d0c92d4-6742-4e1b-96d8-371e6491280e tempest-TestInstancesWithCinderVolumes-1364232362 None] Terminate volume connection completed successfully. Nov 03 20:28:51 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-eec891d6-bb77-4b5d-8779-b72292b3e8af req-3d0c92d4-6742-4e1b-96d8-371e6491280e tempest-TestInstancesWithCinderVolumes-1364232362 None] Deleting attachment 562ee45e-af89-4ecf-9852-73025b749e24. {{(pid=87248) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 20:28:52 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d042fddb-f949-48a8-8d51-2a58c9eb59f0 tempest-TestInstancesWithCinderVolumes-1364232362 None] Acquiring lock "cinder-e012b197-88b6-4680-92de-40ca908ff3a4-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:28:52 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d042fddb-f949-48a8-8d51-2a58c9eb59f0 tempest-TestInstancesWithCinderVolumes-1364232362 None] Lock "cinder-e012b197-88b6-4680-92de-40ca908ff3a4-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:28:52 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d042fddb-f949-48a8-8d51-2a58c9eb59f0 tempest-TestInstancesWithCinderVolumes-1364232362 None] Acquiring lock "cinder-quobyte-e012b197-88b6-4680-92de-40ca908ff3a4" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:28:52 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d042fddb-f949-48a8-8d51-2a58c9eb59f0 tempest-TestInstancesWithCinderVolumes-1364232362 None] Lock "cinder-quobyte-e012b197-88b6-4680-92de-40ca908ff3a4" acquired by "delete_volume" :: waited 0.061s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:28:52 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:28:52 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Flow 'volume_create_manager' (511e5cba-56a2-4023-b6ac-660f75344e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:28:52 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f22ad5fa-aed6-47fc-86e7-0d5a40b03a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:52 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[073b8854-e4a5-48c1-b6b5-8850a2d13082]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:28:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d042fddb-f949-48a8-8d51-2a58c9eb59f0 tempest-TestInstancesWithCinderVolumes-1364232362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e012b197-88b6-4680-92de-40ca908ff3a4 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:52 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f22ad5fa-aed6-47fc-86e7-0d5a40b03a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:28:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd701b70-d38d-422a-9b94-7fa4623e8662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5f273d9c7e845fca925f6b9e5d8033e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:28:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:28:52Z,use_quota=True,user_id='c780f038947c4ec291c3a518d9e67a5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:52 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (315761a2-1785-412f-abb1-e2124a3f9e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:52 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (315761a2-1785-412f-abb1-e2124a3f9e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:52 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1c6c849-db8b-4b64-8a74-3c425cca8ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:52 devstack cinder-volume[87248]: DEBUG cinder.image.glance [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Creating Keystone auth plugin from conf {{(pid=87248) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 20:28:52 devstack sudo[100693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e012b197-88b6-4680-92de-40ca908ff3a4 Nov 03 20:28:52 devstack sudo[100693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:52 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1c6c849-db8b-4b64-8a74-3c425cca8ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bd701b70-d38d-422a-9b94-7fa4623e8662', 'volume_name': 'volume-bd701b70-d38d-422a-9b94-7fa4623e8662', 'volume_size': 1, 'image_id': 'c2aa700d-684a-4ea2-82b3-60bc427c0428', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c2aa700d-684a-4ea2-82b3-60bc427c0428', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3b19646bd34f249e9e34199579d7766b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f5f273d9c7e845fca925f6b9e5d8033e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4b45117a9e16530ff0d52f8b378919d276f940d8e81d69b6b7efa2a6c955c341cc4c66a96f38eb8d3f674996098fc2d421c71fb24f0c72f8259ebab976db7676', 'id': 'c2aa700d-684a-4ea2-82b3-60bc427c0428', 'created_at': datetime.datetime(2026, 11, 3, 19, 28, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 28, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c2aa700d-684a-4ea2-82b3-60bc427c0428/file', 'properties': {}}, 'image_service': }' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:52 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81235d45-591f-4ec6-880d-622e362ebf26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:52 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81235d45-591f-4ec6-880d-622e362ebf26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:28:52 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db2f94f2-c6e8-4928-a194-25a6f6aab746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:28:52 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Volume bd701b70-d38d-422a-9b94-7fa4623e8662: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bd701b70-d38d-422a-9b94-7fa4623e8662', 'volume_size': 1, 'image_id': 'c2aa700d-684a-4ea2-82b3-60bc427c0428', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c2aa700d-684a-4ea2-82b3-60bc427c0428', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3b19646bd34f249e9e34199579d7766b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f5f273d9c7e845fca925f6b9e5d8033e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4b45117a9e16530ff0d52f8b378919d276f940d8e81d69b6b7efa2a6c955c341cc4c66a96f38eb8d3f674996098fc2d421c71fb24f0c72f8259ebab976db7676', 'id': 'c2aa700d-684a-4ea2-82b3-60bc427c0428', 'created_at': datetime.datetime(2026, 11, 3, 19, 28, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 28, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c2aa700d-684a-4ea2-82b3-60bc427c0428/file', 'properties': {}}, 'image_service': } Nov 03 20:28:52 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Trying to clone bd701b70-d38d-422a-9b94-7fa4623e8662 from image c2aa700d-684a-4ea2-82b3-60bc427c0428 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c2aa700d-684a-4ea2-82b3-60bc427c0428', 'metadata': {}}]). {{(pid=87248) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 20:28:53 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c2aa700d-684a-4ea2-82b3-60bc427c0428_6oddnduodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87248) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 20:28:53 devstack cinder-volume[87248]: INFO cinder.image.image_utils [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Image download 0.00 MB at 0.00 MB/s Nov 03 20:28:53 devstack sudo[100693]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d042fddb-f949-48a8-8d51-2a58c9eb59f0 tempest-TestInstancesWithCinderVolumes-1364232362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e012b197-88b6-4680-92de-40ca908ff3a4" returned: 0 in 0.862s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d042fddb-f949-48a8-8d51-2a58c9eb59f0 tempest-TestInstancesWithCinderVolumes-1364232362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e012b197-88b6-4680-92de-40ca908ff3a4 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:53 devstack sudo[100698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e012b197-88b6-4680-92de-40ca908ff3a4 Nov 03 20:28:53 devstack sudo[100698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:53 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eea760d-332c-46e3-b475-bf34efc4277a]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:28:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2aa700d-684a-4ea2-82b3-60bc427c0428_6oddnduodevstack@QuobyteHD {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:53 devstack sudo[100698]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d042fddb-f949-48a8-8d51-2a58c9eb59f0 tempest-TestInstancesWithCinderVolumes-1364232362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e012b197-88b6-4680-92de-40ca908ff3a4" returned: 0 in 0.411s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:53 devstack sudo[100700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2aa700d-684a-4ea2-82b3-60bc427c0428_6oddnduodevstack@QuobyteHD Nov 03 20:28:53 devstack sudo[100700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:53 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d042fddb-f949-48a8-8d51-2a58c9eb59f0 tempest-TestInstancesWithCinderVolumes-1364232362 None] Lock "cinder-quobyte-e012b197-88b6-4680-92de-40ca908ff3a4" released by "delete_volume" :: held 1.418s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:28:53 devstack cinder-volume[87248]: WARNING cinder.quota [None req-d042fddb-f949-48a8-8d51-2a58c9eb59f0 tempest-TestInstancesWithCinderVolumes-1364232362 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1220719295-92313959 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1220719295-92313959, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:28:53 devstack cinder-volume[87248]: WARNING cinder.quota [None req-d042fddb-f949-48a8-8d51-2a58c9eb59f0 tempest-TestInstancesWithCinderVolumes-1364232362 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1220719295-92313959 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1220719295-92313959, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:28:53 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-d042fddb-f949-48a8-8d51-2a58c9eb59f0 tempest-TestInstancesWithCinderVolumes-1364232362 None] Created reservations ['102e725f-5414-4e9a-a521-d1768264f21c', 'bd026963-875a-4ee0-95fb-2aaf78a05f28', '56767a95-c4af-498c-9505-d0b78d885a11', '2c3db048-00e9-465c-9902-b2d6991bfa01'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:28:53 devstack sudo[100700]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2aa700d-684a-4ea2-82b3-60bc427c0428_6oddnduodevstack@QuobyteHD" returned: 0 in 0.584s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2aa700d-684a-4ea2-82b3-60bc427c0428_6oddnduodevstack@QuobyteHD {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d042fddb-f949-48a8-8d51-2a58c9eb59f0 tempest-TestInstancesWithCinderVolumes-1364232362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:28:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d042fddb-f949-48a8-8d51-2a58c9eb59f0 tempest-TestInstancesWithCinderVolumes-1364232362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:28:54 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-d042fddb-f949-48a8-8d51-2a58c9eb59f0 tempest-TestInstancesWithCinderVolumes-1364232362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:28:54 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-d042fddb-f949-48a8-8d51-2a58c9eb59f0 tempest-TestInstancesWithCinderVolumes-1364232362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:28:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d042fddb-f949-48a8-8d51-2a58c9eb59f0 tempest-TestInstancesWithCinderVolumes-1364232362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:28:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d042fddb-f949-48a8-8d51-2a58c9eb59f0 tempest-TestInstancesWithCinderVolumes-1364232362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:54 devstack sudo[100706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:28:54 devstack sudo[100706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:54 devstack sudo[100705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2aa700d-684a-4ea2-82b3-60bc427c0428_6oddnduodevstack@QuobyteHD Nov 03 20:28:54 devstack sudo[100705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:54 devstack sudo[100706]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d042fddb-f949-48a8-8d51-2a58c9eb59f0 tempest-TestInstancesWithCinderVolumes-1364232362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.474s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:54 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-d042fddb-f949-48a8-8d51-2a58c9eb59f0 tempest-TestInstancesWithCinderVolumes-1364232362 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:28:54 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-d042fddb-f949-48a8-8d51-2a58c9eb59f0 tempest-TestInstancesWithCinderVolumes-1364232362 None] Deleted volume successfully. Nov 03 20:28:54 devstack sudo[100705]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:54 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d042fddb-f949-48a8-8d51-2a58c9eb59f0 tempest-TestInstancesWithCinderVolumes-1364232362 None] Lock "cinder-e012b197-88b6-4680-92de-40ca908ff3a4-delete_volume" released by "delete_volume" :: held 2.425s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:28:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2aa700d-684a-4ea2-82b3-60bc427c0428_6oddnduodevstack@QuobyteHD" returned: 1 in 0.615s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2aa700d-684a-4ea2-82b3-60bc427c0428_6oddnduodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 20:28:54 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Temporary image c2aa700d-684a-4ea2-82b3-60bc427c0428 is fetched for user c780f038947c4ec291c3a518d9e67a5e. {{(pid=87248) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 20:28:54 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b8aff3-9cb6-4f8f-8b95-b0c84f42d6b6]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:28:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2aa700d-684a-4ea2-82b3-60bc427c0428_6oddnduodevstack@QuobyteHD {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:54 devstack sudo[100714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2aa700d-684a-4ea2-82b3-60bc427c0428_6oddnduodevstack@QuobyteHD Nov 03 20:28:54 devstack sudo[100714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:55 devstack sudo[100714]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2aa700d-684a-4ea2-82b3-60bc427c0428_6oddnduodevstack@QuobyteHD" returned: 0 in 0.483s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2aa700d-684a-4ea2-82b3-60bc427c0428_6oddnduodevstack@QuobyteHD {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:55 devstack sudo[100718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2aa700d-684a-4ea2-82b3-60bc427c0428_6oddnduodevstack@QuobyteHD Nov 03 20:28:55 devstack sudo[100718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:55 devstack sudo[100718]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2aa700d-684a-4ea2-82b3-60bc427c0428_6oddnduodevstack@QuobyteHD" returned: 1 in 0.403s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2aa700d-684a-4ea2-82b3-60bc427c0428_6oddnduodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 20:28:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:28:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:28:55 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:28:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd701b70-d38d-422a-9b94-7fa4623e8662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5f273d9c7e845fca925f6b9e5d8033e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:28:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:28:52Z,use_quota=True,user_id='c780f038947c4ec291c3a518d9e67a5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:28:55 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Creating volume bd701b70-d38d-422a-9b94-7fa4623e8662 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:28:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:28:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:28:55 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:28:55 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:28:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:28:55 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:28:55 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:28:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bd701b70-d38d-422a-9b94-7fa4623e8662 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:55 devstack sudo[100723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bd701b70-d38d-422a-9b94-7fa4623e8662 1073741824 Nov 03 20:28:55 devstack sudo[100723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:56 devstack sudo[100723]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bd701b70-d38d-422a-9b94-7fa4623e8662 1073741824" returned: 0 in 0.788s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bd701b70-d38d-422a-9b94-7fa4623e8662 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:56 devstack sudo[100730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bd701b70-d38d-422a-9b94-7fa4623e8662 Nov 03 20:28:56 devstack sudo[100730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:56 devstack sudo[100730]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bd701b70-d38d-422a-9b94-7fa4623e8662" returned: 0 in 0.348s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:56 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:28:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:28:56 devstack cinder-volume[87248]: DEBUG cinder.volume.volume_utils [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Attempting download of c2aa700d-684a-4ea2-82b3-60bc427c0428 ((None, [{'url': 'file:///opt/stack/data/glance/images/c2aa700d-684a-4ea2-82b3-60bc427c0428', 'metadata': {}}])) to volume bd701b70-d38d-422a-9b94-7fa4623e8662. {{(pid=87248) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 20:28:57 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[4072bc3b-af2b-4941-956c-713b0e2c719c]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:28:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c2aa700d-684a-4ea2-82b3-60bc427c0428_41sg3zsd {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:57 devstack sudo[100769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c2aa700d-684a-4ea2-82b3-60bc427c0428_41sg3zsd Nov 03 20:28:57 devstack sudo[100769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:57 devstack sudo[100769]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c2aa700d-684a-4ea2-82b3-60bc427c0428_41sg3zsd" returned: 0 in 0.515s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c2aa700d-684a-4ea2-82b3-60bc427c0428_41sg3zsd {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:57 devstack sudo[100784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c2aa700d-684a-4ea2-82b3-60bc427c0428_41sg3zsd Nov 03 20:28:57 devstack sudo[100784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:58 devstack sudo[100784]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c2aa700d-684a-4ea2-82b3-60bc427c0428_41sg3zsd" returned: 1 in 0.542s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c2aa700d-684a-4ea2-82b3-60bc427c0428_41sg3zsd' failed. Not Retrying. {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 20:28:58 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a7d8aa-d88e-431b-83fb-d5bbb65938d6]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:28:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2aa700d-684a-4ea2-82b3-60bc427c0428_6oddnduodevstack@QuobyteHD {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:58 devstack sudo[100797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2aa700d-684a-4ea2-82b3-60bc427c0428_6oddnduodevstack@QuobyteHD Nov 03 20:28:58 devstack sudo[100797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:58 devstack sudo[100797]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2aa700d-684a-4ea2-82b3-60bc427c0428_6oddnduodevstack@QuobyteHD" returned: 0 in 0.541s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2aa700d-684a-4ea2-82b3-60bc427c0428_6oddnduodevstack@QuobyteHD {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:58 devstack sudo[100802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2aa700d-684a-4ea2-82b3-60bc427c0428_6oddnduodevstack@QuobyteHD Nov 03 20:28:58 devstack sudo[100802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:59 devstack sudo[100802]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2aa700d-684a-4ea2-82b3-60bc427c0428_6oddnduodevstack@QuobyteHD" returned: 1 in 0.472s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2aa700d-684a-4ea2-82b3-60bc427c0428_6oddnduodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 20:28:59 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] c2aa700d-684a-4ea2-82b3-60bc427c0428 was raw, converting to qcow2 {{(pid=87248) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 20:28:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c2aa700d-684a-4ea2-82b3-60bc427c0428_6oddnduodevstack@QuobyteHD /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bd701b70-d38d-422a-9b94-7fa4623e8662 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:59 devstack sudo[100808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c2aa700d-684a-4ea2-82b3-60bc427c0428_6oddnduodevstack@QuobyteHD /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bd701b70-d38d-422a-9b94-7fa4623e8662 Nov 03 20:28:59 devstack sudo[100808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:28:59 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-8c7ceb95-8a9b-4308-9fef-53104062ca37 req-6881c466-0158-4762-8445-bcc1d10826b9 tempest-TestInstancesWithCinderVolumes-1364232362 None] Terminate volume connection completed successfully. Nov 03 20:28:59 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-8c7ceb95-8a9b-4308-9fef-53104062ca37 req-6881c466-0158-4762-8445-bcc1d10826b9 tempest-TestInstancesWithCinderVolumes-1364232362 None] Deleting attachment 32481690-a1c0-4796-b8fe-39b64aec100f. {{(pid=87248) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 20:28:59 devstack sudo[100808]: pam_unix(sudo:session): session closed for user root Nov 03 20:28:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c2aa700d-684a-4ea2-82b3-60bc427c0428_6oddnduodevstack@QuobyteHD /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bd701b70-d38d-422a-9b94-7fa4623e8662" returned: 0 in 0.720s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:28:59 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c2aa700d-684a-4ea2-82b3-60bc427c0428_6oddnduodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bd701b70-d38d-422a-9b94-7fa4623e8662 {{(pid=87248) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:28:59 devstack cinder-volume[87248]: INFO cinder.image.image_utils [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 20:28:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bd701b70-d38d-422a-9b94-7fa4623e8662 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:28:59 devstack sudo[100815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bd701b70-d38d-422a-9b94-7fa4623e8662 1G Nov 03 20:28:59 devstack sudo[100815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:00 devstack sudo[100815]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bd701b70-d38d-422a-9b94-7fa4623e8662 1G" returned: 0 in 0.455s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:00 devstack cinder-volume[87248]: DEBUG cinder.volume.volume_utils [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Downloaded image c2aa700d-684a-4ea2-82b3-60bc427c0428 ((None, [{'url': 'file:///opt/stack/data/glance/images/c2aa700d-684a-4ea2-82b3-60bc427c0428', 'metadata': {}}])) to volume bd701b70-d38d-422a-9b94-7fa4623e8662 successfully. {{(pid=87248) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 20:29:00 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Temporary image c2aa700d-684a-4ea2-82b3-60bc427c0428 for user c780f038947c4ec291c3a518d9e67a5e is deleted. {{(pid=87248) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 20:29:00 devstack cinder-volume[87248]: DEBUG cinder.volume.volume_utils [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Marking volume bd701b70-d38d-422a-9b94-7fa4623e8662 as bootable. {{(pid=87248) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 20:29:00 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Copying metadata from image c2aa700d-684a-4ea2-82b3-60bc427c0428 to bd701b70-d38d-422a-9b94-7fa4623e8662. {{(pid=87248) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 20:29:00 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Creating volume glance metadata for volume bd701b70-d38d-422a-9b94-7fa4623e8662 backed by image c2aa700d-684a-4ea2-82b3-60bc427c0428 with: {'image_id': 'c2aa700d-684a-4ea2-82b3-60bc427c0428', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '3b19646bd34f249e9e34199579d7766b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87248) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 20:29:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db2f94f2-c6e8-4928-a194-25a6f6aab746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd701b70-d38d-422a-9b94-7fa4623e8662', 'volume_size': 1, 'image_id': 'c2aa700d-684a-4ea2-82b3-60bc427c0428', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c2aa700d-684a-4ea2-82b3-60bc427c0428', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3b19646bd34f249e9e34199579d7766b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f5f273d9c7e845fca925f6b9e5d8033e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4b45117a9e16530ff0d52f8b378919d276f940d8e81d69b6b7efa2a6c955c341cc4c66a96f38eb8d3f674996098fc2d421c71fb24f0c72f8259ebab976db7676', 'id': 'c2aa700d-684a-4ea2-82b3-60bc427c0428', 'created_at': datetime.datetime(2026, 11, 3, 19, 28, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 28, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c2aa700d-684a-4ea2-82b3-60bc427c0428/file', 'properties': {}}, 'image_service': }' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:29:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56a33dcc-08f7-4f03-ad99-91a4172e6070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:29:00 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Volume volume-bd701b70-d38d-422a-9b94-7fa4623e8662 (bd701b70-d38d-422a-9b94-7fa4623e8662): created successfully Nov 03 20:29:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56a33dcc-08f7-4f03-ad99-91a4172e6070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:29:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Flow 'volume_create_manager' (511e5cba-56a2-4023-b6ac-660f75344e71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:29:00 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-68cad54a-fa52-4d0c-8f30-917d0102c1f0 tempest-VolumeImageDependencyTests-544838128 None] Created volume successfully. Nov 03 20:29:00 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-07701b44-3c76-4746-8d5f-9e937da834c2 tempest-TestInstancesWithCinderVolumes-1364232362 None] Acquiring lock "cinder-73b150f6-b10c-422d-9de8-3fac99321fe5-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:29:01 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-07701b44-3c76-4746-8d5f-9e937da834c2 tempest-TestInstancesWithCinderVolumes-1364232362 None] Lock "cinder-73b150f6-b10c-422d-9de8-3fac99321fe5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:29:01 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-07701b44-3c76-4746-8d5f-9e937da834c2 tempest-TestInstancesWithCinderVolumes-1364232362 None] Acquiring lock "cinder-quobyte-73b150f6-b10c-422d-9de8-3fac99321fe5" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:29:01 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-07701b44-3c76-4746-8d5f-9e937da834c2 tempest-TestInstancesWithCinderVolumes-1364232362 None] Lock "cinder-quobyte-73b150f6-b10c-422d-9de8-3fac99321fe5" acquired by "delete_volume" :: waited 0.018s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:29:01 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd61d834-472d-4795-8d9a-3774d078fbf2]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:29:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-07701b44-3c76-4746-8d5f-9e937da834c2 tempest-TestInstancesWithCinderVolumes-1364232362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-73b150f6-b10c-422d-9de8-3fac99321fe5 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:01 devstack sudo[100821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-73b150f6-b10c-422d-9de8-3fac99321fe5 Nov 03 20:29:01 devstack sudo[100821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:01 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-43d9b54b-071c-40b1-9fec-0da58ca7dd1e tempest-VolumeImageDependencyTests-544838128 None] Acquiring lock "cinder-bd701b70-d38d-422a-9b94-7fa4623e8662-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:29:01 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-43d9b54b-071c-40b1-9fec-0da58ca7dd1e tempest-VolumeImageDependencyTests-544838128 None] Lock "cinder-bd701b70-d38d-422a-9b94-7fa4623e8662-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:29:01 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-43d9b54b-071c-40b1-9fec-0da58ca7dd1e tempest-VolumeImageDependencyTests-544838128 None] Acquiring lock "cinder-quobyte-bd701b70-d38d-422a-9b94-7fa4623e8662" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:29:01 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-43d9b54b-071c-40b1-9fec-0da58ca7dd1e tempest-VolumeImageDependencyTests-544838128 None] Lock "cinder-quobyte-bd701b70-d38d-422a-9b94-7fa4623e8662" acquired by "delete_volume" :: waited 0.024s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:29:01 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0a92ae-fcd5-48e8-83f0-03898128c291]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:29:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-43d9b54b-071c-40b1-9fec-0da58ca7dd1e tempest-VolumeImageDependencyTests-544838128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bd701b70-d38d-422a-9b94-7fa4623e8662 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:01 devstack sudo[100821]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-07701b44-3c76-4746-8d5f-9e937da834c2 tempest-TestInstancesWithCinderVolumes-1364232362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-73b150f6-b10c-422d-9de8-3fac99321fe5" returned: 0 in 0.472s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-07701b44-3c76-4746-8d5f-9e937da834c2 tempest-TestInstancesWithCinderVolumes-1364232362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-73b150f6-b10c-422d-9de8-3fac99321fe5 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:01 devstack sudo[100827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-73b150f6-b10c-422d-9de8-3fac99321fe5 Nov 03 20:29:01 devstack sudo[100827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:01 devstack sudo[100826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bd701b70-d38d-422a-9b94-7fa4623e8662 Nov 03 20:29:01 devstack sudo[100826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:01 devstack sudo[100827]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-07701b44-3c76-4746-8d5f-9e937da834c2 tempest-TestInstancesWithCinderVolumes-1364232362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-73b150f6-b10c-422d-9de8-3fac99321fe5" returned: 0 in 0.272s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:01 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-07701b44-3c76-4746-8d5f-9e937da834c2 tempest-TestInstancesWithCinderVolumes-1364232362 None] Lock "cinder-quobyte-73b150f6-b10c-422d-9de8-3fac99321fe5" released by "delete_volume" :: held 0.791s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:29:01 devstack cinder-volume[87248]: WARNING cinder.quota [None req-07701b44-3c76-4746-8d5f-9e937da834c2 tempest-TestInstancesWithCinderVolumes-1364232362 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-265524470-549205696 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-265524470-549205696, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:29:01 devstack cinder-volume[87248]: WARNING cinder.quota [None req-07701b44-3c76-4746-8d5f-9e937da834c2 tempest-TestInstancesWithCinderVolumes-1364232362 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-265524470-549205696 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-265524470-549205696, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:29:01 devstack sudo[100826]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-43d9b54b-071c-40b1-9fec-0da58ca7dd1e tempest-VolumeImageDependencyTests-544838128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bd701b70-d38d-422a-9b94-7fa4623e8662" returned: 0 in 0.405s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-43d9b54b-071c-40b1-9fec-0da58ca7dd1e tempest-VolumeImageDependencyTests-544838128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bd701b70-d38d-422a-9b94-7fa4623e8662 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:01 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-07701b44-3c76-4746-8d5f-9e937da834c2 tempest-TestInstancesWithCinderVolumes-1364232362 None] Created reservations ['293d5ea9-dec0-4eb4-a367-e9efe0001e93', '7b9ebea1-b3e9-40cc-8b68-044ccea5e3bd', '284a073c-b681-4c45-ac44-ff4b0f2b14fe', '9f309c60-32f9-42a3-b25f-2906a5bc0e4d'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:29:01 devstack sudo[100835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bd701b70-d38d-422a-9b94-7fa4623e8662 Nov 03 20:29:01 devstack sudo[100835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-07701b44-3c76-4746-8d5f-9e937da834c2 tempest-TestInstancesWithCinderVolumes-1364232362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:29:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-07701b44-3c76-4746-8d5f-9e937da834c2 tempest-TestInstancesWithCinderVolumes-1364232362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:29:02 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-07701b44-3c76-4746-8d5f-9e937da834c2 tempest-TestInstancesWithCinderVolumes-1364232362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:29:02 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-07701b44-3c76-4746-8d5f-9e937da834c2 tempest-TestInstancesWithCinderVolumes-1364232362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:29:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-07701b44-3c76-4746-8d5f-9e937da834c2 tempest-TestInstancesWithCinderVolumes-1364232362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:29:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-07701b44-3c76-4746-8d5f-9e937da834c2 tempest-TestInstancesWithCinderVolumes-1364232362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:02 devstack sudo[100837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:29:02 devstack sudo[100837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:02 devstack sudo[100835]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-43d9b54b-071c-40b1-9fec-0da58ca7dd1e tempest-VolumeImageDependencyTests-544838128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bd701b70-d38d-422a-9b94-7fa4623e8662" returned: 0 in 0.306s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:02 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-43d9b54b-071c-40b1-9fec-0da58ca7dd1e tempest-VolumeImageDependencyTests-544838128 None] Lock "cinder-quobyte-bd701b70-d38d-422a-9b94-7fa4623e8662" released by "delete_volume" :: held 0.783s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:29:02 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-43d9b54b-071c-40b1-9fec-0da58ca7dd1e tempest-VolumeImageDependencyTests-544838128 None] Created reservations ['7071be2a-0940-4931-b4f9-1b0164674a21', '4e8a2e98-7028-42e1-ab92-22bb4ec37565', 'b581ec8c-754f-4801-ac0b-e683c17e5bf6', '0bb3f976-0544-48e3-b00c-fce5c1c1df13'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:29:02 devstack sudo[100837]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-07701b44-3c76-4746-8d5f-9e937da834c2 tempest-TestInstancesWithCinderVolumes-1364232362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.317s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:02 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-07701b44-3c76-4746-8d5f-9e937da834c2 tempest-TestInstancesWithCinderVolumes-1364232362 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:29:02 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-07701b44-3c76-4746-8d5f-9e937da834c2 tempest-TestInstancesWithCinderVolumes-1364232362 None] Deleted volume successfully. Nov 03 20:29:02 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-07701b44-3c76-4746-8d5f-9e937da834c2 tempest-TestInstancesWithCinderVolumes-1364232362 None] Lock "cinder-73b150f6-b10c-422d-9de8-3fac99321fe5-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:29:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-43d9b54b-071c-40b1-9fec-0da58ca7dd1e tempest-VolumeImageDependencyTests-544838128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:29:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-43d9b54b-071c-40b1-9fec-0da58ca7dd1e tempest-VolumeImageDependencyTests-544838128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:29:02 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-43d9b54b-071c-40b1-9fec-0da58ca7dd1e tempest-VolumeImageDependencyTests-544838128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:29:02 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-43d9b54b-071c-40b1-9fec-0da58ca7dd1e tempest-VolumeImageDependencyTests-544838128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:29:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-43d9b54b-071c-40b1-9fec-0da58ca7dd1e tempest-VolumeImageDependencyTests-544838128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:29:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-43d9b54b-071c-40b1-9fec-0da58ca7dd1e tempest-VolumeImageDependencyTests-544838128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:02 devstack sudo[100847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:29:02 devstack sudo[100847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:02 devstack sudo[100847]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-43d9b54b-071c-40b1-9fec-0da58ca7dd1e tempest-VolumeImageDependencyTests-544838128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.376s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:02 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-43d9b54b-071c-40b1-9fec-0da58ca7dd1e tempest-VolumeImageDependencyTests-544838128 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:29:02 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-43d9b54b-071c-40b1-9fec-0da58ca7dd1e tempest-VolumeImageDependencyTests-544838128 None] Deleted volume successfully. Nov 03 20:29:02 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-43d9b54b-071c-40b1-9fec-0da58ca7dd1e tempest-VolumeImageDependencyTests-544838128 None] Lock "cinder-bd701b70-d38d-422a-9b94-7fa4623e8662-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:29:09 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-d13a4755-f863-40de-9156-a8bce2b87799 tempest-AttachVolumeNegativeTest-1262133860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:29:09 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d13a4755-f863-40de-9156-a8bce2b87799 tempest-AttachVolumeNegativeTest-1262133860 None] Flow 'volume_create_manager' (cf3f3189-e438-4ffe-8921-0009c055cc6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:29:09 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d13a4755-f863-40de-9156-a8bce2b87799 tempest-AttachVolumeNegativeTest-1262133860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51b21972-faab-4511-a369-9e57aa4192f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:29:09 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d13a4755-f863-40de-9156-a8bce2b87799 tempest-AttachVolumeNegativeTest-1262133860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51b21972-faab-4511-a369-9e57aa4192f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:29:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1819629025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f663d726-38da-44db-a953-39dc13769fe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0ca15c601f747d395e8d184a9e0e0ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:29:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:29:10Z,use_quota=True,user_id='b397ba0c98774898b6e0048d127232da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:29:09 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d13a4755-f863-40de-9156-a8bce2b87799 tempest-AttachVolumeNegativeTest-1262133860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45cb77a6-b7e0-4d97-87d2-2a521ffd53e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:29:09 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d13a4755-f863-40de-9156-a8bce2b87799 tempest-AttachVolumeNegativeTest-1262133860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45cb77a6-b7e0-4d97-87d2-2a521ffd53e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:29:09 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d13a4755-f863-40de-9156-a8bce2b87799 tempest-AttachVolumeNegativeTest-1262133860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86b8a462-4c71-4393-80bf-11addbcb39b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:29:09 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d13a4755-f863-40de-9156-a8bce2b87799 tempest-AttachVolumeNegativeTest-1262133860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86b8a462-4c71-4393-80bf-11addbcb39b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f663d726-38da-44db-a953-39dc13769fe6', 'volume_name': 'volume-f663d726-38da-44db-a953-39dc13769fe6', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:29:09 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d13a4755-f863-40de-9156-a8bce2b87799 tempest-AttachVolumeNegativeTest-1262133860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1644b4f-192e-4a42-a21c-51e507aa6316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:29:09 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d13a4755-f863-40de-9156-a8bce2b87799 tempest-AttachVolumeNegativeTest-1262133860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1644b4f-192e-4a42-a21c-51e507aa6316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:29:09 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d13a4755-f863-40de-9156-a8bce2b87799 tempest-AttachVolumeNegativeTest-1262133860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e229105e-5508-4688-b3d6-344cb8236d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:29:09 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-d13a4755-f863-40de-9156-a8bce2b87799 tempest-AttachVolumeNegativeTest-1262133860 None] Volume f663d726-38da-44db-a953-39dc13769fe6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f663d726-38da-44db-a953-39dc13769fe6', 'volume_size': 1} Nov 03 20:29:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d13a4755-f863-40de-9156-a8bce2b87799 tempest-AttachVolumeNegativeTest-1262133860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:29:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d13a4755-f863-40de-9156-a8bce2b87799 tempest-AttachVolumeNegativeTest-1262133860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:29:09 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-d13a4755-f863-40de-9156-a8bce2b87799 tempest-AttachVolumeNegativeTest-1262133860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:29:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1819629025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f663d726-38da-44db-a953-39dc13769fe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0ca15c601f747d395e8d184a9e0e0ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:29:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:29:10Z,use_quota=True,user_id='b397ba0c98774898b6e0048d127232da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:29:09 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-d13a4755-f863-40de-9156-a8bce2b87799 tempest-AttachVolumeNegativeTest-1262133860 None] Creating volume f663d726-38da-44db-a953-39dc13769fe6 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:29:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d13a4755-f863-40de-9156-a8bce2b87799 tempest-AttachVolumeNegativeTest-1262133860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:29:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d13a4755-f863-40de-9156-a8bce2b87799 tempest-AttachVolumeNegativeTest-1262133860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:29:09 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-d13a4755-f863-40de-9156-a8bce2b87799 tempest-AttachVolumeNegativeTest-1262133860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:29:09 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-d13a4755-f863-40de-9156-a8bce2b87799 tempest-AttachVolumeNegativeTest-1262133860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:29:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d13a4755-f863-40de-9156-a8bce2b87799 tempest-AttachVolumeNegativeTest-1262133860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:29:09 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-d13a4755-f863-40de-9156-a8bce2b87799 tempest-AttachVolumeNegativeTest-1262133860 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:29:09 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-d13a4755-f863-40de-9156-a8bce2b87799 tempest-AttachVolumeNegativeTest-1262133860 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:29:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d13a4755-f863-40de-9156-a8bce2b87799 tempest-AttachVolumeNegativeTest-1262133860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f663d726-38da-44db-a953-39dc13769fe6 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:09 devstack sudo[100890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f663d726-38da-44db-a953-39dc13769fe6 1073741824 Nov 03 20:29:09 devstack sudo[100890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:10 devstack sudo[100890]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d13a4755-f863-40de-9156-a8bce2b87799 tempest-AttachVolumeNegativeTest-1262133860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f663d726-38da-44db-a953-39dc13769fe6 1073741824" returned: 0 in 0.856s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d13a4755-f863-40de-9156-a8bce2b87799 tempest-AttachVolumeNegativeTest-1262133860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f663d726-38da-44db-a953-39dc13769fe6 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:10 devstack sudo[100896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f663d726-38da-44db-a953-39dc13769fe6 Nov 03 20:29:10 devstack sudo[100896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:11 devstack sudo[100896]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d13a4755-f863-40de-9156-a8bce2b87799 tempest-AttachVolumeNegativeTest-1262133860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f663d726-38da-44db-a953-39dc13769fe6" returned: 0 in 0.378s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:11 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-d13a4755-f863-40de-9156-a8bce2b87799 tempest-AttachVolumeNegativeTest-1262133860 None] <== create_volume: return (1327ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:29:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d13a4755-f863-40de-9156-a8bce2b87799 tempest-AttachVolumeNegativeTest-1262133860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.335s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:29:11 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d13a4755-f863-40de-9156-a8bce2b87799 tempest-AttachVolumeNegativeTest-1262133860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e229105e-5508-4688-b3d6-344cb8236d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f663d726-38da-44db-a953-39dc13769fe6', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:29:11 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d13a4755-f863-40de-9156-a8bce2b87799 tempest-AttachVolumeNegativeTest-1262133860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b947e93-fe11-477a-aad1-7a679d151fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:29:11 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-d13a4755-f863-40de-9156-a8bce2b87799 tempest-AttachVolumeNegativeTest-1262133860 None] Volume volume-f663d726-38da-44db-a953-39dc13769fe6 (f663d726-38da-44db-a953-39dc13769fe6): created successfully Nov 03 20:29:11 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d13a4755-f863-40de-9156-a8bce2b87799 tempest-AttachVolumeNegativeTest-1262133860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b947e93-fe11-477a-aad1-7a679d151fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:29:11 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d13a4755-f863-40de-9156-a8bce2b87799 tempest-AttachVolumeNegativeTest-1262133860 None] Flow 'volume_create_manager' (cf3f3189-e438-4ffe-8921-0009c055cc6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:29:11 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-d13a4755-f863-40de-9156-a8bce2b87799 tempest-AttachVolumeNegativeTest-1262133860 None] Created volume successfully. Nov 03 20:29:12 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-47cc7dca-d0a0-4e57-a170-559988428e48 tempest-CinderUnicodeTest-2054357048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:29:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-47cc7dca-d0a0-4e57-a170-559988428e48 tempest-CinderUnicodeTest-2054357048 None] Flow 'volume_create_manager' (2559b390-f66a-4511-94a2-fcfdc66d7ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:29:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-47cc7dca-d0a0-4e57-a170-559988428e48 tempest-CinderUnicodeTest-2054357048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f5ecbf8-7e18-4489-9022-9523ba5d7110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:29:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-47cc7dca-d0a0-4e57-a170-559988428e48 tempest-CinderUnicodeTest-2054357048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f5ecbf8-7e18-4489-9022-9523ba5d7110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4c3d505-4966-4556-b139-fc72e1d34244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='316516250e174ed8a98b688c15471d8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:29:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:29:12Z,use_quota=True,user_id='4d0c4e10818d42e0b3e8f21b702e537c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:29:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-47cc7dca-d0a0-4e57-a170-559988428e48 tempest-CinderUnicodeTest-2054357048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c917eb2-e668-4872-8879-1cd19c8287d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:29:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-47cc7dca-d0a0-4e57-a170-559988428e48 tempest-CinderUnicodeTest-2054357048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c917eb2-e668-4872-8879-1cd19c8287d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:29:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-47cc7dca-d0a0-4e57-a170-559988428e48 tempest-CinderUnicodeTest-2054357048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1f34050-e106-4f29-852d-031bd1712ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:29:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-47cc7dca-d0a0-4e57-a170-559988428e48 tempest-CinderUnicodeTest-2054357048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1f34050-e106-4f29-852d-031bd1712ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4c3d505-4966-4556-b139-fc72e1d34244', 'volume_name': 'volume-c4c3d505-4966-4556-b139-fc72e1d34244', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:29:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-47cc7dca-d0a0-4e57-a170-559988428e48 tempest-CinderUnicodeTest-2054357048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d13f9d5-b246-423c-9842-4010e9e086ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:29:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-47cc7dca-d0a0-4e57-a170-559988428e48 tempest-CinderUnicodeTest-2054357048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d13f9d5-b246-423c-9842-4010e9e086ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:29:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-47cc7dca-d0a0-4e57-a170-559988428e48 tempest-CinderUnicodeTest-2054357048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b46745ec-3dee-4282-83fc-bedbb89a87a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:29:12 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-47cc7dca-d0a0-4e57-a170-559988428e48 tempest-CinderUnicodeTest-2054357048 None] Volume c4c3d505-4966-4556-b139-fc72e1d34244: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4c3d505-4966-4556-b139-fc72e1d34244', 'volume_size': 1} Nov 03 20:29:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-47cc7dca-d0a0-4e57-a170-559988428e48 tempest-CinderUnicodeTest-2054357048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:29:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-47cc7dca-d0a0-4e57-a170-559988428e48 tempest-CinderUnicodeTest-2054357048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:29:12 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-47cc7dca-d0a0-4e57-a170-559988428e48 tempest-CinderUnicodeTest-2054357048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4c3d505-4966-4556-b139-fc72e1d34244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='316516250e174ed8a98b688c15471d8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:29:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:29:12Z,use_quota=True,user_id='4d0c4e10818d42e0b3e8f21b702e537c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:29:12 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-47cc7dca-d0a0-4e57-a170-559988428e48 tempest-CinderUnicodeTest-2054357048 None] Creating volume c4c3d505-4966-4556-b139-fc72e1d34244 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:29:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-47cc7dca-d0a0-4e57-a170-559988428e48 tempest-CinderUnicodeTest-2054357048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:29:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-47cc7dca-d0a0-4e57-a170-559988428e48 tempest-CinderUnicodeTest-2054357048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:29:12 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-47cc7dca-d0a0-4e57-a170-559988428e48 tempest-CinderUnicodeTest-2054357048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:29:12 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-47cc7dca-d0a0-4e57-a170-559988428e48 tempest-CinderUnicodeTest-2054357048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:29:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-47cc7dca-d0a0-4e57-a170-559988428e48 tempest-CinderUnicodeTest-2054357048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:29:12 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-47cc7dca-d0a0-4e57-a170-559988428e48 tempest-CinderUnicodeTest-2054357048 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:29:12 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-47cc7dca-d0a0-4e57-a170-559988428e48 tempest-CinderUnicodeTest-2054357048 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:29:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-47cc7dca-d0a0-4e57-a170-559988428e48 tempest-CinderUnicodeTest-2054357048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-c4c3d505-4966-4556-b139-fc72e1d34244 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:12 devstack sudo[100905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-c4c3d505-4966-4556-b139-fc72e1d34244 1073741824 Nov 03 20:29:12 devstack sudo[100905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-2203f6e7-14c1-477b-af8a-c5304b5ac96e req-eb91628c-3d2c-437a-b4d1-f05b25450505 tempest-AttachVolumeNegativeTest-1262133860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:29:13 devstack sudo[100905]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-47cc7dca-d0a0-4e57-a170-559988428e48 tempest-CinderUnicodeTest-2054357048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-c4c3d505-4966-4556-b139-fc72e1d34244 1073741824" returned: 0 in 0.584s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-47cc7dca-d0a0-4e57-a170-559988428e48 tempest-CinderUnicodeTest-2054357048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-c4c3d505-4966-4556-b139-fc72e1d34244 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:13 devstack sudo[100919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-c4c3d505-4966-4556-b139-fc72e1d34244 Nov 03 20:29:13 devstack sudo[100919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:13 devstack sudo[100919]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-47cc7dca-d0a0-4e57-a170-559988428e48 tempest-CinderUnicodeTest-2054357048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-c4c3d505-4966-4556-b139-fc72e1d34244" returned: 0 in 0.280s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:13 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-47cc7dca-d0a0-4e57-a170-559988428e48 tempest-CinderUnicodeTest-2054357048 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:29:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-47cc7dca-d0a0-4e57-a170-559988428e48 tempest-CinderUnicodeTest-2054357048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:29:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-2203f6e7-14c1-477b-af8a-c5304b5ac96e req-eb91628c-3d2c-437a-b4d1-f05b25450505 tempest-AttachVolumeNegativeTest-1262133860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.519s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:29:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-2203f6e7-14c1-477b-af8a-c5304b5ac96e req-eb91628c-3d2c-437a-b4d1-f05b25450505 tempest-AttachVolumeNegativeTest-1262133860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:29:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-47cc7dca-d0a0-4e57-a170-559988428e48 tempest-CinderUnicodeTest-2054357048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b46745ec-3dee-4282-83fc-bedbb89a87a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4c3d505-4966-4556-b139-fc72e1d34244', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:29:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-47cc7dca-d0a0-4e57-a170-559988428e48 tempest-CinderUnicodeTest-2054357048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0640f1c3-c383-42f5-b493-ee82ecd5dd15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:29:13 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-47cc7dca-d0a0-4e57-a170-559988428e48 tempest-CinderUnicodeTest-2054357048 None] Volume volume-c4c3d505-4966-4556-b139-fc72e1d34244 (c4c3d505-4966-4556-b139-fc72e1d34244): created successfully Nov 03 20:29:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-47cc7dca-d0a0-4e57-a170-559988428e48 tempest-CinderUnicodeTest-2054357048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0640f1c3-c383-42f5-b493-ee82ecd5dd15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:29:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-47cc7dca-d0a0-4e57-a170-559988428e48 tempest-CinderUnicodeTest-2054357048 None] Flow 'volume_create_manager' (2559b390-f66a-4511-94a2-fcfdc66d7ee6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:29:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-2203f6e7-14c1-477b-af8a-c5304b5ac96e req-eb91628c-3d2c-437a-b4d1-f05b25450505 tempest-AttachVolumeNegativeTest-1262133860 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8', 'name': 'volume-f663d726-38da-44db-a953-39dc13769fe6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '734502fb-d504-433b-a129-f788e1fcc4bd', 'enforce_multipath': True} {{(pid=87248) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 20:29:13 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-47cc7dca-d0a0-4e57-a170-559988428e48 tempest-CinderUnicodeTest-2054357048 None] Created volume successfully. Nov 03 20:29:13 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-2203f6e7-14c1-477b-af8a-c5304b5ac96e req-eb91628c-3d2c-437a-b4d1-f05b25450505 tempest-AttachVolumeNegativeTest-1262133860 None] attachment_update completed successfully. Nov 03 20:29:15 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e67774b-460b-4320-9886-646265a307c4 tempest-CinderUnicodeTest-2054357048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:29:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4e67774b-460b-4320-9886-646265a307c4 tempest-CinderUnicodeTest-2054357048 None] Flow 'volume_create_manager' (4b95054c-e7ec-4060-a723-27d91d9c7b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:29:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4e67774b-460b-4320-9886-646265a307c4 tempest-CinderUnicodeTest-2054357048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (772b1506-b255-411e-859b-cacf69580ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:29:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4e67774b-460b-4320-9886-646265a307c4 tempest-CinderUnicodeTest-2054357048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (772b1506-b255-411e-859b-cacf69580ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:29:15Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-219921967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a49d12b-c70a-4590-a804-ab89b83f0c26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='316516250e174ed8a98b688c15471d8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:29:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:29:15Z,use_quota=True,user_id='4d0c4e10818d42e0b3e8f21b702e537c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:29:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4e67774b-460b-4320-9886-646265a307c4 tempest-CinderUnicodeTest-2054357048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1242175-2bdd-4995-8c87-5b7f126ee2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:29:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4e67774b-460b-4320-9886-646265a307c4 tempest-CinderUnicodeTest-2054357048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1242175-2bdd-4995-8c87-5b7f126ee2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:29:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4e67774b-460b-4320-9886-646265a307c4 tempest-CinderUnicodeTest-2054357048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (567ec7ff-bf91-48b3-ab4e-734793812f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:29:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4e67774b-460b-4320-9886-646265a307c4 tempest-CinderUnicodeTest-2054357048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (567ec7ff-bf91-48b3-ab4e-734793812f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a49d12b-c70a-4590-a804-ab89b83f0c26', 'volume_name': 'volume-6a49d12b-c70a-4590-a804-ab89b83f0c26', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:29:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4e67774b-460b-4320-9886-646265a307c4 tempest-CinderUnicodeTest-2054357048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de793f47-6d39-498e-9444-f707ebca198a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:29:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4e67774b-460b-4320-9886-646265a307c4 tempest-CinderUnicodeTest-2054357048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de793f47-6d39-498e-9444-f707ebca198a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:29:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4e67774b-460b-4320-9886-646265a307c4 tempest-CinderUnicodeTest-2054357048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab0fd3b7-dc9b-4104-a7cc-94863bdd56ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:29:15 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-4e67774b-460b-4320-9886-646265a307c4 tempest-CinderUnicodeTest-2054357048 None] Volume 6a49d12b-c70a-4590-a804-ab89b83f0c26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a49d12b-c70a-4590-a804-ab89b83f0c26', 'volume_size': 1} Nov 03 20:29:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4e67774b-460b-4320-9886-646265a307c4 tempest-CinderUnicodeTest-2054357048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:29:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4e67774b-460b-4320-9886-646265a307c4 tempest-CinderUnicodeTest-2054357048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:29:15 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-4e67774b-460b-4320-9886-646265a307c4 tempest-CinderUnicodeTest-2054357048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:29:15Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-219921967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a49d12b-c70a-4590-a804-ab89b83f0c26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='316516250e174ed8a98b688c15471d8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:29:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:29:15Z,use_quota=True,user_id='4d0c4e10818d42e0b3e8f21b702e537c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:29:15 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-4e67774b-460b-4320-9886-646265a307c4 tempest-CinderUnicodeTest-2054357048 None] Creating volume 6a49d12b-c70a-4590-a804-ab89b83f0c26 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:29:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4e67774b-460b-4320-9886-646265a307c4 tempest-CinderUnicodeTest-2054357048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:29:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4e67774b-460b-4320-9886-646265a307c4 tempest-CinderUnicodeTest-2054357048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:29:15 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-4e67774b-460b-4320-9886-646265a307c4 tempest-CinderUnicodeTest-2054357048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:29:15 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-4e67774b-460b-4320-9886-646265a307c4 tempest-CinderUnicodeTest-2054357048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:29:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4e67774b-460b-4320-9886-646265a307c4 tempest-CinderUnicodeTest-2054357048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:29:15 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-4e67774b-460b-4320-9886-646265a307c4 tempest-CinderUnicodeTest-2054357048 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:29:15 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-4e67774b-460b-4320-9886-646265a307c4 tempest-CinderUnicodeTest-2054357048 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:29:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4e67774b-460b-4320-9886-646265a307c4 tempest-CinderUnicodeTest-2054357048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6a49d12b-c70a-4590-a804-ab89b83f0c26 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:15 devstack sudo[101341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6a49d12b-c70a-4590-a804-ab89b83f0c26 1073741824 Nov 03 20:29:15 devstack sudo[101341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:15 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:29:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Flow 'volume_create_manager' (72ab8d08-ae0d-4aa1-b039-ce81cd7e52a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:29:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04598427-2560-4dd9-aa89-e3789d9d916a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:29:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04598427-2560-4dd9-aa89-e3789d9d916a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:29:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-489800797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e66183fe-35e0-4de3-ac30-d3c443b74bde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a63ccc45b1b45f0b1f0701e9827f4c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:29:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:29:16Z,use_quota=True,user_id='f72941836ac3450eb88da387671e965f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:29:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1cdf932-fe52-45f0-9dcd-8bee8ad6b685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:29:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1cdf932-fe52-45f0-9dcd-8bee8ad6b685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:29:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f0425db-4ee6-406b-8f95-117c66a34985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:29:15 devstack cinder-volume[87248]: DEBUG cinder.image.glance [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Creating Keystone auth plugin from conf {{(pid=87248) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 20:29:15 devstack sudo[101341]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4e67774b-460b-4320-9886-646265a307c4 tempest-CinderUnicodeTest-2054357048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6a49d12b-c70a-4590-a804-ab89b83f0c26 1073741824" returned: 0 in 0.672s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4e67774b-460b-4320-9886-646265a307c4 tempest-CinderUnicodeTest-2054357048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6a49d12b-c70a-4590-a804-ab89b83f0c26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:16 devstack sudo[101347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6a49d12b-c70a-4590-a804-ab89b83f0c26 Nov 03 20:29:16 devstack sudo[101347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:16 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f0425db-4ee6-406b-8f95-117c66a34985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e66183fe-35e0-4de3-ac30-d3c443b74bde', 'volume_name': 'volume-e66183fe-35e0-4de3-ac30-d3c443b74bde', 'volume_size': 1, 'image_id': '346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a647f64245a54dad95167f6d04c75eaa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'created_at': datetime.datetime(2026, 11, 3, 19, 11, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 11, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/346de059-5b9a-438e-a6dd-24e9fc9a1ee3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:29:16 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c4fedda-8b44-47aa-a86a-fdeab6522289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:29:16 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c4fedda-8b44-47aa-a86a-fdeab6522289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:29:16 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9890ea5f-dd7e-4bb5-8ad9-eb7766b16829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:29:16 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Volume e66183fe-35e0-4de3-ac30-d3c443b74bde: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e66183fe-35e0-4de3-ac30-d3c443b74bde', 'volume_size': 1, 'image_id': '346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a647f64245a54dad95167f6d04c75eaa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'created_at': datetime.datetime(2026, 11, 3, 19, 11, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 11, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/346de059-5b9a-438e-a6dd-24e9fc9a1ee3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 20:29:16 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Trying to clone e66183fe-35e0-4de3-ac30-d3c443b74bde from image 346de059-5b9a-438e-a6dd-24e9fc9a1ee3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'metadata': {}}]). {{(pid=87248) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 20:29:16 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-3d2090b5-e6ee-4d3b-bddc-f5f1494b235b req-8d0ad05c-fb83-4f76-a4f3-cee20264c6f8 tempest-AttachVolumeNegativeTest-1262133860 None] Terminate volume connection completed successfully. Nov 03 20:29:16 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-3d2090b5-e6ee-4d3b-bddc-f5f1494b235b req-8d0ad05c-fb83-4f76-a4f3-cee20264c6f8 tempest-AttachVolumeNegativeTest-1262133860 None] Deleting attachment 734502fb-d504-433b-a129-f788e1fcc4bd. {{(pid=87248) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 20:29:16 devstack sudo[101347]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4e67774b-460b-4320-9886-646265a307c4 tempest-CinderUnicodeTest-2054357048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6a49d12b-c70a-4590-a804-ab89b83f0c26" returned: 0 in 0.330s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:16 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-4e67774b-460b-4320-9886-646265a307c4 tempest-CinderUnicodeTest-2054357048 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:29:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4e67774b-460b-4320-9886-646265a307c4 tempest-CinderUnicodeTest-2054357048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:29:16 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4e67774b-460b-4320-9886-646265a307c4 tempest-CinderUnicodeTest-2054357048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab0fd3b7-dc9b-4104-a7cc-94863bdd56ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a49d12b-c70a-4590-a804-ab89b83f0c26', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:29:16 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4e67774b-460b-4320-9886-646265a307c4 tempest-CinderUnicodeTest-2054357048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (565b93c9-5da6-4039-ae0e-baebf5dd1964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:29:16 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-4e67774b-460b-4320-9886-646265a307c4 tempest-CinderUnicodeTest-2054357048 None] Volume volume-6a49d12b-c70a-4590-a804-ab89b83f0c26 (6a49d12b-c70a-4590-a804-ab89b83f0c26): created successfully Nov 03 20:29:16 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4e67774b-460b-4320-9886-646265a307c4 tempest-CinderUnicodeTest-2054357048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (565b93c9-5da6-4039-ae0e-baebf5dd1964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:29:16 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4e67774b-460b-4320-9886-646265a307c4 tempest-CinderUnicodeTest-2054357048 None] Flow 'volume_create_manager' (4b95054c-e7ec-4060-a723-27d91d9c7b19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:29:16 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-4e67774b-460b-4320-9886-646265a307c4 tempest-CinderUnicodeTest-2054357048 None] Created volume successfully. Nov 03 20:29:16 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_iocmlja4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87248) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 20:29:16 devstack cinder-volume[87248]: INFO cinder.image.image_utils [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Image download 20.69 MB at 20.69 MB/s Nov 03 20:29:16 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc2c947-07a0-4daf-b523-c9ee45819b6f]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:29:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_iocmlja4devstack@QuobyteHD {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:16 devstack sudo[101377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_iocmlja4devstack@QuobyteHD Nov 03 20:29:16 devstack sudo[101377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:17 devstack sudo[101377]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_iocmlja4devstack@QuobyteHD" returned: 0 in 0.360s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:17 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Temporary image 346de059-5b9a-438e-a6dd-24e9fc9a1ee3 is fetched for user f72941836ac3450eb88da387671e965f. {{(pid=87248) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 20:29:17 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3a35b3-e3ac-4037-802e-46a475b16676]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:29:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_iocmlja4devstack@QuobyteHD {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:17 devstack sudo[101382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_iocmlja4devstack@QuobyteHD Nov 03 20:29:17 devstack sudo[101382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c9b1a73d-107a-4083-a3a5-a756ff2d8046 tempest-CinderUnicodeTest-2054357048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:29:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c9b1a73d-107a-4083-a3a5-a756ff2d8046 tempest-CinderUnicodeTest-2054357048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:29:17 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-c9b1a73d-107a-4083-a3a5-a756ff2d8046 tempest-CinderUnicodeTest-2054357048 None] Creating offline snapshot 5c4e2d85-cb62-44b3-835b-8f9e8874f0c4 of volume 6a49d12b-c70a-4590-a804-ab89b83f0c26 {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:29:17 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b81ec4-1b55-4616-a43b-e573b6ad04fd]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:29:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c9b1a73d-107a-4083-a3a5-a756ff2d8046 tempest-CinderUnicodeTest-2054357048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6a49d12b-c70a-4590-a804-ab89b83f0c26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:18 devstack sudo[101400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6a49d12b-c70a-4590-a804-ab89b83f0c26 Nov 03 20:29:18 devstack sudo[101400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:18 devstack sudo[101382]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_iocmlja4devstack@QuobyteHD" returned: 0 in 0.815s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:29:18 devstack sudo[101400]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c9b1a73d-107a-4083-a3a5-a756ff2d8046 tempest-CinderUnicodeTest-2054357048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6a49d12b-c70a-4590-a804-ab89b83f0c26" returned: 0 in 0.497s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c9b1a73d-107a-4083-a3a5-a756ff2d8046 tempest-CinderUnicodeTest-2054357048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6a49d12b-c70a-4590-a804-ab89b83f0c26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6a49d12b-c70a-4590-a804-ab89b83f0c26.5c4e2d85-cb62-44b3-835b-8f9e8874f0c4 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:18 devstack sudo[101414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6a49d12b-c70a-4590-a804-ab89b83f0c26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6a49d12b-c70a-4590-a804-ab89b83f0c26.5c4e2d85-cb62-44b3-835b-8f9e8874f0c4 1G Nov 03 20:29:18 devstack sudo[101414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:19 devstack sudo[101414]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c9b1a73d-107a-4083-a3a5-a756ff2d8046 tempest-CinderUnicodeTest-2054357048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6a49d12b-c70a-4590-a804-ab89b83f0c26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6a49d12b-c70a-4590-a804-ab89b83f0c26.5c4e2d85-cb62-44b3-835b-8f9e8874f0c4 1G" returned: 0 in 0.607s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c9b1a73d-107a-4083-a3a5-a756ff2d8046 tempest-CinderUnicodeTest-2054357048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a49d12b-c70a-4590-a804-ab89b83f0c26 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6a49d12b-c70a-4590-a804-ab89b83f0c26.5c4e2d85-cb62-44b3-835b-8f9e8874f0c4 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:19 devstack sudo[101422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a49d12b-c70a-4590-a804-ab89b83f0c26 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6a49d12b-c70a-4590-a804-ab89b83f0c26.5c4e2d85-cb62-44b3-835b-8f9e8874f0c4 Nov 03 20:29:19 devstack sudo[101422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:19 devstack sudo[101422]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c9b1a73d-107a-4083-a3a5-a756ff2d8046 tempest-CinderUnicodeTest-2054357048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a49d12b-c70a-4590-a804-ab89b83f0c26 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6a49d12b-c70a-4590-a804-ab89b83f0c26.5c4e2d85-cb62-44b3-835b-8f9e8874f0c4" returned: 0 in 0.430s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:19 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-c9b1a73d-107a-4083-a3a5-a756ff2d8046 tempest-CinderUnicodeTest-2054357048 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6a49d12b-c70a-4590-a804-ab89b83f0c26.5c4e2d85-cb62-44b3-835b-8f9e8874f0c4 is being set with open permissions: ugo+rw Nov 03 20:29:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c9b1a73d-107a-4083-a3a5-a756ff2d8046 tempest-CinderUnicodeTest-2054357048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6a49d12b-c70a-4590-a804-ab89b83f0c26.5c4e2d85-cb62-44b3-835b-8f9e8874f0c4 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:19 devstack sudo[101428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6a49d12b-c70a-4590-a804-ab89b83f0c26.5c4e2d85-cb62-44b3-835b-8f9e8874f0c4 Nov 03 20:29:19 devstack sudo[101428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:19 devstack sudo[101428]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c9b1a73d-107a-4083-a3a5-a756ff2d8046 tempest-CinderUnicodeTest-2054357048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6a49d12b-c70a-4590-a804-ab89b83f0c26.5c4e2d85-cb62-44b3-835b-8f9e8874f0c4" returned: 0 in 0.263s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c9b1a73d-107a-4083-a3a5-a756ff2d8046 tempest-CinderUnicodeTest-2054357048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6a49d12b-c70a-4590-a804-ab89b83f0c26.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:19 devstack sudo[101431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6a49d12b-c70a-4590-a804-ab89b83f0c26.info Nov 03 20:29:19 devstack sudo[101431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:20 devstack sudo[101431]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c9b1a73d-107a-4083-a3a5-a756ff2d8046 tempest-CinderUnicodeTest-2054357048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6a49d12b-c70a-4590-a804-ab89b83f0c26.info" returned: 0 in 0.303s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:20 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-c9b1a73d-107a-4083-a3a5-a756ff2d8046 tempest-CinderUnicodeTest-2054357048 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6a49d12b-c70a-4590-a804-ab89b83f0c26.info is being set with open permissions: ugo+rw Nov 03 20:29:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c9b1a73d-107a-4083-a3a5-a756ff2d8046 tempest-CinderUnicodeTest-2054357048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6a49d12b-c70a-4590-a804-ab89b83f0c26.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:20 devstack sudo[101434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6a49d12b-c70a-4590-a804-ab89b83f0c26.info Nov 03 20:29:20 devstack sudo[101434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:20 devstack sudo[101434]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c9b1a73d-107a-4083-a3a5-a756ff2d8046 tempest-CinderUnicodeTest-2054357048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6a49d12b-c70a-4590-a804-ab89b83f0c26.info" returned: 0 in 0.263s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c9b1a73d-107a-4083-a3a5-a756ff2d8046 tempest-CinderUnicodeTest-2054357048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.592s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:29:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.276s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:29:20 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:29:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-489800797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e66183fe-35e0-4de3-ac30-d3c443b74bde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a63ccc45b1b45f0b1f0701e9827f4c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:29:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:29:16Z,use_quota=True,user_id='f72941836ac3450eb88da387671e965f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:29:20 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Creating volume e66183fe-35e0-4de3-ac30-d3c443b74bde {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:29:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:29:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:29:20 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:29:20 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:29:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:29:20 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:29:20 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:29:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e66183fe-35e0-4de3-ac30-d3c443b74bde 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:20 devstack sudo[101437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e66183fe-35e0-4de3-ac30-d3c443b74bde 1073741824 Nov 03 20:29:20 devstack sudo[101437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:20 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-c9b1a73d-107a-4083-a3a5-a756ff2d8046 tempest-CinderUnicodeTest-2054357048 None] Create snapshot completed successfully Nov 03 20:29:20 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e44efca7-3b2f-430a-ba5d-95ddb2ea8a88 tempest-CinderUnicodeTest-2054357048 None] Acquiring lock "cinder-5c4e2d85-cb62-44b3-835b-8f9e8874f0c4-delete_snapshot" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:29:20 devstack sudo[101437]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:20 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e44efca7-3b2f-430a-ba5d-95ddb2ea8a88 tempest-CinderUnicodeTest-2054357048 None] Lock "cinder-5c4e2d85-cb62-44b3-835b-8f9e8874f0c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:29:21 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e44efca7-3b2f-430a-ba5d-95ddb2ea8a88 tempest-CinderUnicodeTest-2054357048 None] Acquiring lock "cinder-quobyte-6a49d12b-c70a-4590-a804-ab89b83f0c26" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:29:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e66183fe-35e0-4de3-ac30-d3c443b74bde 1073741824" returned: 0 in 0.596s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:21 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e44efca7-3b2f-430a-ba5d-95ddb2ea8a88 tempest-CinderUnicodeTest-2054357048 None] Lock "cinder-quobyte-6a49d12b-c70a-4590-a804-ab89b83f0c26" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:29:21 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e44efca7-3b2f-430a-ba5d-95ddb2ea8a88 tempest-CinderUnicodeTest-2054357048 None] Acquiring lock "cinder-quobyte-5c4e2d85-cb62-44b3-835b-8f9e8874f0c4" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:29:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e66183fe-35e0-4de3-ac30-d3c443b74bde {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:21 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e44efca7-3b2f-430a-ba5d-95ddb2ea8a88 tempest-CinderUnicodeTest-2054357048 None] Lock "cinder-quobyte-5c4e2d85-cb62-44b3-835b-8f9e8874f0c4" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:29:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-e44efca7-3b2f-430a-ba5d-95ddb2ea8a88 tempest-CinderUnicodeTest-2054357048 None] Deleting offline snapshot 5c4e2d85-cb62-44b3-835b-8f9e8874f0c4 of volume 6a49d12b-c70a-4590-a804-ab89b83f0c26 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:29:21 devstack sudo[101443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e66183fe-35e0-4de3-ac30-d3c443b74bde Nov 03 20:29:21 devstack sudo[101443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-e44efca7-3b2f-430a-ba5d-95ddb2ea8a88 tempest-CinderUnicodeTest-2054357048 None] snapshot_file for this snap is: volume-6a49d12b-c70a-4590-a804-ab89b83f0c26.5c4e2d85-cb62-44b3-835b-8f9e8874f0c4 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:29:21 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[502b6763-4a66-44fc-8a24-8d279cb733ff]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:29:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e44efca7-3b2f-430a-ba5d-95ddb2ea8a88 tempest-CinderUnicodeTest-2054357048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6a49d12b-c70a-4590-a804-ab89b83f0c26.5c4e2d85-cb62-44b3-835b-8f9e8874f0c4 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:21 devstack sudo[101445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6a49d12b-c70a-4590-a804-ab89b83f0c26.5c4e2d85-cb62-44b3-835b-8f9e8874f0c4 Nov 03 20:29:21 devstack sudo[101445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:21 devstack sudo[101443]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e66183fe-35e0-4de3-ac30-d3c443b74bde" returned: 0 in 0.330s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:29:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:29:21 devstack cinder-volume[87248]: DEBUG cinder.volume.volume_utils [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Attempting download of 346de059-5b9a-438e-a6dd-24e9fc9a1ee3 ((None, [{'url': 'file:///opt/stack/data/glance/images/346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'metadata': {}}])) to volume e66183fe-35e0-4de3-ac30-d3c443b74bde. {{(pid=87248) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 20:29:21 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dadaa08-fea5-40ff-adae-aa5478e88705]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:29:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_hedzm9y9 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:21 devstack sudo[101445]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e44efca7-3b2f-430a-ba5d-95ddb2ea8a88 tempest-CinderUnicodeTest-2054357048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6a49d12b-c70a-4590-a804-ab89b83f0c26.5c4e2d85-cb62-44b3-835b-8f9e8874f0c4" returned: 0 in 0.456s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-e44efca7-3b2f-430a-ba5d-95ddb2ea8a88 tempest-CinderUnicodeTest-2054357048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a49d12b-c70a-4590-a804-ab89b83f0c26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:29:21 devstack sudo[101450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_hedzm9y9 Nov 03 20:29:21 devstack sudo[101450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:21 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5dea48a-dfa6-4d41-aca3-d6ca7ef058e7]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:29:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e44efca7-3b2f-430a-ba5d-95ddb2ea8a88 tempest-CinderUnicodeTest-2054357048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6a49d12b-c70a-4590-a804-ab89b83f0c26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:21 devstack sudo[101453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6a49d12b-c70a-4590-a804-ab89b83f0c26 Nov 03 20:29:21 devstack sudo[101453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:21 devstack sudo[101450]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_hedzm9y9" returned: 0 in 0.392s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_hedzm9y9 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:22 devstack sudo[101458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_hedzm9y9 Nov 03 20:29:22 devstack sudo[101458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:22 devstack sudo[101453]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e44efca7-3b2f-430a-ba5d-95ddb2ea8a88 tempest-CinderUnicodeTest-2054357048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6a49d12b-c70a-4590-a804-ab89b83f0c26" returned: 0 in 0.593s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e44efca7-3b2f-430a-ba5d-95ddb2ea8a88 tempest-CinderUnicodeTest-2054357048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6a49d12b-c70a-4590-a804-ab89b83f0c26.5c4e2d85-cb62-44b3-835b-8f9e8874f0c4 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:22 devstack sudo[101464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6a49d12b-c70a-4590-a804-ab89b83f0c26.5c4e2d85-cb62-44b3-835b-8f9e8874f0c4 Nov 03 20:29:22 devstack sudo[101464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:22 devstack sudo[101458]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_hedzm9y9" returned: 1 in 0.541s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_hedzm9y9' failed. Not Retrying. {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 20:29:22 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabf0b7e-2341-493d-8f41-f8563c8867bb]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:29:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_iocmlja4devstack@QuobyteHD {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:22 devstack sudo[101468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_iocmlja4devstack@QuobyteHD Nov 03 20:29:22 devstack sudo[101468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:22 devstack sudo[101464]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e44efca7-3b2f-430a-ba5d-95ddb2ea8a88 tempest-CinderUnicodeTest-2054357048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6a49d12b-c70a-4590-a804-ab89b83f0c26.5c4e2d85-cb62-44b3-835b-8f9e8874f0c4" returned: 0 in 0.477s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e44efca7-3b2f-430a-ba5d-95ddb2ea8a88 tempest-CinderUnicodeTest-2054357048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6a49d12b-c70a-4590-a804-ab89b83f0c26.5c4e2d85-cb62-44b3-835b-8f9e8874f0c4 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:22 devstack sudo[101473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6a49d12b-c70a-4590-a804-ab89b83f0c26.5c4e2d85-cb62-44b3-835b-8f9e8874f0c4 Nov 03 20:29:22 devstack sudo[101473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:22 devstack sudo[101468]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_iocmlja4devstack@QuobyteHD" returned: 0 in 0.403s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:22 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] 346de059-5b9a-438e-a6dd-24e9fc9a1ee3 was qcow2, converting to qcow2 {{(pid=87248) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 20:29:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_iocmlja4devstack@QuobyteHD /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e66183fe-35e0-4de3-ac30-d3c443b74bde {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:22 devstack sudo[101478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_iocmlja4devstack@QuobyteHD /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e66183fe-35e0-4de3-ac30-d3c443b74bde Nov 03 20:29:22 devstack sudo[101478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:23 devstack sudo[101473]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e44efca7-3b2f-430a-ba5d-95ddb2ea8a88 tempest-CinderUnicodeTest-2054357048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6a49d12b-c70a-4590-a804-ab89b83f0c26.5c4e2d85-cb62-44b3-835b-8f9e8874f0c4" returned: 0 in 0.333s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:23 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e44efca7-3b2f-430a-ba5d-95ddb2ea8a88 tempest-CinderUnicodeTest-2054357048 None] Lock "cinder-quobyte-5c4e2d85-cb62-44b3-835b-8f9e8874f0c4" released by "_delete_snapshot" :: held 2.075s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:29:23 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e44efca7-3b2f-430a-ba5d-95ddb2ea8a88 tempest-CinderUnicodeTest-2054357048 None] Lock "cinder-quobyte-6a49d12b-c70a-4590-a804-ab89b83f0c26" released by "delete_snapshot" :: held 2.131s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:29:23 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-e44efca7-3b2f-430a-ba5d-95ddb2ea8a88 tempest-CinderUnicodeTest-2054357048 None] Created reservations ['4e49d188-f938-4825-804a-86f811129676', '57df9c81-87d4-47ae-b332-f2a7de7aa2d7', 'abf66c8e-b40d-4676-bf5f-02433b3de018', '53f68357-fd45-42a5-b0b4-8e74aa3ab803'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:29:23 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-e44efca7-3b2f-430a-ba5d-95ddb2ea8a88 tempest-CinderUnicodeTest-2054357048 None] Delete snapshot completed successfully. Nov 03 20:29:23 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e44efca7-3b2f-430a-ba5d-95ddb2ea8a88 tempest-CinderUnicodeTest-2054357048 None] Lock "cinder-5c4e2d85-cb62-44b3-835b-8f9e8874f0c4-delete_snapshot" released by "delete_snapshot" :: held 2.423s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:29:24 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ef300595-3e09-496a-936c-f8bfc2c9ea7c tempest-CinderUnicodeTest-2054357048 None] Acquiring lock "cinder-6a49d12b-c70a-4590-a804-ab89b83f0c26-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:29:24 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ef300595-3e09-496a-936c-f8bfc2c9ea7c tempest-CinderUnicodeTest-2054357048 None] Lock "cinder-6a49d12b-c70a-4590-a804-ab89b83f0c26-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:29:24 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ef300595-3e09-496a-936c-f8bfc2c9ea7c tempest-CinderUnicodeTest-2054357048 None] Acquiring lock "cinder-quobyte-6a49d12b-c70a-4590-a804-ab89b83f0c26" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:29:24 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ef300595-3e09-496a-936c-f8bfc2c9ea7c tempest-CinderUnicodeTest-2054357048 None] Lock "cinder-quobyte-6a49d12b-c70a-4590-a804-ab89b83f0c26" acquired by "delete_volume" :: waited 0.024s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:29:24 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6edad2-52a8-402d-9b99-29a6ca7c8c4b]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:29:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ef300595-3e09-496a-936c-f8bfc2c9ea7c tempest-CinderUnicodeTest-2054357048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6a49d12b-c70a-4590-a804-ab89b83f0c26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:24 devstack sudo[101488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6a49d12b-c70a-4590-a804-ab89b83f0c26 Nov 03 20:29:24 devstack sudo[101488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:24 devstack sudo[101488]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ef300595-3e09-496a-936c-f8bfc2c9ea7c tempest-CinderUnicodeTest-2054357048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6a49d12b-c70a-4590-a804-ab89b83f0c26" returned: 0 in 0.487s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ef300595-3e09-496a-936c-f8bfc2c9ea7c tempest-CinderUnicodeTest-2054357048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6a49d12b-c70a-4590-a804-ab89b83f0c26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:24 devstack sudo[101493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6a49d12b-c70a-4590-a804-ab89b83f0c26 Nov 03 20:29:24 devstack sudo[101493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:25 devstack sudo[101493]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ef300595-3e09-496a-936c-f8bfc2c9ea7c tempest-CinderUnicodeTest-2054357048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6a49d12b-c70a-4590-a804-ab89b83f0c26" returned: 0 in 0.369s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:25 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ef300595-3e09-496a-936c-f8bfc2c9ea7c tempest-CinderUnicodeTest-2054357048 None] Lock "cinder-quobyte-6a49d12b-c70a-4590-a804-ab89b83f0c26" released by "delete_volume" :: held 0.958s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:29:25 devstack sudo[101478]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_iocmlja4devstack@QuobyteHD /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e66183fe-35e0-4de3-ac30-d3c443b74bde" returned: 0 in 2.493s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:25 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_346de059-5b9a-438e-a6dd-24e9fc9a1ee3_iocmlja4devstack@QuobyteHD, size 112.00 MB, duration 2.49 sec, destination /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e66183fe-35e0-4de3-ac30-d3c443b74bde {{(pid=87248) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:29:25 devstack cinder-volume[87248]: INFO cinder.image.image_utils [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Converted 112.00 MB image at 44.91 MB/s Nov 03 20:29:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e66183fe-35e0-4de3-ac30-d3c443b74bde 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:25 devstack sudo[101497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e66183fe-35e0-4de3-ac30-d3c443b74bde 1G Nov 03 20:29:25 devstack sudo[101497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:25 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-ef300595-3e09-496a-936c-f8bfc2c9ea7c tempest-CinderUnicodeTest-2054357048 None] Created reservations ['2adbadc6-2272-4260-812a-321a7b6c1fc6', '8d631242-44b6-4b0e-a318-2d780b0ae474', 'b1a3a2de-edc5-4a77-a75b-05107b31e48c', '2eeef990-1a1d-434f-af78-333d0a4cbc56'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:29:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ef300595-3e09-496a-936c-f8bfc2c9ea7c tempest-CinderUnicodeTest-2054357048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:29:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ef300595-3e09-496a-936c-f8bfc2c9ea7c tempest-CinderUnicodeTest-2054357048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:29:25 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-ef300595-3e09-496a-936c-f8bfc2c9ea7c tempest-CinderUnicodeTest-2054357048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:29:25 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-ef300595-3e09-496a-936c-f8bfc2c9ea7c tempest-CinderUnicodeTest-2054357048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:29:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ef300595-3e09-496a-936c-f8bfc2c9ea7c tempest-CinderUnicodeTest-2054357048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:29:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ef300595-3e09-496a-936c-f8bfc2c9ea7c tempest-CinderUnicodeTest-2054357048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:25 devstack sudo[101501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:29:25 devstack sudo[101501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:25 devstack sudo[101501]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ef300595-3e09-496a-936c-f8bfc2c9ea7c tempest-CinderUnicodeTest-2054357048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.351s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:25 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-ef300595-3e09-496a-936c-f8bfc2c9ea7c tempest-CinderUnicodeTest-2054357048 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:29:25 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-ef300595-3e09-496a-936c-f8bfc2c9ea7c tempest-CinderUnicodeTest-2054357048 None] Deleted volume successfully. Nov 03 20:29:25 devstack sudo[101497]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e66183fe-35e0-4de3-ac30-d3c443b74bde 1G" returned: 0 in 0.590s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:25 devstack cinder-volume[87248]: DEBUG cinder.volume.volume_utils [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Downloaded image 346de059-5b9a-438e-a6dd-24e9fc9a1ee3 ((None, [{'url': 'file:///opt/stack/data/glance/images/346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'metadata': {}}])) to volume e66183fe-35e0-4de3-ac30-d3c443b74bde successfully. {{(pid=87248) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 20:29:25 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Temporary image 346de059-5b9a-438e-a6dd-24e9fc9a1ee3 for user f72941836ac3450eb88da387671e965f is deleted. {{(pid=87248) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 20:29:25 devstack cinder-volume[87248]: DEBUG cinder.volume.volume_utils [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Marking volume e66183fe-35e0-4de3-ac30-d3c443b74bde as bootable. {{(pid=87248) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 20:29:25 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ef300595-3e09-496a-936c-f8bfc2c9ea7c tempest-CinderUnicodeTest-2054357048 None] Lock "cinder-6a49d12b-c70a-4590-a804-ab89b83f0c26-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:29:26 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Copying metadata from image 346de059-5b9a-438e-a6dd-24e9fc9a1ee3 to e66183fe-35e0-4de3-ac30-d3c443b74bde. {{(pid=87248) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 20:29:26 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Creating volume glance metadata for volume e66183fe-35e0-4de3-ac30-d3c443b74bde backed by image 346de059-5b9a-438e-a6dd-24e9fc9a1ee3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87248) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 20:29:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9890ea5f-dd7e-4bb5-8ad9-eb7766b16829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e66183fe-35e0-4de3-ac30-d3c443b74bde', 'volume_size': 1, 'image_id': '346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a647f64245a54dad95167f6d04c75eaa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '346de059-5b9a-438e-a6dd-24e9fc9a1ee3', 'created_at': datetime.datetime(2026, 11, 3, 19, 11, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 11, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/346de059-5b9a-438e-a6dd-24e9fc9a1ee3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:29:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec97b5be-ad64-4137-a659-09ba27f7392c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:29:26 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Volume volume-e66183fe-35e0-4de3-ac30-d3c443b74bde (e66183fe-35e0-4de3-ac30-d3c443b74bde): created successfully Nov 03 20:29:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec97b5be-ad64-4137-a659-09ba27f7392c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:29:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Flow 'volume_create_manager' (72ab8d08-ae0d-4aa1-b039-ce81cd7e52a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:29:26 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-fe74169b-cfd4-4c18-b9cc-4c788f530e90 tempest-TestShelveInstance-965880078 None] Created volume successfully. Nov 03 20:29:26 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-4a099ce3-4750-4166-8978-d3a0deda67b5 tempest-CinderUnicodeTest-2054357048 None] Acquiring lock "cinder-c4c3d505-4966-4556-b139-fc72e1d34244-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:29:26 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-4a099ce3-4750-4166-8978-d3a0deda67b5 tempest-CinderUnicodeTest-2054357048 None] Lock "cinder-c4c3d505-4966-4556-b139-fc72e1d34244-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:29:26 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-4a099ce3-4750-4166-8978-d3a0deda67b5 tempest-CinderUnicodeTest-2054357048 None] Acquiring lock "cinder-quobyte-c4c3d505-4966-4556-b139-fc72e1d34244" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:29:26 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-4a099ce3-4750-4166-8978-d3a0deda67b5 tempest-CinderUnicodeTest-2054357048 None] Lock "cinder-quobyte-c4c3d505-4966-4556-b139-fc72e1d34244" acquired by "delete_volume" :: waited 0.020s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:29:26 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[2511e95c-20bd-4474-b332-9dee25c9eeb4]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:29:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4a099ce3-4750-4166-8978-d3a0deda67b5 tempest-CinderUnicodeTest-2054357048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-c4c3d505-4966-4556-b139-fc72e1d34244 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:26 devstack sudo[101507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-c4c3d505-4966-4556-b139-fc72e1d34244 Nov 03 20:29:26 devstack sudo[101507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:27 devstack sudo[101507]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4a099ce3-4750-4166-8978-d3a0deda67b5 tempest-CinderUnicodeTest-2054357048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-c4c3d505-4966-4556-b139-fc72e1d34244" returned: 0 in 0.588s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4a099ce3-4750-4166-8978-d3a0deda67b5 tempest-CinderUnicodeTest-2054357048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-c4c3d505-4966-4556-b139-fc72e1d34244 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:27 devstack sudo[101517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-c4c3d505-4966-4556-b139-fc72e1d34244 Nov 03 20:29:27 devstack sudo[101517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:27 devstack sudo[101517]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4a099ce3-4750-4166-8978-d3a0deda67b5 tempest-CinderUnicodeTest-2054357048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-c4c3d505-4966-4556-b139-fc72e1d34244" returned: 0 in 0.374s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:27 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-4a099ce3-4750-4166-8978-d3a0deda67b5 tempest-CinderUnicodeTest-2054357048 None] Lock "cinder-quobyte-c4c3d505-4966-4556-b139-fc72e1d34244" released by "delete_volume" :: held 1.066s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:29:27 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-4a099ce3-4750-4166-8978-d3a0deda67b5 tempest-CinderUnicodeTest-2054357048 None] Created reservations ['b9abd080-c4d1-42ad-8251-09fd8d46ed1f', 'b99c2ffe-e0d8-403e-a65a-e792035649d3', '74141ff9-eb99-49b4-b30c-7ea98ee87a6d', 'dbcde799-d550-4b5b-9e90-df9604a3cce3'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:29:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4a099ce3-4750-4166-8978-d3a0deda67b5 tempest-CinderUnicodeTest-2054357048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:29:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4a099ce3-4750-4166-8978-d3a0deda67b5 tempest-CinderUnicodeTest-2054357048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:29:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-4a099ce3-4750-4166-8978-d3a0deda67b5 tempest-CinderUnicodeTest-2054357048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:29:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-4a099ce3-4750-4166-8978-d3a0deda67b5 tempest-CinderUnicodeTest-2054357048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:29:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4a099ce3-4750-4166-8978-d3a0deda67b5 tempest-CinderUnicodeTest-2054357048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:29:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4a099ce3-4750-4166-8978-d3a0deda67b5 tempest-CinderUnicodeTest-2054357048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:28 devstack sudo[101532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:29:28 devstack sudo[101532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:28 devstack sudo[101532]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4a099ce3-4750-4166-8978-d3a0deda67b5 tempest-CinderUnicodeTest-2054357048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.375s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:28 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-4a099ce3-4750-4166-8978-d3a0deda67b5 tempest-CinderUnicodeTest-2054357048 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:29:28 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-4a099ce3-4750-4166-8978-d3a0deda67b5 tempest-CinderUnicodeTest-2054357048 None] Deleted volume successfully. Nov 03 20:29:28 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-4a099ce3-4750-4166-8978-d3a0deda67b5 tempest-CinderUnicodeTest-2054357048 None] Lock "cinder-c4c3d505-4966-4556-b139-fc72e1d34244-delete_volume" released by "delete_volume" :: held 1.808s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:29:28 devstack cinder-volume[87248]: DEBUG oslo_service.periodic_task [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:29:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:29:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:29:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:29:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:29:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:29:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:29:28 devstack sudo[101540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:29:28 devstack sudo[101540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:29:29 devstack sudo[101540]: pam_unix(sudo:session): session closed for user root Nov 03 20:29:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.289s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:29:29 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:29:29 devstack cinder-volume[87248]: DEBUG oslo_service.periodic_task [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running periodic task VolumeManager._thread_info {{(pid=87248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:29:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] thread count: 28 {{(pid=87248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:29:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] thread info: [<_MainThread(MainThread, started 124862067372160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:29:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-c08c6d11-465f-4995-be4d-6475cb23abea req-7883728b-019b-428a-b6e4-c2f994a23d82 tempest-TestShelveInstance-965880078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:29:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-c08c6d11-465f-4995-be4d-6475cb23abea req-7883728b-019b-428a-b6e4-c2f994a23d82 tempest-TestShelveInstance-965880078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:29:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-c08c6d11-465f-4995-be4d-6475cb23abea req-7883728b-019b-428a-b6e4-c2f994a23d82 tempest-TestShelveInstance-965880078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:29:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-c08c6d11-465f-4995-be4d-6475cb23abea req-7883728b-019b-428a-b6e4-c2f994a23d82 tempest-TestShelveInstance-965880078 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8', 'name': 'volume-e66183fe-35e0-4de3-ac30-d3c443b74bde', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0925d34d-2eab-4c38-a8b8-73c5dc35c676', 'enforce_multipath': True} {{(pid=87248) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 20:29:37 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-c08c6d11-465f-4995-be4d-6475cb23abea req-7883728b-019b-428a-b6e4-c2f994a23d82 tempest-TestShelveInstance-965880078 None] attachment_update completed successfully. Nov 03 20:29:47 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:SELECT=88,cinder:INSERT=31,cinder:UPDATE=95,cinder:DELETE=6 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:29:47 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:SELECT=89,cinder:INSERT=33,cinder:UPDATE=88,cinder:DELETE=8 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:30:02 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-2187c3e5-f456-41b1-8664-f0938786bc27 tempest-AttachVolumeNegativeTest-1262133860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:30:03 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2187c3e5-f456-41b1-8664-f0938786bc27 tempest-AttachVolumeNegativeTest-1262133860 None] Flow 'volume_create_manager' (a3270d2b-556c-4b30-8336-3f5ac8f8c3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:30:03 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2187c3e5-f456-41b1-8664-f0938786bc27 tempest-AttachVolumeNegativeTest-1262133860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ee2d58b-17f1-47f2-9de1-cd1cc5ba78bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:03 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2187c3e5-f456-41b1-8664-f0938786bc27 tempest-AttachVolumeNegativeTest-1262133860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ee2d58b-17f1-47f2-9de1-cd1cc5ba78bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:30:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2015426533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c30495b-ef89-4232-a267-e891e39b44b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0ca15c601f747d395e8d184a9e0e0ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:30:03Z,use_quota=True,user_id='b397ba0c98774898b6e0048d127232da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:03 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2187c3e5-f456-41b1-8664-f0938786bc27 tempest-AttachVolumeNegativeTest-1262133860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feba3b22-2dbd-46ce-a1f7-2736ae34954e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:03 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2187c3e5-f456-41b1-8664-f0938786bc27 tempest-AttachVolumeNegativeTest-1262133860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feba3b22-2dbd-46ce-a1f7-2736ae34954e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:03 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2187c3e5-f456-41b1-8664-f0938786bc27 tempest-AttachVolumeNegativeTest-1262133860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16c5b086-73ce-4c9e-b559-923aebabf10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:03 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2187c3e5-f456-41b1-8664-f0938786bc27 tempest-AttachVolumeNegativeTest-1262133860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16c5b086-73ce-4c9e-b559-923aebabf10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c30495b-ef89-4232-a267-e891e39b44b1', 'volume_name': 'volume-3c30495b-ef89-4232-a267-e891e39b44b1', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:03 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2187c3e5-f456-41b1-8664-f0938786bc27 tempest-AttachVolumeNegativeTest-1262133860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b61213b-e549-4752-b0de-7623fc6fa432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:03 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2187c3e5-f456-41b1-8664-f0938786bc27 tempest-AttachVolumeNegativeTest-1262133860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b61213b-e549-4752-b0de-7623fc6fa432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:03 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2187c3e5-f456-41b1-8664-f0938786bc27 tempest-AttachVolumeNegativeTest-1262133860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (132d3e0b-220d-4042-9d21-4ba6c5f7f12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:03 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-2187c3e5-f456-41b1-8664-f0938786bc27 tempest-AttachVolumeNegativeTest-1262133860 None] Volume 3c30495b-ef89-4232-a267-e891e39b44b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c30495b-ef89-4232-a267-e891e39b44b1', 'volume_size': 1} Nov 03 20:30:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2187c3e5-f456-41b1-8664-f0938786bc27 tempest-AttachVolumeNegativeTest-1262133860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2187c3e5-f456-41b1-8664-f0938786bc27 tempest-AttachVolumeNegativeTest-1262133860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:03 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2187c3e5-f456-41b1-8664-f0938786bc27 tempest-AttachVolumeNegativeTest-1262133860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:30:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2015426533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c30495b-ef89-4232-a267-e891e39b44b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0ca15c601f747d395e8d184a9e0e0ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:30:03Z,use_quota=True,user_id='b397ba0c98774898b6e0048d127232da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:30:03 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-2187c3e5-f456-41b1-8664-f0938786bc27 tempest-AttachVolumeNegativeTest-1262133860 None] Creating volume 3c30495b-ef89-4232-a267-e891e39b44b1 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:30:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2187c3e5-f456-41b1-8664-f0938786bc27 tempest-AttachVolumeNegativeTest-1262133860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2187c3e5-f456-41b1-8664-f0938786bc27 tempest-AttachVolumeNegativeTest-1262133860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:03 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2187c3e5-f456-41b1-8664-f0938786bc27 tempest-AttachVolumeNegativeTest-1262133860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:30:03 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2187c3e5-f456-41b1-8664-f0938786bc27 tempest-AttachVolumeNegativeTest-1262133860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:30:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2187c3e5-f456-41b1-8664-f0938786bc27 tempest-AttachVolumeNegativeTest-1262133860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:03 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2187c3e5-f456-41b1-8664-f0938786bc27 tempest-AttachVolumeNegativeTest-1262133860 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:30:03 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-2187c3e5-f456-41b1-8664-f0938786bc27 tempest-AttachVolumeNegativeTest-1262133860 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:30:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2187c3e5-f456-41b1-8664-f0938786bc27 tempest-AttachVolumeNegativeTest-1262133860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c30495b-ef89-4232-a267-e891e39b44b1 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:03 devstack sudo[102186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c30495b-ef89-4232-a267-e891e39b44b1 1073741824 Nov 03 20:30:03 devstack sudo[102186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:03 devstack sudo[102186]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2187c3e5-f456-41b1-8664-f0938786bc27 tempest-AttachVolumeNegativeTest-1262133860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c30495b-ef89-4232-a267-e891e39b44b1 1073741824" returned: 0 in 0.726s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2187c3e5-f456-41b1-8664-f0938786bc27 tempest-AttachVolumeNegativeTest-1262133860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c30495b-ef89-4232-a267-e891e39b44b1 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:03 devstack sudo[102196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c30495b-ef89-4232-a267-e891e39b44b1 Nov 03 20:30:03 devstack sudo[102196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:04 devstack sudo[102196]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2187c3e5-f456-41b1-8664-f0938786bc27 tempest-AttachVolumeNegativeTest-1262133860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c30495b-ef89-4232-a267-e891e39b44b1" returned: 0 in 0.458s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:04 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2187c3e5-f456-41b1-8664-f0938786bc27 tempest-AttachVolumeNegativeTest-1262133860 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:30:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2187c3e5-f456-41b1-8664-f0938786bc27 tempest-AttachVolumeNegativeTest-1262133860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.272s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:04 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2187c3e5-f456-41b1-8664-f0938786bc27 tempest-AttachVolumeNegativeTest-1262133860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (132d3e0b-220d-4042-9d21-4ba6c5f7f12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c30495b-ef89-4232-a267-e891e39b44b1', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:04 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2187c3e5-f456-41b1-8664-f0938786bc27 tempest-AttachVolumeNegativeTest-1262133860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eed32823-2d22-49a9-957c-fa03e2680b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:04 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-2187c3e5-f456-41b1-8664-f0938786bc27 tempest-AttachVolumeNegativeTest-1262133860 None] Volume volume-3c30495b-ef89-4232-a267-e891e39b44b1 (3c30495b-ef89-4232-a267-e891e39b44b1): created successfully Nov 03 20:30:04 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2187c3e5-f456-41b1-8664-f0938786bc27 tempest-AttachVolumeNegativeTest-1262133860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eed32823-2d22-49a9-957c-fa03e2680b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:04 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2187c3e5-f456-41b1-8664-f0938786bc27 tempest-AttachVolumeNegativeTest-1262133860 None] Flow 'volume_create_manager' (a3270d2b-556c-4b30-8336-3f5ac8f8c3ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:30:04 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-2187c3e5-f456-41b1-8664-f0938786bc27 tempest-AttachVolumeNegativeTest-1262133860 None] Created volume successfully. Nov 03 20:30:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-c7bf30e0-ace7-4400-a840-d13e336a973b req-bad34a18-9156-4258-8445-57ce8689b4a3 tempest-AttachVolumeNegativeTest-1262133860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-c7bf30e0-ace7-4400-a840-d13e336a973b req-bad34a18-9156-4258-8445-57ce8689b4a3 tempest-AttachVolumeNegativeTest-1262133860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-c7bf30e0-ace7-4400-a840-d13e336a973b req-bad34a18-9156-4258-8445-57ce8689b4a3 tempest-AttachVolumeNegativeTest-1262133860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-c7bf30e0-ace7-4400-a840-d13e336a973b req-bad34a18-9156-4258-8445-57ce8689b4a3 tempest-AttachVolumeNegativeTest-1262133860 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8', 'name': 'volume-3c30495b-ef89-4232-a267-e891e39b44b1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a7ad6e34-0791-4495-b518-44a1d54717f5', 'enforce_multipath': True} {{(pid=87248) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 20:30:06 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-c7bf30e0-ace7-4400-a840-d13e336a973b req-bad34a18-9156-4258-8445-57ce8689b4a3 tempest-AttachVolumeNegativeTest-1262133860 None] attachment_update completed successfully. Nov 03 20:30:09 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-8727e47b-1837-45b9-a592-1434837f16ae req-b38f5e26-c99c-41da-9b36-9902626fcda9 tempest-AttachVolumeNegativeTest-1262133860 None] Terminate volume connection completed successfully. Nov 03 20:30:09 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-8727e47b-1837-45b9-a592-1434837f16ae req-b38f5e26-c99c-41da-9b36-9902626fcda9 tempest-AttachVolumeNegativeTest-1262133860 None] Deleting attachment a7ad6e34-0791-4495-b518-44a1d54717f5. {{(pid=87248) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 20:30:13 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-cff7a9d6-351d-418c-b105-39ffe0a67fba tempest-TestMinimumBasicScenario-486674481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:30:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cff7a9d6-351d-418c-b105-39ffe0a67fba tempest-TestMinimumBasicScenario-486674481 None] Flow 'volume_create_manager' (efb9ca54-d4a5-41b1-88df-77014cd80ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:30:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cff7a9d6-351d-418c-b105-39ffe0a67fba tempest-TestMinimumBasicScenario-486674481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75b21590-2902-452b-87df-b4adf0c1a954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cff7a9d6-351d-418c-b105-39ffe0a67fba tempest-TestMinimumBasicScenario-486674481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75b21590-2902-452b-87df-b4adf0c1a954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1674665712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d7b85c-35b6-4012-a4df-86733a3c4c43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8473bc4141d84df68139a323091a720a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:30:13Z,use_quota=True,user_id='c2853d4443ac4f26974bc34be86813e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cff7a9d6-351d-418c-b105-39ffe0a67fba tempest-TestMinimumBasicScenario-486674481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58ee4442-d6eb-4fe6-8004-3c8d7f5ab1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cff7a9d6-351d-418c-b105-39ffe0a67fba tempest-TestMinimumBasicScenario-486674481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58ee4442-d6eb-4fe6-8004-3c8d7f5ab1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cff7a9d6-351d-418c-b105-39ffe0a67fba tempest-TestMinimumBasicScenario-486674481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c5b1197-245d-4c40-9547-f39e95bed90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cff7a9d6-351d-418c-b105-39ffe0a67fba tempest-TestMinimumBasicScenario-486674481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c5b1197-245d-4c40-9547-f39e95bed90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4d7b85c-35b6-4012-a4df-86733a3c4c43', 'volume_name': 'volume-b4d7b85c-35b6-4012-a4df-86733a3c4c43', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cff7a9d6-351d-418c-b105-39ffe0a67fba tempest-TestMinimumBasicScenario-486674481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb312a9d-5689-4352-a7dc-5745ed823bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cff7a9d6-351d-418c-b105-39ffe0a67fba tempest-TestMinimumBasicScenario-486674481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb312a9d-5689-4352-a7dc-5745ed823bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cff7a9d6-351d-418c-b105-39ffe0a67fba tempest-TestMinimumBasicScenario-486674481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed8e471c-45e7-48dc-a6b4-651e4003d14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:13 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-cff7a9d6-351d-418c-b105-39ffe0a67fba tempest-TestMinimumBasicScenario-486674481 None] Volume b4d7b85c-35b6-4012-a4df-86733a3c4c43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4d7b85c-35b6-4012-a4df-86733a3c4c43', 'volume_size': 1} Nov 03 20:30:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-cff7a9d6-351d-418c-b105-39ffe0a67fba tempest-TestMinimumBasicScenario-486674481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-cff7a9d6-351d-418c-b105-39ffe0a67fba tempest-TestMinimumBasicScenario-486674481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:13 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-cff7a9d6-351d-418c-b105-39ffe0a67fba tempest-TestMinimumBasicScenario-486674481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1674665712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d7b85c-35b6-4012-a4df-86733a3c4c43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8473bc4141d84df68139a323091a720a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:30:13Z,use_quota=True,user_id='c2853d4443ac4f26974bc34be86813e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:30:13 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-cff7a9d6-351d-418c-b105-39ffe0a67fba tempest-TestMinimumBasicScenario-486674481 None] Creating volume b4d7b85c-35b6-4012-a4df-86733a3c4c43 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:30:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-cff7a9d6-351d-418c-b105-39ffe0a67fba tempest-TestMinimumBasicScenario-486674481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-cff7a9d6-351d-418c-b105-39ffe0a67fba tempest-TestMinimumBasicScenario-486674481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:13 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-cff7a9d6-351d-418c-b105-39ffe0a67fba tempest-TestMinimumBasicScenario-486674481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:30:13 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-cff7a9d6-351d-418c-b105-39ffe0a67fba tempest-TestMinimumBasicScenario-486674481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:30:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-cff7a9d6-351d-418c-b105-39ffe0a67fba tempest-TestMinimumBasicScenario-486674481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:13 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-cff7a9d6-351d-418c-b105-39ffe0a67fba tempest-TestMinimumBasicScenario-486674481 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:30:13 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-cff7a9d6-351d-418c-b105-39ffe0a67fba tempest-TestMinimumBasicScenario-486674481 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:30:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cff7a9d6-351d-418c-b105-39ffe0a67fba tempest-TestMinimumBasicScenario-486674481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b4d7b85c-35b6-4012-a4df-86733a3c4c43 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:13 devstack sudo[102381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b4d7b85c-35b6-4012-a4df-86733a3c4c43 1073741824 Nov 03 20:30:13 devstack sudo[102381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:13 devstack sudo[102381]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cff7a9d6-351d-418c-b105-39ffe0a67fba tempest-TestMinimumBasicScenario-486674481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b4d7b85c-35b6-4012-a4df-86733a3c4c43 1073741824" returned: 0 in 0.517s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cff7a9d6-351d-418c-b105-39ffe0a67fba tempest-TestMinimumBasicScenario-486674481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b4d7b85c-35b6-4012-a4df-86733a3c4c43 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:14 devstack sudo[102387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b4d7b85c-35b6-4012-a4df-86733a3c4c43 Nov 03 20:30:14 devstack sudo[102387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:14 devstack sudo[102387]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cff7a9d6-351d-418c-b105-39ffe0a67fba tempest-TestMinimumBasicScenario-486674481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b4d7b85c-35b6-4012-a4df-86733a3c4c43" returned: 0 in 0.365s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:14 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-cff7a9d6-351d-418c-b105-39ffe0a67fba tempest-TestMinimumBasicScenario-486674481 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:30:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-cff7a9d6-351d-418c-b105-39ffe0a67fba tempest-TestMinimumBasicScenario-486674481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:14 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cff7a9d6-351d-418c-b105-39ffe0a67fba tempest-TestMinimumBasicScenario-486674481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed8e471c-45e7-48dc-a6b4-651e4003d14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4d7b85c-35b6-4012-a4df-86733a3c4c43', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:14 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cff7a9d6-351d-418c-b105-39ffe0a67fba tempest-TestMinimumBasicScenario-486674481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49cdd02d-4d25-49e4-8e2a-d02779debbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:14 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-cff7a9d6-351d-418c-b105-39ffe0a67fba tempest-TestMinimumBasicScenario-486674481 None] Volume volume-b4d7b85c-35b6-4012-a4df-86733a3c4c43 (b4d7b85c-35b6-4012-a4df-86733a3c4c43): created successfully Nov 03 20:30:14 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cff7a9d6-351d-418c-b105-39ffe0a67fba tempest-TestMinimumBasicScenario-486674481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49cdd02d-4d25-49e4-8e2a-d02779debbd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:14 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cff7a9d6-351d-418c-b105-39ffe0a67fba tempest-TestMinimumBasicScenario-486674481 None] Flow 'volume_create_manager' (efb9ca54-d4a5-41b1-88df-77014cd80ccf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:30:14 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-cff7a9d6-351d-418c-b105-39ffe0a67fba tempest-TestMinimumBasicScenario-486674481 None] Created volume successfully. Nov 03 20:30:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-3fbd91c8-9432-4519-85ec-26bb26c35014 req-cf97e80d-16db-4f38-b84d-681ff3ad4f7f tempest-TestMinimumBasicScenario-486674481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-3fbd91c8-9432-4519-85ec-26bb26c35014 req-cf97e80d-16db-4f38-b84d-681ff3ad4f7f tempest-TestMinimumBasicScenario-486674481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-3fbd91c8-9432-4519-85ec-26bb26c35014 req-cf97e80d-16db-4f38-b84d-681ff3ad4f7f tempest-TestMinimumBasicScenario-486674481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:17 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-3fbd91c8-9432-4519-85ec-26bb26c35014 req-cf97e80d-16db-4f38-b84d-681ff3ad4f7f tempest-TestMinimumBasicScenario-486674481 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8', 'name': 'volume-b4d7b85c-35b6-4012-a4df-86733a3c4c43', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c753029d-7e0b-456a-9bf0-9e5a93dce4c4', 'enforce_multipath': True} {{(pid=87248) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 20:30:17 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-3fbd91c8-9432-4519-85ec-26bb26c35014 req-cf97e80d-16db-4f38-b84d-681ff3ad4f7f tempest-TestMinimumBasicScenario-486674481 None] attachment_update completed successfully. Nov 03 20:30:19 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-41d81790-09bc-4c2e-b23a-70336eb9561c tempest-AttachVolumeNegativeTest-1262133860 None] Acquiring lock "cinder-3c30495b-ef89-4232-a267-e891e39b44b1-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:30:19 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-41d81790-09bc-4c2e-b23a-70336eb9561c tempest-AttachVolumeNegativeTest-1262133860 None] Lock "cinder-3c30495b-ef89-4232-a267-e891e39b44b1-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:30:19 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-41d81790-09bc-4c2e-b23a-70336eb9561c tempest-AttachVolumeNegativeTest-1262133860 None] Acquiring lock "cinder-quobyte-3c30495b-ef89-4232-a267-e891e39b44b1" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:30:19 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-41d81790-09bc-4c2e-b23a-70336eb9561c tempest-AttachVolumeNegativeTest-1262133860 None] Lock "cinder-quobyte-3c30495b-ef89-4232-a267-e891e39b44b1" acquired by "delete_volume" :: waited 0.016s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:30:19 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8df8de9-a672-4129-a43b-dc8fe2430c39]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:30:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-41d81790-09bc-4c2e-b23a-70336eb9561c tempest-AttachVolumeNegativeTest-1262133860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c30495b-ef89-4232-a267-e891e39b44b1 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:19 devstack sudo[102424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c30495b-ef89-4232-a267-e891e39b44b1 Nov 03 20:30:19 devstack sudo[102424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:20 devstack sudo[102424]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-41d81790-09bc-4c2e-b23a-70336eb9561c tempest-AttachVolumeNegativeTest-1262133860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c30495b-ef89-4232-a267-e891e39b44b1" returned: 0 in 0.652s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-41d81790-09bc-4c2e-b23a-70336eb9561c tempest-AttachVolumeNegativeTest-1262133860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c30495b-ef89-4232-a267-e891e39b44b1 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:20 devstack sudo[102430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c30495b-ef89-4232-a267-e891e39b44b1 Nov 03 20:30:20 devstack sudo[102430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:20 devstack sudo[102430]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-41d81790-09bc-4c2e-b23a-70336eb9561c tempest-AttachVolumeNegativeTest-1262133860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3c30495b-ef89-4232-a267-e891e39b44b1" returned: 0 in 0.593s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:20 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-41d81790-09bc-4c2e-b23a-70336eb9561c tempest-AttachVolumeNegativeTest-1262133860 None] Lock "cinder-quobyte-3c30495b-ef89-4232-a267-e891e39b44b1" released by "delete_volume" :: held 1.354s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:30:20 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-41d81790-09bc-4c2e-b23a-70336eb9561c tempest-AttachVolumeNegativeTest-1262133860 None] Created reservations ['162283f8-8011-4029-babf-4ef8ce9a8e70', '251f45c1-2fb3-45fb-8f7c-f9d6552035d5', '640f3798-d3b3-43c1-a78d-48019018e364', '682a490a-271f-49e1-83c2-74d34a89b9c3'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:30:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-41d81790-09bc-4c2e-b23a-70336eb9561c tempest-AttachVolumeNegativeTest-1262133860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-41d81790-09bc-4c2e-b23a-70336eb9561c tempest-AttachVolumeNegativeTest-1262133860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-41d81790-09bc-4c2e-b23a-70336eb9561c tempest-AttachVolumeNegativeTest-1262133860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:30:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-41d81790-09bc-4c2e-b23a-70336eb9561c tempest-AttachVolumeNegativeTest-1262133860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:30:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-41d81790-09bc-4c2e-b23a-70336eb9561c tempest-AttachVolumeNegativeTest-1262133860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-41d81790-09bc-4c2e-b23a-70336eb9561c tempest-AttachVolumeNegativeTest-1262133860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:21 devstack sudo[102436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:30:21 devstack sudo[102436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:21 devstack sudo[102436]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-41d81790-09bc-4c2e-b23a-70336eb9561c tempest-AttachVolumeNegativeTest-1262133860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.520s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:21 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-41d81790-09bc-4c2e-b23a-70336eb9561c tempest-AttachVolumeNegativeTest-1262133860 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:30:21 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-41d81790-09bc-4c2e-b23a-70336eb9561c tempest-AttachVolumeNegativeTest-1262133860 None] Deleted volume successfully. Nov 03 20:30:21 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-41d81790-09bc-4c2e-b23a-70336eb9561c tempest-AttachVolumeNegativeTest-1262133860 None] Lock "cinder-3c30495b-ef89-4232-a267-e891e39b44b1-delete_volume" released by "delete_volume" :: held 2.287s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:30:21 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b39f5c2a-a99d-430c-95d5-748fa304f491 tempest-AttachVolumeNegativeTest-1262133860 None] Acquiring lock "cinder-f663d726-38da-44db-a953-39dc13769fe6-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:30:21 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b39f5c2a-a99d-430c-95d5-748fa304f491 tempest-AttachVolumeNegativeTest-1262133860 None] Lock "cinder-f663d726-38da-44db-a953-39dc13769fe6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:30:21 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b39f5c2a-a99d-430c-95d5-748fa304f491 tempest-AttachVolumeNegativeTest-1262133860 None] Acquiring lock "cinder-quobyte-f663d726-38da-44db-a953-39dc13769fe6" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:30:21 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b39f5c2a-a99d-430c-95d5-748fa304f491 tempest-AttachVolumeNegativeTest-1262133860 None] Lock "cinder-quobyte-f663d726-38da-44db-a953-39dc13769fe6" acquired by "delete_volume" :: waited 0.026s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:30:21 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[81fde49a-0cc1-4f6e-8be1-5945254e11f2]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:30:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b39f5c2a-a99d-430c-95d5-748fa304f491 tempest-AttachVolumeNegativeTest-1262133860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f663d726-38da-44db-a953-39dc13769fe6 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:22 devstack sudo[102439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f663d726-38da-44db-a953-39dc13769fe6 Nov 03 20:30:22 devstack sudo[102439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:22 devstack sudo[102439]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b39f5c2a-a99d-430c-95d5-748fa304f491 tempest-AttachVolumeNegativeTest-1262133860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f663d726-38da-44db-a953-39dc13769fe6" returned: 0 in 0.517s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b39f5c2a-a99d-430c-95d5-748fa304f491 tempest-AttachVolumeNegativeTest-1262133860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f663d726-38da-44db-a953-39dc13769fe6 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:22 devstack sudo[102455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f663d726-38da-44db-a953-39dc13769fe6 Nov 03 20:30:22 devstack sudo[102455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:22 devstack sudo[102455]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b39f5c2a-a99d-430c-95d5-748fa304f491 tempest-AttachVolumeNegativeTest-1262133860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f663d726-38da-44db-a953-39dc13769fe6" returned: 0 in 0.327s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:22 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b39f5c2a-a99d-430c-95d5-748fa304f491 tempest-AttachVolumeNegativeTest-1262133860 None] Lock "cinder-quobyte-f663d726-38da-44db-a953-39dc13769fe6" released by "delete_volume" :: held 0.911s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:30:22 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-b39f5c2a-a99d-430c-95d5-748fa304f491 tempest-AttachVolumeNegativeTest-1262133860 None] Created reservations ['a13d620c-1a1e-4659-9e13-d3f4cfd57159', '1a4a6bba-00e8-44df-97e9-82bea90de02f', '6b6a7d36-4b8e-46af-8cea-a61dd23722cd', 'bfe18b29-2cc9-4476-8c51-bccf4c77650a'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:30:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b39f5c2a-a99d-430c-95d5-748fa304f491 tempest-AttachVolumeNegativeTest-1262133860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b39f5c2a-a99d-430c-95d5-748fa304f491 tempest-AttachVolumeNegativeTest-1262133860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:23 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-b39f5c2a-a99d-430c-95d5-748fa304f491 tempest-AttachVolumeNegativeTest-1262133860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:30:23 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-b39f5c2a-a99d-430c-95d5-748fa304f491 tempest-AttachVolumeNegativeTest-1262133860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:30:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b39f5c2a-a99d-430c-95d5-748fa304f491 tempest-AttachVolumeNegativeTest-1262133860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b39f5c2a-a99d-430c-95d5-748fa304f491 tempest-AttachVolumeNegativeTest-1262133860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:23 devstack sudo[102466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:30:23 devstack sudo[102466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:23 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-72fc6e90-fab0-4962-ba2f-69b7b6656ca8 tempest-AttachVolumeNegativeTest-1262133860 None] Acquiring lock "cinder-3641d0eb-4eea-4cbd-9fcd-39ffed509e27-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:30:23 devstack sudo[102466]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b39f5c2a-a99d-430c-95d5-748fa304f491 tempest-AttachVolumeNegativeTest-1262133860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.432s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:23 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-b39f5c2a-a99d-430c-95d5-748fa304f491 tempest-AttachVolumeNegativeTest-1262133860 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:30:23 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-72fc6e90-fab0-4962-ba2f-69b7b6656ca8 tempest-AttachVolumeNegativeTest-1262133860 None] Lock "cinder-3641d0eb-4eea-4cbd-9fcd-39ffed509e27-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:30:23 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-b39f5c2a-a99d-430c-95d5-748fa304f491 tempest-AttachVolumeNegativeTest-1262133860 None] Deleted volume successfully. Nov 03 20:30:23 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b39f5c2a-a99d-430c-95d5-748fa304f491 tempest-AttachVolumeNegativeTest-1262133860 None] Lock "cinder-f663d726-38da-44db-a953-39dc13769fe6-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:30:23 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-72fc6e90-fab0-4962-ba2f-69b7b6656ca8 tempest-AttachVolumeNegativeTest-1262133860 None] Acquiring lock "cinder-quobyte-3641d0eb-4eea-4cbd-9fcd-39ffed509e27" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:30:23 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-72fc6e90-fab0-4962-ba2f-69b7b6656ca8 tempest-AttachVolumeNegativeTest-1262133860 None] Lock "cinder-quobyte-3641d0eb-4eea-4cbd-9fcd-39ffed509e27" acquired by "delete_volume" :: waited 0.028s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:30:23 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbac792-6f30-40c4-9112-434ba28d6aff]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:30:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-72fc6e90-fab0-4962-ba2f-69b7b6656ca8 tempest-AttachVolumeNegativeTest-1262133860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3641d0eb-4eea-4cbd-9fcd-39ffed509e27 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:23 devstack sudo[102469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3641d0eb-4eea-4cbd-9fcd-39ffed509e27 Nov 03 20:30:23 devstack sudo[102469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:24 devstack sudo[102469]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-72fc6e90-fab0-4962-ba2f-69b7b6656ca8 tempest-AttachVolumeNegativeTest-1262133860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3641d0eb-4eea-4cbd-9fcd-39ffed509e27" returned: 0 in 0.421s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-72fc6e90-fab0-4962-ba2f-69b7b6656ca8 tempest-AttachVolumeNegativeTest-1262133860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3641d0eb-4eea-4cbd-9fcd-39ffed509e27 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:24 devstack sudo[102475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3641d0eb-4eea-4cbd-9fcd-39ffed509e27 Nov 03 20:30:24 devstack sudo[102475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:24 devstack sudo[102475]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-72fc6e90-fab0-4962-ba2f-69b7b6656ca8 tempest-AttachVolumeNegativeTest-1262133860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3641d0eb-4eea-4cbd-9fcd-39ffed509e27" returned: 0 in 0.286s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:24 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-72fc6e90-fab0-4962-ba2f-69b7b6656ca8 tempest-AttachVolumeNegativeTest-1262133860 None] Lock "cinder-quobyte-3641d0eb-4eea-4cbd-9fcd-39ffed509e27" released by "delete_volume" :: held 0.768s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:30:24 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-72fc6e90-fab0-4962-ba2f-69b7b6656ca8 tempest-AttachVolumeNegativeTest-1262133860 None] Created reservations ['e20cf8fa-11be-44cd-94f6-c7db757a25ee', 'a1e01a19-2ac0-4e95-9536-70756d3bed5f', '131c92dd-9a5f-447c-9b42-3f2922b68966', '8068e959-da1d-4234-8ada-b69a4e018317'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:30:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-72fc6e90-fab0-4962-ba2f-69b7b6656ca8 tempest-AttachVolumeNegativeTest-1262133860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-72fc6e90-fab0-4962-ba2f-69b7b6656ca8 tempest-AttachVolumeNegativeTest-1262133860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:24 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-72fc6e90-fab0-4962-ba2f-69b7b6656ca8 tempest-AttachVolumeNegativeTest-1262133860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:30:24 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-72fc6e90-fab0-4962-ba2f-69b7b6656ca8 tempest-AttachVolumeNegativeTest-1262133860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:30:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-72fc6e90-fab0-4962-ba2f-69b7b6656ca8 tempest-AttachVolumeNegativeTest-1262133860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-72fc6e90-fab0-4962-ba2f-69b7b6656ca8 tempest-AttachVolumeNegativeTest-1262133860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:24 devstack sudo[102479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:30:24 devstack sudo[102479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:24 devstack sudo[102479]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-72fc6e90-fab0-4962-ba2f-69b7b6656ca8 tempest-AttachVolumeNegativeTest-1262133860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.298s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:24 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-72fc6e90-fab0-4962-ba2f-69b7b6656ca8 tempest-AttachVolumeNegativeTest-1262133860 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:30:24 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-72fc6e90-fab0-4962-ba2f-69b7b6656ca8 tempest-AttachVolumeNegativeTest-1262133860 None] Deleted volume successfully. Nov 03 20:30:24 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-72fc6e90-fab0-4962-ba2f-69b7b6656ca8 tempest-AttachVolumeNegativeTest-1262133860 None] Lock "cinder-3641d0eb-4eea-4cbd-9fcd-39ffed509e27-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:30:26 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf24d9f0-acee-4cee-956e-8067821005ef tempest-SnapshotDependencyTests-1699856137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:30:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cf24d9f0-acee-4cee-956e-8067821005ef tempest-SnapshotDependencyTests-1699856137 None] Flow 'volume_create_manager' (f7981fd6-0ba2-4e9b-b4c2-a97f2d8f1dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:30:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cf24d9f0-acee-4cee-956e-8067821005ef tempest-SnapshotDependencyTests-1699856137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cc06875-fa29-49d9-a34c-085ba9b5c873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cf24d9f0-acee-4cee-956e-8067821005ef tempest-SnapshotDependencyTests-1699856137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cc06875-fa29-49d9-a34c-085ba9b5c873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:30:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1390800585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91eaace2-1d1b-4116-be87-e43636296c35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a66380691e34a06bb5d97da5f25c67e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:30:27Z,use_quota=True,user_id='c67cbfbff342492ab52891e971327d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cf24d9f0-acee-4cee-956e-8067821005ef tempest-SnapshotDependencyTests-1699856137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfcfe449-5a48-441f-8d47-12f60c6ff824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cf24d9f0-acee-4cee-956e-8067821005ef tempest-SnapshotDependencyTests-1699856137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfcfe449-5a48-441f-8d47-12f60c6ff824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cf24d9f0-acee-4cee-956e-8067821005ef tempest-SnapshotDependencyTests-1699856137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b4fbcc8-b4db-4264-b701-712acdf1f4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cf24d9f0-acee-4cee-956e-8067821005ef tempest-SnapshotDependencyTests-1699856137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b4fbcc8-b4db-4264-b701-712acdf1f4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91eaace2-1d1b-4116-be87-e43636296c35', 'volume_name': 'volume-91eaace2-1d1b-4116-be87-e43636296c35', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cf24d9f0-acee-4cee-956e-8067821005ef tempest-SnapshotDependencyTests-1699856137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (140043b2-dd89-41d1-b72f-bcaa2b6e594e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cf24d9f0-acee-4cee-956e-8067821005ef tempest-SnapshotDependencyTests-1699856137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (140043b2-dd89-41d1-b72f-bcaa2b6e594e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cf24d9f0-acee-4cee-956e-8067821005ef tempest-SnapshotDependencyTests-1699856137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cae7190-fdcf-476b-9a67-fd39d08665bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:26 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-cf24d9f0-acee-4cee-956e-8067821005ef tempest-SnapshotDependencyTests-1699856137 None] Volume 91eaace2-1d1b-4116-be87-e43636296c35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91eaace2-1d1b-4116-be87-e43636296c35', 'volume_size': 1} Nov 03 20:30:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-cf24d9f0-acee-4cee-956e-8067821005ef tempest-SnapshotDependencyTests-1699856137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-cf24d9f0-acee-4cee-956e-8067821005ef tempest-SnapshotDependencyTests-1699856137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:26 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-cf24d9f0-acee-4cee-956e-8067821005ef tempest-SnapshotDependencyTests-1699856137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:30:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1390800585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91eaace2-1d1b-4116-be87-e43636296c35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a66380691e34a06bb5d97da5f25c67e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:30:27Z,use_quota=True,user_id='c67cbfbff342492ab52891e971327d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:30:26 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-cf24d9f0-acee-4cee-956e-8067821005ef tempest-SnapshotDependencyTests-1699856137 None] Creating volume 91eaace2-1d1b-4116-be87-e43636296c35 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:30:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-cf24d9f0-acee-4cee-956e-8067821005ef tempest-SnapshotDependencyTests-1699856137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-cf24d9f0-acee-4cee-956e-8067821005ef tempest-SnapshotDependencyTests-1699856137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:26 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-cf24d9f0-acee-4cee-956e-8067821005ef tempest-SnapshotDependencyTests-1699856137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:30:26 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-cf24d9f0-acee-4cee-956e-8067821005ef tempest-SnapshotDependencyTests-1699856137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:30:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-cf24d9f0-acee-4cee-956e-8067821005ef tempest-SnapshotDependencyTests-1699856137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:26 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-cf24d9f0-acee-4cee-956e-8067821005ef tempest-SnapshotDependencyTests-1699856137 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:30:26 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-cf24d9f0-acee-4cee-956e-8067821005ef tempest-SnapshotDependencyTests-1699856137 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:30:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cf24d9f0-acee-4cee-956e-8067821005ef tempest-SnapshotDependencyTests-1699856137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:26 devstack sudo[102482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35 1073741824 Nov 03 20:30:26 devstack sudo[102482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:27 devstack sudo[102482]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cf24d9f0-acee-4cee-956e-8067821005ef tempest-SnapshotDependencyTests-1699856137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35 1073741824" returned: 0 in 0.524s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cf24d9f0-acee-4cee-956e-8067821005ef tempest-SnapshotDependencyTests-1699856137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:27 devstack sudo[102490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35 Nov 03 20:30:27 devstack sudo[102490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:27 devstack sudo[102490]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cf24d9f0-acee-4cee-956e-8067821005ef tempest-SnapshotDependencyTests-1699856137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35" returned: 0 in 0.326s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:27 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-cf24d9f0-acee-4cee-956e-8067821005ef tempest-SnapshotDependencyTests-1699856137 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:30:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-cf24d9f0-acee-4cee-956e-8067821005ef tempest-SnapshotDependencyTests-1699856137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:27 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cf24d9f0-acee-4cee-956e-8067821005ef tempest-SnapshotDependencyTests-1699856137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cae7190-fdcf-476b-9a67-fd39d08665bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91eaace2-1d1b-4116-be87-e43636296c35', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:27 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cf24d9f0-acee-4cee-956e-8067821005ef tempest-SnapshotDependencyTests-1699856137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a531d292-9dc2-46d6-b96a-cfe0189ce813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:27 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-cf24d9f0-acee-4cee-956e-8067821005ef tempest-SnapshotDependencyTests-1699856137 None] Volume volume-91eaace2-1d1b-4116-be87-e43636296c35 (91eaace2-1d1b-4116-be87-e43636296c35): created successfully Nov 03 20:30:27 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cf24d9f0-acee-4cee-956e-8067821005ef tempest-SnapshotDependencyTests-1699856137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a531d292-9dc2-46d6-b96a-cfe0189ce813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:27 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cf24d9f0-acee-4cee-956e-8067821005ef tempest-SnapshotDependencyTests-1699856137 None] Flow 'volume_create_manager' (f7981fd6-0ba2-4e9b-b4c2-a97f2d8f1dca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:30:27 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-cf24d9f0-acee-4cee-956e-8067821005ef tempest-SnapshotDependencyTests-1699856137 None] Created volume successfully. Nov 03 20:30:28 devstack cinder-volume[87248]: DEBUG oslo_service.periodic_task [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:30:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:30:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:30:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:28 devstack sudo[102525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:30:28 devstack sudo[102525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:29 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-c4ee0b4b-19f7-4ac0-8e21-74cf37aee46d req-8d6272bc-d21d-4503-917e-5333bc705950 tempest-TestShelveInstance-965880078 None] Terminate volume connection completed successfully. Nov 03 20:30:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-c4ee0b4b-19f7-4ac0-8e21-74cf37aee46d req-8d6272bc-d21d-4503-917e-5333bc705950 tempest-TestShelveInstance-965880078 None] Deleting attachment 0925d34d-2eab-4c38-a8b8-73c5dc35c676. {{(pid=87248) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 20:30:29 devstack sudo[102525]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.500s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:29 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:30:29 devstack cinder-volume[87248]: DEBUG oslo_service.periodic_task [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running periodic task VolumeManager._thread_info {{(pid=87248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:30:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] thread count: 28 {{(pid=87248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:30:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] thread info: [<_MainThread(MainThread, started 124862067372160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:30:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1eab033c-54d8-4f61-8b67-df9c1a54a8b6 tempest-SnapshotDependencyTests-1699856137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1eab033c-54d8-4f61-8b67-df9c1a54a8b6 tempest-SnapshotDependencyTests-1699856137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:29 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-1eab033c-54d8-4f61-8b67-df9c1a54a8b6 tempest-SnapshotDependencyTests-1699856137 None] Creating offline snapshot c559c3b9-39d1-4db1-ae7e-2f79c87488ac of volume 91eaace2-1d1b-4116-be87-e43636296c35 {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:30:29 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[012fc459-8227-4131-8f66-7d4c748067bc]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:30:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1eab033c-54d8-4f61-8b67-df9c1a54a8b6 tempest-SnapshotDependencyTests-1699856137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:29 devstack sudo[102529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35 Nov 03 20:30:29 devstack sudo[102529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:30 devstack sudo[102529]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1eab033c-54d8-4f61-8b67-df9c1a54a8b6 tempest-SnapshotDependencyTests-1699856137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35" returned: 0 in 0.687s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1eab033c-54d8-4f61-8b67-df9c1a54a8b6 tempest-SnapshotDependencyTests-1699856137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35.c559c3b9-39d1-4db1-ae7e-2f79c87488ac 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:30 devstack sudo[102534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35.c559c3b9-39d1-4db1-ae7e-2f79c87488ac 1G Nov 03 20:30:30 devstack sudo[102534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:30 devstack sudo[102534]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1eab033c-54d8-4f61-8b67-df9c1a54a8b6 tempest-SnapshotDependencyTests-1699856137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35.c559c3b9-39d1-4db1-ae7e-2f79c87488ac 1G" returned: 0 in 0.577s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1eab033c-54d8-4f61-8b67-df9c1a54a8b6 tempest-SnapshotDependencyTests-1699856137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91eaace2-1d1b-4116-be87-e43636296c35 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35.c559c3b9-39d1-4db1-ae7e-2f79c87488ac {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:30 devstack sudo[102540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91eaace2-1d1b-4116-be87-e43636296c35 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35.c559c3b9-39d1-4db1-ae7e-2f79c87488ac Nov 03 20:30:30 devstack sudo[102540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:30 devstack sudo[102540]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1eab033c-54d8-4f61-8b67-df9c1a54a8b6 tempest-SnapshotDependencyTests-1699856137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91eaace2-1d1b-4116-be87-e43636296c35 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35.c559c3b9-39d1-4db1-ae7e-2f79c87488ac" returned: 0 in 0.332s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:30 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-1eab033c-54d8-4f61-8b67-df9c1a54a8b6 tempest-SnapshotDependencyTests-1699856137 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35.c559c3b9-39d1-4db1-ae7e-2f79c87488ac is being set with open permissions: ugo+rw Nov 03 20:30:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1eab033c-54d8-4f61-8b67-df9c1a54a8b6 tempest-SnapshotDependencyTests-1699856137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35.c559c3b9-39d1-4db1-ae7e-2f79c87488ac {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:30 devstack sudo[102546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35.c559c3b9-39d1-4db1-ae7e-2f79c87488ac Nov 03 20:30:30 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:31 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1eab033c-54d8-4f61-8b67-df9c1a54a8b6 tempest-SnapshotDependencyTests-1699856137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35.c559c3b9-39d1-4db1-ae7e-2f79c87488ac" returned: 0 in 0.499s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1eab033c-54d8-4f61-8b67-df9c1a54a8b6 tempest-SnapshotDependencyTests-1699856137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:31 devstack sudo[102552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35.info Nov 03 20:30:31 devstack sudo[102552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:31 devstack sudo[102552]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1eab033c-54d8-4f61-8b67-df9c1a54a8b6 tempest-SnapshotDependencyTests-1699856137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35.info" returned: 0 in 0.358s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:31 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-1eab033c-54d8-4f61-8b67-df9c1a54a8b6 tempest-SnapshotDependencyTests-1699856137 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35.info is being set with open permissions: ugo+rw Nov 03 20:30:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1eab033c-54d8-4f61-8b67-df9c1a54a8b6 tempest-SnapshotDependencyTests-1699856137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:31 devstack sudo[102555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35.info Nov 03 20:30:31 devstack sudo[102555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:32 devstack sudo[102555]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1eab033c-54d8-4f61-8b67-df9c1a54a8b6 tempest-SnapshotDependencyTests-1699856137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35.info" returned: 0 in 0.507s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1eab033c-54d8-4f61-8b67-df9c1a54a8b6 tempest-SnapshotDependencyTests-1699856137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.143s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:32 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-1eab033c-54d8-4f61-8b67-df9c1a54a8b6 tempest-SnapshotDependencyTests-1699856137 None] Create snapshot completed successfully Nov 03 20:30:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-4f8d2eab-473e-43ec-8777-3ba6ff2b9ff4 req-4affad1b-6b67-48ae-8600-11f81670d92c tempest-TestShelveInstance-965880078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-4f8d2eab-473e-43ec-8777-3ba6ff2b9ff4 req-4affad1b-6b67-48ae-8600-11f81670d92c tempest-TestShelveInstance-965880078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-4f8d2eab-473e-43ec-8777-3ba6ff2b9ff4 req-4affad1b-6b67-48ae-8600-11f81670d92c tempest-TestShelveInstance-965880078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:33 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-4f8d2eab-473e-43ec-8777-3ba6ff2b9ff4 req-4affad1b-6b67-48ae-8600-11f81670d92c tempest-TestShelveInstance-965880078 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8', 'name': 'volume-e66183fe-35e0-4de3-ac30-d3c443b74bde', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '66476043-ba14-4c25-8b0f-4b6922b0ec6b', 'enforce_multipath': True} {{(pid=87248) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 20:30:33 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-4f8d2eab-473e-43ec-8777-3ba6ff2b9ff4 req-4affad1b-6b67-48ae-8600-11f81670d92c tempest-TestShelveInstance-965880078 None] attachment_update completed successfully. Nov 03 20:30:34 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:30:34 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] Flow 'volume_create_manager' (9598c810-df57-4bb6-b4da-d13eb5b6e47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:30:34 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e560897e-70de-487c-8863-bf82e7a49472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:34 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e560897e-70de-487c-8863-bf82e7a49472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=969f1951-447d-4cfd-a4f8-cb473bb3645c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a66380691e34a06bb5d97da5f25c67e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:30:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c559c3b9-39d1-4db1-ae7e-2f79c87488ac,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:30:35Z,use_quota=True,user_id='c67cbfbff342492ab52891e971327d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:34 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63857019-c1d3-4f3b-9187-70f8284aa1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:34 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63857019-c1d3-4f3b-9187-70f8284aa1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:34 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb146a29-5d18-42b5-9409-34fc4732d5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:34 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb146a29-5d18-42b5-9409-34fc4732d5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '969f1951-447d-4cfd-a4f8-cb473bb3645c', 'volume_name': 'volume-969f1951-447d-4cfd-a4f8-cb473bb3645c', 'volume_size': 1, 'snapshot_id': 'c559c3b9-39d1-4db1-ae7e-2f79c87488ac'}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:34 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (534fa2bd-cbce-4271-b4c0-19d6af6396c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:34 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (534fa2bd-cbce-4271-b4c0-19d6af6396c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:34 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf6eca40-d54b-43d1-a651-4e5cbc5645d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:34 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] Volume 969f1951-447d-4cfd-a4f8-cb473bb3645c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-969f1951-447d-4cfd-a4f8-cb473bb3645c', 'volume_size': 1, 'snapshot_id': 'c559c3b9-39d1-4db1-ae7e-2f79c87488ac'} Nov 03 20:30:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:34 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] Acquiring lock "cinder-quobyte-c559c3b9-39d1-4db1-ae7e-2f79c87488ac-969f1951-447d-4cfd-a4f8-cb473bb3645c" by "_create_volume_from_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:30:34 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] Lock "cinder-quobyte-c559c3b9-39d1-4db1-ae7e-2f79c87488ac-969f1951-447d-4cfd-a4f8-cb473bb3645c" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:30:34 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] Creating volume 969f1951-447d-4cfd-a4f8-cb473bb3645c from snapshot c559c3b9-39d1-4db1-ae7e-2f79c87488ac {{(pid=87248) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 20:30:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:34 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:30:34 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:30:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:34 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:30:34 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] Acquiring lock "cinder-quobyte-969f1951-447d-4cfd-a4f8-cb473bb3645c" by "_copy_volume_from_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:30:34 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] Lock "cinder-quobyte-969f1951-447d-4cfd-a4f8-cb473bb3645c" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:30:34 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] snapshot: c559c3b9-39d1-4db1-ae7e-2f79c87488ac, volume: 969f1951-447d-4cfd-a4f8-cb473bb3645c, {{(pid=87248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 20:30:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:34 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:30:34 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:30:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:34 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5502a10-3366-4e80-a566-19c703a2c311]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:30:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35.c559c3b9-39d1-4db1-ae7e-2f79c87488ac {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:35 devstack sudo[102570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35.c559c3b9-39d1-4db1-ae7e-2f79c87488ac Nov 03 20:30:35 devstack sudo[102570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35.c559c3b9-39d1-4db1-ae7e-2f79c87488ac" returned: 0 in 0.667s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:35 devstack sudo[102570]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:35 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91eaace2-1d1b-4116-be87-e43636296c35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:30:35 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1b6e4e-27c5-467a-9dc1-3089c6f2598b]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:30:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:35 devstack sudo[102575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35 Nov 03 20:30:35 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:36 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35" returned: 0 in 0.426s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:36 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35 {{(pid=87248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 20:30:36 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] Creating direct copy from snapshot {{(pid=87248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 20:30:36 devstack cinder-volume[87248]: DEBUG cinder.utils [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] Path /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-969f1951-447d-4cfd-a4f8-cb473bb3645c not found in is_blk_device check {{(pid=87248) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 20:30:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-969f1951-447d-4cfd-a4f8-cb473bb3645c {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:36 devstack sudo[102581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-969f1951-447d-4cfd-a4f8-cb473bb3645c Nov 03 20:30:36 devstack sudo[102581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:37 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [req-fa62f9df-e444-4270-82e8-a2020acfd970 req-de638f24-d16b-4747-8c23-4203edd03d86 tempest-VolumesGetTestJSON-746255241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:30:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-fa62f9df-e444-4270-82e8-a2020acfd970 req-de638f24-d16b-4747-8c23-4203edd03d86 tempest-VolumesGetTestJSON-746255241 None] Flow 'volume_create_manager' (9e2c42e2-37a3-4fdc-89e3-a737f3417aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:30:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-fa62f9df-e444-4270-82e8-a2020acfd970 req-de638f24-d16b-4747-8c23-4203edd03d86 tempest-VolumesGetTestJSON-746255241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b47bb941-ef11-4225-b2ac-9622b1cb53e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-fa62f9df-e444-4270-82e8-a2020acfd970 req-de638f24-d16b-4747-8c23-4203edd03d86 tempest-VolumesGetTestJSON-746255241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b47bb941-ef11-4225-b2ac-9622b1cb53e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-254593848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e52498d3-f45e-4230-ba22-962bed7675d4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='942109df5ead4848964bd3a5b1273d38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:30:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:30:37Z,use_quota=True,user_id='0750741f25954539aff766d02b7b406e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-fa62f9df-e444-4270-82e8-a2020acfd970 req-de638f24-d16b-4747-8c23-4203edd03d86 tempest-VolumesGetTestJSON-746255241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7cb6ba7-faf1-40a9-ac6b-8625a174061d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-fa62f9df-e444-4270-82e8-a2020acfd970 req-de638f24-d16b-4747-8c23-4203edd03d86 tempest-VolumesGetTestJSON-746255241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7cb6ba7-faf1-40a9-ac6b-8625a174061d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-fa62f9df-e444-4270-82e8-a2020acfd970 req-de638f24-d16b-4747-8c23-4203edd03d86 tempest-VolumesGetTestJSON-746255241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5d67d10-79b8-4596-85af-89d4ab593a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-fa62f9df-e444-4270-82e8-a2020acfd970 req-de638f24-d16b-4747-8c23-4203edd03d86 tempest-VolumesGetTestJSON-746255241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5d67d10-79b8-4596-85af-89d4ab593a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e52498d3-f45e-4230-ba22-962bed7675d4', 'volume_name': 'volume-e52498d3-f45e-4230-ba22-962bed7675d4', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-fa62f9df-e444-4270-82e8-a2020acfd970 req-de638f24-d16b-4747-8c23-4203edd03d86 tempest-VolumesGetTestJSON-746255241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e2203df-42e5-44de-9473-2418cc6bfe03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-fa62f9df-e444-4270-82e8-a2020acfd970 req-de638f24-d16b-4747-8c23-4203edd03d86 tempest-VolumesGetTestJSON-746255241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e2203df-42e5-44de-9473-2418cc6bfe03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-fa62f9df-e444-4270-82e8-a2020acfd970 req-de638f24-d16b-4747-8c23-4203edd03d86 tempest-VolumesGetTestJSON-746255241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (864bc4b4-6360-46aa-ad36-654696ca8ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:37 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [req-fa62f9df-e444-4270-82e8-a2020acfd970 req-de638f24-d16b-4747-8c23-4203edd03d86 tempest-VolumesGetTestJSON-746255241 None] Volume e52498d3-f45e-4230-ba22-962bed7675d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e52498d3-f45e-4230-ba22-962bed7675d4', 'volume_size': 1} Nov 03 20:30:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-fa62f9df-e444-4270-82e8-a2020acfd970 req-de638f24-d16b-4747-8c23-4203edd03d86 tempest-VolumesGetTestJSON-746255241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:47 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:UPDATE=50,cinder:SELECT=55,cinder:INSERT=9,cinder:DELETE=1 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:30:47 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:SELECT=44,cinder:INSERT=7,cinder:UPDATE=31,cinder:DELETE=6 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:30:47 devstack sudo[102581]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-969f1951-447d-4cfd-a4f8-cb473bb3645c" returned: 0 in 11.172s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:47 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] Image conversion details: src /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35, size 1024.00 MB, duration 11.17 sec, destination /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-969f1951-447d-4cfd-a4f8-cb473bb3645c {{(pid=87248) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:30:47 devstack cinder-volume[87248]: INFO cinder.image.image_utils [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] Converted 1024.00 MB image at 91.65 MB/s Nov 03 20:30:47 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-969f1951-447d-4cfd-a4f8-cb473bb3645c is being set with open permissions: ugo+rw Nov 03 20:30:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-969f1951-447d-4cfd-a4f8-cb473bb3645c {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:47 devstack sudo[102693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-969f1951-447d-4cfd-a4f8-cb473bb3645c Nov 03 20:30:47 devstack sudo[102693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:47 devstack sudo[102693]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-969f1951-447d-4cfd-a4f8-cb473bb3645c" returned: 0 in 0.278s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:47 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] Lock "cinder-quobyte-969f1951-447d-4cfd-a4f8-cb473bb3645c" released by "_copy_volume_from_snapshot" :: held 12.668s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:30:47 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] Lock "cinder-quobyte-c559c3b9-39d1-4db1-ae7e-2f79c87488ac-969f1951-447d-4cfd-a4f8-cb473bb3645c" released by "_create_volume_from_snapshot" :: held 12.766s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:30:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.795s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-fa62f9df-e444-4270-82e8-a2020acfd970 req-de638f24-d16b-4747-8c23-4203edd03d86 tempest-VolumesGetTestJSON-746255241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.182s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:47 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [req-fa62f9df-e444-4270-82e8-a2020acfd970 req-de638f24-d16b-4747-8c23-4203edd03d86 tempest-VolumesGetTestJSON-746255241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-254593848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e52498d3-f45e-4230-ba22-962bed7675d4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='942109df5ead4848964bd3a5b1273d38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:30:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:30:37Z,use_quota=True,user_id='0750741f25954539aff766d02b7b406e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:30:47 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [req-fa62f9df-e444-4270-82e8-a2020acfd970 req-de638f24-d16b-4747-8c23-4203edd03d86 tempest-VolumesGetTestJSON-746255241 None] Creating volume e52498d3-f45e-4230-ba22-962bed7675d4 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:30:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-fa62f9df-e444-4270-82e8-a2020acfd970 req-de638f24-d16b-4747-8c23-4203edd03d86 tempest-VolumesGetTestJSON-746255241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-fa62f9df-e444-4270-82e8-a2020acfd970 req-de638f24-d16b-4747-8c23-4203edd03d86 tempest-VolumesGetTestJSON-746255241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:47 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [req-fa62f9df-e444-4270-82e8-a2020acfd970 req-de638f24-d16b-4747-8c23-4203edd03d86 tempest-VolumesGetTestJSON-746255241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:30:47 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [req-fa62f9df-e444-4270-82e8-a2020acfd970 req-de638f24-d16b-4747-8c23-4203edd03d86 tempest-VolumesGetTestJSON-746255241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:30:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-fa62f9df-e444-4270-82e8-a2020acfd970 req-de638f24-d16b-4747-8c23-4203edd03d86 tempest-VolumesGetTestJSON-746255241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:47 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [req-fa62f9df-e444-4270-82e8-a2020acfd970 req-de638f24-d16b-4747-8c23-4203edd03d86 tempest-VolumesGetTestJSON-746255241 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:30:47 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [req-fa62f9df-e444-4270-82e8-a2020acfd970 req-de638f24-d16b-4747-8c23-4203edd03d86 tempest-VolumesGetTestJSON-746255241 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:30:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-fa62f9df-e444-4270-82e8-a2020acfd970 req-de638f24-d16b-4747-8c23-4203edd03d86 tempest-VolumesGetTestJSON-746255241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e52498d3-f45e-4230-ba22-962bed7675d4 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:47 devstack sudo[102696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e52498d3-f45e-4230-ba22-962bed7675d4 1073741824 Nov 03 20:30:47 devstack sudo[102696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:47 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf6eca40-d54b-43d1-a651-4e5cbc5645d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-969f1951-447d-4cfd-a4f8-cb473bb3645c', 'volume_size': 1, 'snapshot_id': 'c559c3b9-39d1-4db1-ae7e-2f79c87488ac'}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:47 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (109d0c09-f7bc-4dee-ac04-14804de91d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:47 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] Volume volume-969f1951-447d-4cfd-a4f8-cb473bb3645c (969f1951-447d-4cfd-a4f8-cb473bb3645c): created successfully Nov 03 20:30:47 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (109d0c09-f7bc-4dee-ac04-14804de91d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:47 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] Flow 'volume_create_manager' (9598c810-df57-4bb6-b4da-d13eb5b6e47f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:30:47 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-b5559da6-7e46-45a0-a457-5ab8f77dd6eb tempest-SnapshotDependencyTests-1699856137 None] Created volume successfully. Nov 03 20:30:48 devstack sudo[102696]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-fa62f9df-e444-4270-82e8-a2020acfd970 req-de638f24-d16b-4747-8c23-4203edd03d86 tempest-VolumesGetTestJSON-746255241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e52498d3-f45e-4230-ba22-962bed7675d4 1073741824" returned: 0 in 0.504s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-fa62f9df-e444-4270-82e8-a2020acfd970 req-de638f24-d16b-4747-8c23-4203edd03d86 tempest-VolumesGetTestJSON-746255241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e52498d3-f45e-4230-ba22-962bed7675d4 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:48 devstack sudo[102703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e52498d3-f45e-4230-ba22-962bed7675d4 Nov 03 20:30:48 devstack sudo[102703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:48 devstack sudo[102703]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-fa62f9df-e444-4270-82e8-a2020acfd970 req-de638f24-d16b-4747-8c23-4203edd03d86 tempest-VolumesGetTestJSON-746255241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e52498d3-f45e-4230-ba22-962bed7675d4" returned: 0 in 0.309s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:48 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [req-fa62f9df-e444-4270-82e8-a2020acfd970 req-de638f24-d16b-4747-8c23-4203edd03d86 tempest-VolumesGetTestJSON-746255241 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:30:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-fa62f9df-e444-4270-82e8-a2020acfd970 req-de638f24-d16b-4747-8c23-4203edd03d86 tempest-VolumesGetTestJSON-746255241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:48 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-fa62f9df-e444-4270-82e8-a2020acfd970 req-de638f24-d16b-4747-8c23-4203edd03d86 tempest-VolumesGetTestJSON-746255241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (864bc4b4-6360-46aa-ad36-654696ca8ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e52498d3-f45e-4230-ba22-962bed7675d4', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:48 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-fa62f9df-e444-4270-82e8-a2020acfd970 req-de638f24-d16b-4747-8c23-4203edd03d86 tempest-VolumesGetTestJSON-746255241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4fa08dc-52a6-45bf-a63e-38a7945b6646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:30:48 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e8de3586-b7c5-4498-abbc-a004a84b6afa tempest-SnapshotDependencyTests-1699856137 None] Acquiring lock "cinder-c559c3b9-39d1-4db1-ae7e-2f79c87488ac-delete_snapshot" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:30:48 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [req-fa62f9df-e444-4270-82e8-a2020acfd970 req-de638f24-d16b-4747-8c23-4203edd03d86 tempest-VolumesGetTestJSON-746255241 None] Volume volume-e52498d3-f45e-4230-ba22-962bed7675d4 (e52498d3-f45e-4230-ba22-962bed7675d4): created successfully Nov 03 20:30:48 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-fa62f9df-e444-4270-82e8-a2020acfd970 req-de638f24-d16b-4747-8c23-4203edd03d86 tempest-VolumesGetTestJSON-746255241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4fa08dc-52a6-45bf-a63e-38a7945b6646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:30:48 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-fa62f9df-e444-4270-82e8-a2020acfd970 req-de638f24-d16b-4747-8c23-4203edd03d86 tempest-VolumesGetTestJSON-746255241 None] Flow 'volume_create_manager' (9e2c42e2-37a3-4fdc-89e3-a737f3417aa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:30:48 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e8de3586-b7c5-4498-abbc-a004a84b6afa tempest-SnapshotDependencyTests-1699856137 None] Lock "cinder-c559c3b9-39d1-4db1-ae7e-2f79c87488ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.098s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:30:48 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e8de3586-b7c5-4498-abbc-a004a84b6afa tempest-SnapshotDependencyTests-1699856137 None] Acquiring lock "cinder-quobyte-91eaace2-1d1b-4116-be87-e43636296c35" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:30:48 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-fa62f9df-e444-4270-82e8-a2020acfd970 req-de638f24-d16b-4747-8c23-4203edd03d86 tempest-VolumesGetTestJSON-746255241 None] Created volume successfully. Nov 03 20:30:48 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e8de3586-b7c5-4498-abbc-a004a84b6afa tempest-SnapshotDependencyTests-1699856137 None] Lock "cinder-quobyte-91eaace2-1d1b-4116-be87-e43636296c35" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:30:48 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e8de3586-b7c5-4498-abbc-a004a84b6afa tempest-SnapshotDependencyTests-1699856137 None] Acquiring lock "cinder-quobyte-c559c3b9-39d1-4db1-ae7e-2f79c87488ac" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:30:48 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e8de3586-b7c5-4498-abbc-a004a84b6afa tempest-SnapshotDependencyTests-1699856137 None] Lock "cinder-quobyte-c559c3b9-39d1-4db1-ae7e-2f79c87488ac" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:30:48 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-e8de3586-b7c5-4498-abbc-a004a84b6afa tempest-SnapshotDependencyTests-1699856137 None] Deleting offline snapshot c559c3b9-39d1-4db1-ae7e-2f79c87488ac of volume 91eaace2-1d1b-4116-be87-e43636296c35 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:30:48 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-e8de3586-b7c5-4498-abbc-a004a84b6afa tempest-SnapshotDependencyTests-1699856137 None] snapshot_file for this snap is: volume-91eaace2-1d1b-4116-be87-e43636296c35.c559c3b9-39d1-4db1-ae7e-2f79c87488ac {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:30:48 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3219a55-0023-4996-bb1d-68ea0656aea1]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:30:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e8de3586-b7c5-4498-abbc-a004a84b6afa tempest-SnapshotDependencyTests-1699856137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35.c559c3b9-39d1-4db1-ae7e-2f79c87488ac {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:48 devstack sudo[102706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35.c559c3b9-39d1-4db1-ae7e-2f79c87488ac Nov 03 20:30:48 devstack sudo[102706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:48 devstack sudo[102706]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e8de3586-b7c5-4498-abbc-a004a84b6afa tempest-SnapshotDependencyTests-1699856137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35.c559c3b9-39d1-4db1-ae7e-2f79c87488ac" returned: 0 in 0.371s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:49 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-e8de3586-b7c5-4498-abbc-a004a84b6afa tempest-SnapshotDependencyTests-1699856137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91eaace2-1d1b-4116-be87-e43636296c35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:30:49 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed7ee86-d8da-4b84-923c-70574287c3f6]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:30:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e8de3586-b7c5-4498-abbc-a004a84b6afa tempest-SnapshotDependencyTests-1699856137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:49 devstack sudo[102711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35 Nov 03 20:30:49 devstack sudo[102711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:49 devstack sudo[102711]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e8de3586-b7c5-4498-abbc-a004a84b6afa tempest-SnapshotDependencyTests-1699856137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35" returned: 0 in 0.582s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e8de3586-b7c5-4498-abbc-a004a84b6afa tempest-SnapshotDependencyTests-1699856137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35.c559c3b9-39d1-4db1-ae7e-2f79c87488ac {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:49 devstack sudo[102716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35.c559c3b9-39d1-4db1-ae7e-2f79c87488ac Nov 03 20:30:49 devstack sudo[102716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:49 devstack cinder-volume[87248]: DEBUG cinder.coordination [req-b828aa77-cc9b-4b47-929a-b9740f994f56 req-2b56b3ad-4c55-4a9c-872a-040b9ac1feab tempest-VolumesGetTestJSON-746255241 None] Acquiring lock "cinder-e52498d3-f45e-4230-ba22-962bed7675d4-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:30:49 devstack cinder-volume[87248]: DEBUG cinder.coordination [req-b828aa77-cc9b-4b47-929a-b9740f994f56 req-2b56b3ad-4c55-4a9c-872a-040b9ac1feab tempest-VolumesGetTestJSON-746255241 None] Lock "cinder-e52498d3-f45e-4230-ba22-962bed7675d4-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:30:49 devstack cinder-volume[87248]: DEBUG cinder.coordination [req-b828aa77-cc9b-4b47-929a-b9740f994f56 req-2b56b3ad-4c55-4a9c-872a-040b9ac1feab tempest-VolumesGetTestJSON-746255241 None] Acquiring lock "cinder-quobyte-e52498d3-f45e-4230-ba22-962bed7675d4" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:30:49 devstack cinder-volume[87248]: DEBUG cinder.coordination [req-b828aa77-cc9b-4b47-929a-b9740f994f56 req-2b56b3ad-4c55-4a9c-872a-040b9ac1feab tempest-VolumesGetTestJSON-746255241 None] Lock "cinder-quobyte-e52498d3-f45e-4230-ba22-962bed7675d4" acquired by "delete_volume" :: waited 0.018s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:30:49 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[67265eac-795c-40bb-97ad-8a9f095b0e83]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:30:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-b828aa77-cc9b-4b47-929a-b9740f994f56 req-2b56b3ad-4c55-4a9c-872a-040b9ac1feab tempest-VolumesGetTestJSON-746255241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e52498d3-f45e-4230-ba22-962bed7675d4 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:50 devstack sudo[102716]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e8de3586-b7c5-4498-abbc-a004a84b6afa tempest-SnapshotDependencyTests-1699856137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35.c559c3b9-39d1-4db1-ae7e-2f79c87488ac" returned: 0 in 0.437s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e8de3586-b7c5-4498-abbc-a004a84b6afa tempest-SnapshotDependencyTests-1699856137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35.c559c3b9-39d1-4db1-ae7e-2f79c87488ac {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:50 devstack sudo[102721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e52498d3-f45e-4230-ba22-962bed7675d4 Nov 03 20:30:50 devstack sudo[102721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:50 devstack sudo[102723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35.c559c3b9-39d1-4db1-ae7e-2f79c87488ac Nov 03 20:30:50 devstack sudo[102723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:50 devstack sudo[102721]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-b828aa77-cc9b-4b47-929a-b9740f994f56 req-2b56b3ad-4c55-4a9c-872a-040b9ac1feab tempest-VolumesGetTestJSON-746255241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e52498d3-f45e-4230-ba22-962bed7675d4" returned: 0 in 0.417s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-b828aa77-cc9b-4b47-929a-b9740f994f56 req-2b56b3ad-4c55-4a9c-872a-040b9ac1feab tempest-VolumesGetTestJSON-746255241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e52498d3-f45e-4230-ba22-962bed7675d4 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:50 devstack sudo[102730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e52498d3-f45e-4230-ba22-962bed7675d4 Nov 03 20:30:50 devstack sudo[102730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:50 devstack sudo[102723]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e8de3586-b7c5-4498-abbc-a004a84b6afa tempest-SnapshotDependencyTests-1699856137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35.c559c3b9-39d1-4db1-ae7e-2f79c87488ac" returned: 0 in 0.378s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:50 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e8de3586-b7c5-4498-abbc-a004a84b6afa tempest-SnapshotDependencyTests-1699856137 None] Lock "cinder-quobyte-c559c3b9-39d1-4db1-ae7e-2f79c87488ac" released by "_delete_snapshot" :: held 1.879s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:30:50 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e8de3586-b7c5-4498-abbc-a004a84b6afa tempest-SnapshotDependencyTests-1699856137 None] Lock "cinder-quobyte-91eaace2-1d1b-4116-be87-e43636296c35" released by "delete_snapshot" :: held 1.906s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:30:50 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-e8de3586-b7c5-4498-abbc-a004a84b6afa tempest-SnapshotDependencyTests-1699856137 None] Created reservations ['2db5bd16-635e-4359-b78d-86f3cbca2566', '189732e7-9e29-41a6-b850-5c1adc7ca9c9', 'b9f9bd06-bfc4-4c18-ba1f-2635ca035a72', '6ab29f57-92b5-4b9f-a93d-f404c9734e5a'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:30:50 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-e8de3586-b7c5-4498-abbc-a004a84b6afa tempest-SnapshotDependencyTests-1699856137 None] Delete snapshot completed successfully. Nov 03 20:30:50 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e8de3586-b7c5-4498-abbc-a004a84b6afa tempest-SnapshotDependencyTests-1699856137 None] Lock "cinder-c559c3b9-39d1-4db1-ae7e-2f79c87488ac-delete_snapshot" released by "delete_snapshot" :: held 2.157s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:30:50 devstack sudo[102730]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-b828aa77-cc9b-4b47-929a-b9740f994f56 req-2b56b3ad-4c55-4a9c-872a-040b9ac1feab tempest-VolumesGetTestJSON-746255241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e52498d3-f45e-4230-ba22-962bed7675d4" returned: 0 in 0.337s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:50 devstack cinder-volume[87248]: DEBUG cinder.coordination [req-b828aa77-cc9b-4b47-929a-b9740f994f56 req-2b56b3ad-4c55-4a9c-872a-040b9ac1feab tempest-VolumesGetTestJSON-746255241 None] Lock "cinder-quobyte-e52498d3-f45e-4230-ba22-962bed7675d4" released by "delete_volume" :: held 0.808s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:30:50 devstack cinder-volume[87248]: DEBUG cinder.quota [req-b828aa77-cc9b-4b47-929a-b9740f994f56 req-2b56b3ad-4c55-4a9c-872a-040b9ac1feab tempest-VolumesGetTestJSON-746255241 None] Created reservations ['53b244ee-71fc-43c3-94e4-ac2fdd48af61', '3c31a560-64b8-46d6-9103-7157d40ef269', '3e6c1a71-7688-4492-88d7-6e9683847c0c', '56f07dfa-d0bb-4267-a57a-b2522fe23a8a'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:30:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-b828aa77-cc9b-4b47-929a-b9740f994f56 req-2b56b3ad-4c55-4a9c-872a-040b9ac1feab tempest-VolumesGetTestJSON-746255241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-b828aa77-cc9b-4b47-929a-b9740f994f56 req-2b56b3ad-4c55-4a9c-872a-040b9ac1feab tempest-VolumesGetTestJSON-746255241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:50 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [req-b828aa77-cc9b-4b47-929a-b9740f994f56 req-2b56b3ad-4c55-4a9c-872a-040b9ac1feab tempest-VolumesGetTestJSON-746255241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:30:50 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [req-b828aa77-cc9b-4b47-929a-b9740f994f56 req-2b56b3ad-4c55-4a9c-872a-040b9ac1feab tempest-VolumesGetTestJSON-746255241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:30:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-b828aa77-cc9b-4b47-929a-b9740f994f56 req-2b56b3ad-4c55-4a9c-872a-040b9ac1feab tempest-VolumesGetTestJSON-746255241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-b828aa77-cc9b-4b47-929a-b9740f994f56 req-2b56b3ad-4c55-4a9c-872a-040b9ac1feab tempest-VolumesGetTestJSON-746255241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:50 devstack sudo[102733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:30:50 devstack sudo[102733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:51 devstack sudo[102733]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-b828aa77-cc9b-4b47-929a-b9740f994f56 req-2b56b3ad-4c55-4a9c-872a-040b9ac1feab tempest-VolumesGetTestJSON-746255241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.264s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:51 devstack cinder-volume[87248]: DEBUG cinder.manager [req-b828aa77-cc9b-4b47-929a-b9740f994f56 req-2b56b3ad-4c55-4a9c-872a-040b9ac1feab tempest-VolumesGetTestJSON-746255241 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:30:51 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-b828aa77-cc9b-4b47-929a-b9740f994f56 req-2b56b3ad-4c55-4a9c-872a-040b9ac1feab tempest-VolumesGetTestJSON-746255241 None] Deleted volume successfully. Nov 03 20:30:51 devstack cinder-volume[87248]: DEBUG cinder.coordination [req-b828aa77-cc9b-4b47-929a-b9740f994f56 req-2b56b3ad-4c55-4a9c-872a-040b9ac1feab tempest-VolumesGetTestJSON-746255241 None] Lock "cinder-e52498d3-f45e-4230-ba22-962bed7675d4-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:30:51 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6d029a03-a729-4d15-bca2-9c66ae4ebddc tempest-SnapshotDependencyTests-1699856137 None] Acquiring lock "cinder-91eaace2-1d1b-4116-be87-e43636296c35-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:30:51 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6d029a03-a729-4d15-bca2-9c66ae4ebddc tempest-SnapshotDependencyTests-1699856137 None] Lock "cinder-91eaace2-1d1b-4116-be87-e43636296c35-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:30:51 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6d029a03-a729-4d15-bca2-9c66ae4ebddc tempest-SnapshotDependencyTests-1699856137 None] Acquiring lock "cinder-quobyte-91eaace2-1d1b-4116-be87-e43636296c35" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:30:51 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6d029a03-a729-4d15-bca2-9c66ae4ebddc tempest-SnapshotDependencyTests-1699856137 None] Lock "cinder-quobyte-91eaace2-1d1b-4116-be87-e43636296c35" acquired by "delete_volume" :: waited 0.033s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:30:51 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d67c982-07a8-40fb-a9ee-2cb0505665fc]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:30:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6d029a03-a729-4d15-bca2-9c66ae4ebddc tempest-SnapshotDependencyTests-1699856137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:52 devstack sudo[102736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35 Nov 03 20:30:52 devstack sudo[102736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:52 devstack sudo[102736]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6d029a03-a729-4d15-bca2-9c66ae4ebddc tempest-SnapshotDependencyTests-1699856137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35" returned: 0 in 0.587s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6d029a03-a729-4d15-bca2-9c66ae4ebddc tempest-SnapshotDependencyTests-1699856137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:52 devstack sudo[102742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35 Nov 03 20:30:52 devstack sudo[102742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:52 devstack sudo[102742]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6d029a03-a729-4d15-bca2-9c66ae4ebddc tempest-SnapshotDependencyTests-1699856137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-91eaace2-1d1b-4116-be87-e43636296c35" returned: 0 in 0.374s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:52 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6d029a03-a729-4d15-bca2-9c66ae4ebddc tempest-SnapshotDependencyTests-1699856137 None] Lock "cinder-quobyte-91eaace2-1d1b-4116-be87-e43636296c35" released by "delete_volume" :: held 1.075s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:30:53 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-6d029a03-a729-4d15-bca2-9c66ae4ebddc tempest-SnapshotDependencyTests-1699856137 None] Created reservations ['d814ef87-1dee-413f-aab3-e73852086796', 'bd5bb03e-ca8c-4487-abf3-97749065cf39', 'fdbf3a2c-0046-4bb2-9f87-32ee66438a1b', '8c77488c-e66c-4d6c-b162-63e4f8058702'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:30:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6d029a03-a729-4d15-bca2-9c66ae4ebddc tempest-SnapshotDependencyTests-1699856137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6d029a03-a729-4d15-bca2-9c66ae4ebddc tempest-SnapshotDependencyTests-1699856137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:53 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-6d029a03-a729-4d15-bca2-9c66ae4ebddc tempest-SnapshotDependencyTests-1699856137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:30:53 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-6d029a03-a729-4d15-bca2-9c66ae4ebddc tempest-SnapshotDependencyTests-1699856137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:30:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6d029a03-a729-4d15-bca2-9c66ae4ebddc tempest-SnapshotDependencyTests-1699856137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6d029a03-a729-4d15-bca2-9c66ae4ebddc tempest-SnapshotDependencyTests-1699856137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:53 devstack sudo[102745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:30:53 devstack sudo[102745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:53 devstack sudo[102745]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6d029a03-a729-4d15-bca2-9c66ae4ebddc tempest-SnapshotDependencyTests-1699856137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.321s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:53 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-6d029a03-a729-4d15-bca2-9c66ae4ebddc tempest-SnapshotDependencyTests-1699856137 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:30:53 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-6d029a03-a729-4d15-bca2-9c66ae4ebddc tempest-SnapshotDependencyTests-1699856137 None] Deleted volume successfully. Nov 03 20:30:53 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6d029a03-a729-4d15-bca2-9c66ae4ebddc tempest-SnapshotDependencyTests-1699856137 None] Lock "cinder-91eaace2-1d1b-4116-be87-e43636296c35-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:30:54 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1e726384-8a37-4946-921d-fea61d3f154c tempest-SnapshotDependencyTests-1699856137 None] Acquiring lock "cinder-969f1951-447d-4cfd-a4f8-cb473bb3645c-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:30:54 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1e726384-8a37-4946-921d-fea61d3f154c tempest-SnapshotDependencyTests-1699856137 None] Lock "cinder-969f1951-447d-4cfd-a4f8-cb473bb3645c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:30:54 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1e726384-8a37-4946-921d-fea61d3f154c tempest-SnapshotDependencyTests-1699856137 None] Acquiring lock "cinder-quobyte-969f1951-447d-4cfd-a4f8-cb473bb3645c" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:30:54 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1e726384-8a37-4946-921d-fea61d3f154c tempest-SnapshotDependencyTests-1699856137 None] Lock "cinder-quobyte-969f1951-447d-4cfd-a4f8-cb473bb3645c" acquired by "delete_volume" :: waited 0.021s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:30:54 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ebf1ba-2410-45a3-aef2-0445e7d70f7b]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:30:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1e726384-8a37-4946-921d-fea61d3f154c tempest-SnapshotDependencyTests-1699856137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-969f1951-447d-4cfd-a4f8-cb473bb3645c {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:54 devstack sudo[102748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-969f1951-447d-4cfd-a4f8-cb473bb3645c Nov 03 20:30:54 devstack sudo[102748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:54 devstack sudo[102748]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1e726384-8a37-4946-921d-fea61d3f154c tempest-SnapshotDependencyTests-1699856137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-969f1951-447d-4cfd-a4f8-cb473bb3645c" returned: 0 in 0.491s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1e726384-8a37-4946-921d-fea61d3f154c tempest-SnapshotDependencyTests-1699856137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-969f1951-447d-4cfd-a4f8-cb473bb3645c {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:54 devstack sudo[102753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-969f1951-447d-4cfd-a4f8-cb473bb3645c Nov 03 20:30:54 devstack sudo[102753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:55 devstack sudo[102753]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1e726384-8a37-4946-921d-fea61d3f154c tempest-SnapshotDependencyTests-1699856137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-969f1951-447d-4cfd-a4f8-cb473bb3645c" returned: 0 in 0.325s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:55 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1e726384-8a37-4946-921d-fea61d3f154c tempest-SnapshotDependencyTests-1699856137 None] Lock "cinder-quobyte-969f1951-447d-4cfd-a4f8-cb473bb3645c" released by "delete_volume" :: held 0.895s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:30:55 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-1e726384-8a37-4946-921d-fea61d3f154c tempest-SnapshotDependencyTests-1699856137 None] Created reservations ['4cf07d4b-8841-4dc4-a480-d964b24b72cb', '7134ed41-90be-490e-9cd3-a0e378f2fe17', '64a8ed20-8dcc-49c6-ae7d-4fb9a4efdcaa', '709a8128-7f5f-4d75-9dd5-b08da2e99e5c'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:30:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1e726384-8a37-4946-921d-fea61d3f154c tempest-SnapshotDependencyTests-1699856137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:30:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1e726384-8a37-4946-921d-fea61d3f154c tempest-SnapshotDependencyTests-1699856137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:30:55 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-1e726384-8a37-4946-921d-fea61d3f154c tempest-SnapshotDependencyTests-1699856137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:30:55 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-1e726384-8a37-4946-921d-fea61d3f154c tempest-SnapshotDependencyTests-1699856137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:30:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1e726384-8a37-4946-921d-fea61d3f154c tempest-SnapshotDependencyTests-1699856137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:30:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1e726384-8a37-4946-921d-fea61d3f154c tempest-SnapshotDependencyTests-1699856137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:30:55 devstack sudo[102756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:30:55 devstack sudo[102756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:30:55 devstack sudo[102756]: pam_unix(sudo:session): session closed for user root Nov 03 20:30:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1e726384-8a37-4946-921d-fea61d3f154c tempest-SnapshotDependencyTests-1699856137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.474s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:30:55 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-1e726384-8a37-4946-921d-fea61d3f154c tempest-SnapshotDependencyTests-1699856137 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:30:55 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-1e726384-8a37-4946-921d-fea61d3f154c tempest-SnapshotDependencyTests-1699856137 None] Deleted volume successfully. Nov 03 20:30:55 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1e726384-8a37-4946-921d-fea61d3f154c tempest-SnapshotDependencyTests-1699856137 None] Lock "cinder-969f1951-447d-4cfd-a4f8-cb473bb3645c-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:05 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:SELECT=20,cinder:UPDATE=38,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:31:05 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:SELECT=26,cinder:INSERT=10,cinder:UPDATE=31,cinder:DELETE=3 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:31:08 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-7a5fc518-a956-4d39-befa-a8d019fc5d5f req-d86c056a-b64e-4ea4-9d04-5e30b0b2ba9e tempest-TestMinimumBasicScenario-486674481 None] Terminate volume connection completed successfully. Nov 03 20:31:08 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-7a5fc518-a956-4d39-befa-a8d019fc5d5f req-d86c056a-b64e-4ea4-9d04-5e30b0b2ba9e tempest-TestMinimumBasicScenario-486674481 None] Deleting attachment c753029d-7e0b-456a-9bf0-9e5a93dce4c4. {{(pid=87248) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 20:31:09 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-23b8132a-eb93-43cb-863f-48dacc39594b tempest-TestMinimumBasicScenario-486674481 None] Acquiring lock "cinder-b4d7b85c-35b6-4012-a4df-86733a3c4c43-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:09 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-23b8132a-eb93-43cb-863f-48dacc39594b tempest-TestMinimumBasicScenario-486674481 None] Lock "cinder-b4d7b85c-35b6-4012-a4df-86733a3c4c43-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:09 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-23b8132a-eb93-43cb-863f-48dacc39594b tempest-TestMinimumBasicScenario-486674481 None] Acquiring lock "cinder-quobyte-b4d7b85c-35b6-4012-a4df-86733a3c4c43" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:09 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-23b8132a-eb93-43cb-863f-48dacc39594b tempest-TestMinimumBasicScenario-486674481 None] Lock "cinder-quobyte-b4d7b85c-35b6-4012-a4df-86733a3c4c43" acquired by "delete_volume" :: waited 0.016s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:09 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[52078d10-556a-4036-9d9d-88b15941c385]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:31:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-23b8132a-eb93-43cb-863f-48dacc39594b tempest-TestMinimumBasicScenario-486674481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b4d7b85c-35b6-4012-a4df-86733a3c4c43 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:09 devstack sudo[102819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b4d7b85c-35b6-4012-a4df-86733a3c4c43 Nov 03 20:31:09 devstack sudo[102819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:10 devstack sudo[102819]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-23b8132a-eb93-43cb-863f-48dacc39594b tempest-TestMinimumBasicScenario-486674481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b4d7b85c-35b6-4012-a4df-86733a3c4c43" returned: 0 in 0.375s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-23b8132a-eb93-43cb-863f-48dacc39594b tempest-TestMinimumBasicScenario-486674481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b4d7b85c-35b6-4012-a4df-86733a3c4c43 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:10 devstack sudo[102825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b4d7b85c-35b6-4012-a4df-86733a3c4c43 Nov 03 20:31:10 devstack sudo[102825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:10 devstack sudo[102825]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-23b8132a-eb93-43cb-863f-48dacc39594b tempest-TestMinimumBasicScenario-486674481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b4d7b85c-35b6-4012-a4df-86733a3c4c43" returned: 0 in 0.256s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:10 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-23b8132a-eb93-43cb-863f-48dacc39594b tempest-TestMinimumBasicScenario-486674481 None] Lock "cinder-quobyte-b4d7b85c-35b6-4012-a4df-86733a3c4c43" released by "delete_volume" :: held 0.683s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:10 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-23b8132a-eb93-43cb-863f-48dacc39594b tempest-TestMinimumBasicScenario-486674481 None] Created reservations ['80f3a057-4db5-4228-974e-e1de025cab40', 'b5df197f-ff64-4578-8626-922c23e5d858', '8051f9c4-4a0d-40b5-a8f0-7b118b2bc1df', 'bf81d4ac-ec46-417e-a9c5-cc08615c2bf7'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:31:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-23b8132a-eb93-43cb-863f-48dacc39594b tempest-TestMinimumBasicScenario-486674481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-23b8132a-eb93-43cb-863f-48dacc39594b tempest-TestMinimumBasicScenario-486674481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:10 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-23b8132a-eb93-43cb-863f-48dacc39594b tempest-TestMinimumBasicScenario-486674481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:31:10 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-23b8132a-eb93-43cb-863f-48dacc39594b tempest-TestMinimumBasicScenario-486674481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:31:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-23b8132a-eb93-43cb-863f-48dacc39594b tempest-TestMinimumBasicScenario-486674481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-23b8132a-eb93-43cb-863f-48dacc39594b tempest-TestMinimumBasicScenario-486674481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:10 devstack sudo[102828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:31:10 devstack sudo[102828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:10 devstack sudo[102828]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-23b8132a-eb93-43cb-863f-48dacc39594b tempest-TestMinimumBasicScenario-486674481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.277s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:10 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-23b8132a-eb93-43cb-863f-48dacc39594b tempest-TestMinimumBasicScenario-486674481 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:31:10 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-23b8132a-eb93-43cb-863f-48dacc39594b tempest-TestMinimumBasicScenario-486674481 None] Deleted volume successfully. Nov 03 20:31:10 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-23b8132a-eb93-43cb-863f-48dacc39594b tempest-TestMinimumBasicScenario-486674481 None] Lock "cinder-b4d7b85c-35b6-4012-a4df-86733a3c4c43-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:12 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-84fa0352-5260-4e4a-bd41-62f32ac5085e tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:31:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-84fa0352-5260-4e4a-bd41-62f32ac5085e tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Flow 'volume_create_manager' (57c580e4-5ca9-43e7-936d-b19c63eaab72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:31:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-84fa0352-5260-4e4a-bd41-62f32ac5085e tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f727cf6f-f1ae-4422-a163-c224530494d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-84fa0352-5260-4e4a-bd41-62f32ac5085e tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f727cf6f-f1ae-4422-a163-c224530494d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:31:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-173254298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb3367c4-2cb6-41b7-bb45-1d9ff8147231,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fee3e50d2304bb1b6c8198d4e3415fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:31:13Z,use_quota=True,user_id='ca5c9966be5a46a69a8c558c675d2a43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f991abc0-e228-4bd9-a608-1a4ff2b310c9),volume_type_id=f991abc0-e228-4bd9-a608-1a4ff2b310c9)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-84fa0352-5260-4e4a-bd41-62f32ac5085e tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbe142ca-c912-4cde-bc67-331d20fd35b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-84fa0352-5260-4e4a-bd41-62f32ac5085e tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbe142ca-c912-4cde-bc67-331d20fd35b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-84fa0352-5260-4e4a-bd41-62f32ac5085e tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b40f3f76-0f6c-471c-918d-710fb2efba05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-84fa0352-5260-4e4a-bd41-62f32ac5085e tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b40f3f76-0f6c-471c-918d-710fb2efba05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb3367c4-2cb6-41b7-bb45-1d9ff8147231', 'volume_name': 'volume-bb3367c4-2cb6-41b7-bb45-1d9ff8147231', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-84fa0352-5260-4e4a-bd41-62f32ac5085e tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e809bc5b-8051-423a-b5e4-177c57f39567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-84fa0352-5260-4e4a-bd41-62f32ac5085e tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e809bc5b-8051-423a-b5e4-177c57f39567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-84fa0352-5260-4e4a-bd41-62f32ac5085e tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ede56876-06d6-491d-bfb4-0762befc3dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:12 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-84fa0352-5260-4e4a-bd41-62f32ac5085e tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Volume bb3367c4-2cb6-41b7-bb45-1d9ff8147231: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb3367c4-2cb6-41b7-bb45-1d9ff8147231', 'volume_size': 1} Nov 03 20:31:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-84fa0352-5260-4e4a-bd41-62f32ac5085e tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-84fa0352-5260-4e4a-bd41-62f32ac5085e tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:12 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-84fa0352-5260-4e4a-bd41-62f32ac5085e tempest-VolumeRetypeWithoutMigrationTest-941698186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:31:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-173254298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb3367c4-2cb6-41b7-bb45-1d9ff8147231,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fee3e50d2304bb1b6c8198d4e3415fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:31:13Z,use_quota=True,user_id='ca5c9966be5a46a69a8c558c675d2a43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f991abc0-e228-4bd9-a608-1a4ff2b310c9),volume_type_id=f991abc0-e228-4bd9-a608-1a4ff2b310c9)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:31:12 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-84fa0352-5260-4e4a-bd41-62f32ac5085e tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Creating volume bb3367c4-2cb6-41b7-bb45-1d9ff8147231 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:31:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-84fa0352-5260-4e4a-bd41-62f32ac5085e tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-84fa0352-5260-4e4a-bd41-62f32ac5085e tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:12 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-84fa0352-5260-4e4a-bd41-62f32ac5085e tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:31:12 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-84fa0352-5260-4e4a-bd41-62f32ac5085e tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:31:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-84fa0352-5260-4e4a-bd41-62f32ac5085e tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:12 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-84fa0352-5260-4e4a-bd41-62f32ac5085e tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:31:12 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-84fa0352-5260-4e4a-bd41-62f32ac5085e tempest-VolumeRetypeWithoutMigrationTest-941698186 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:31:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-84fa0352-5260-4e4a-bd41-62f32ac5085e tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bb3367c4-2cb6-41b7-bb45-1d9ff8147231 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:12 devstack sudo[102858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bb3367c4-2cb6-41b7-bb45-1d9ff8147231 1073741824 Nov 03 20:31:12 devstack sudo[102858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:13 devstack sudo[102858]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-84fa0352-5260-4e4a-bd41-62f32ac5085e tempest-VolumeRetypeWithoutMigrationTest-941698186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bb3367c4-2cb6-41b7-bb45-1d9ff8147231 1073741824" returned: 0 in 0.420s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-84fa0352-5260-4e4a-bd41-62f32ac5085e tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bb3367c4-2cb6-41b7-bb45-1d9ff8147231 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:13 devstack sudo[102863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bb3367c4-2cb6-41b7-bb45-1d9ff8147231 Nov 03 20:31:13 devstack sudo[102863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:13 devstack sudo[102863]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-84fa0352-5260-4e4a-bd41-62f32ac5085e tempest-VolumeRetypeWithoutMigrationTest-941698186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bb3367c4-2cb6-41b7-bb45-1d9ff8147231" returned: 0 in 0.245s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:13 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-84fa0352-5260-4e4a-bd41-62f32ac5085e tempest-VolumeRetypeWithoutMigrationTest-941698186 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:31:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-84fa0352-5260-4e4a-bd41-62f32ac5085e tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-84fa0352-5260-4e4a-bd41-62f32ac5085e tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ede56876-06d6-491d-bfb4-0762befc3dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb3367c4-2cb6-41b7-bb45-1d9ff8147231', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-84fa0352-5260-4e4a-bd41-62f32ac5085e tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (575fafc6-3154-4ec9-9d03-773d4fae53bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:13 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-84fa0352-5260-4e4a-bd41-62f32ac5085e tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Volume volume-bb3367c4-2cb6-41b7-bb45-1d9ff8147231 (bb3367c4-2cb6-41b7-bb45-1d9ff8147231): created successfully Nov 03 20:31:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-84fa0352-5260-4e4a-bd41-62f32ac5085e tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (575fafc6-3154-4ec9-9d03-773d4fae53bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-84fa0352-5260-4e4a-bd41-62f32ac5085e tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Flow 'volume_create_manager' (57c580e4-5ca9-43e7-936d-b19c63eaab72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:31:13 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-84fa0352-5260-4e4a-bd41-62f32ac5085e tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Created volume successfully. Nov 03 20:31:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b4351c7d-7605-4d30-bbbd-4cc9a614ed70 tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b4351c7d-7605-4d30-bbbd-4cc9a614ed70 tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:14 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-b4351c7d-7605-4d30-bbbd-4cc9a614ed70 tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:31:14 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-b4351c7d-7605-4d30-bbbd-4cc9a614ed70 tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:31:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b4351c7d-7605-4d30-bbbd-4cc9a614ed70 tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b4351c7d-7605-4d30-bbbd-4cc9a614ed70 tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:14 devstack sudo[102866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:31:14 devstack sudo[102866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:14 devstack sudo[102866]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b4351c7d-7605-4d30-bbbd-4cc9a614ed70 tempest-VolumeRetypeWithoutMigrationTest-941698186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.254s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:14 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-b4351c7d-7605-4d30-bbbd-4cc9a614ed70 tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:31:14 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-b4351c7d-7605-4d30-bbbd-4cc9a614ed70 tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Retype volume completed successfully. Nov 03 20:31:15 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ecd431b2-42e3-4d73-9734-964f8d7551d6 tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Acquiring lock "cinder-bb3367c4-2cb6-41b7-bb45-1d9ff8147231-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:15 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ecd431b2-42e3-4d73-9734-964f8d7551d6 tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Lock "cinder-bb3367c4-2cb6-41b7-bb45-1d9ff8147231-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:15 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ecd431b2-42e3-4d73-9734-964f8d7551d6 tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Acquiring lock "cinder-quobyte-bb3367c4-2cb6-41b7-bb45-1d9ff8147231" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:15 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ecd431b2-42e3-4d73-9734-964f8d7551d6 tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Lock "cinder-quobyte-bb3367c4-2cb6-41b7-bb45-1d9ff8147231" acquired by "delete_volume" :: waited 0.016s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:15 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fac7f9-6ee9-425b-b577-4f7c0074557b]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:31:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ecd431b2-42e3-4d73-9734-964f8d7551d6 tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bb3367c4-2cb6-41b7-bb45-1d9ff8147231 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:15 devstack sudo[102872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bb3367c4-2cb6-41b7-bb45-1d9ff8147231 Nov 03 20:31:15 devstack sudo[102872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:15 devstack sudo[102872]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ecd431b2-42e3-4d73-9734-964f8d7551d6 tempest-VolumeRetypeWithoutMigrationTest-941698186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bb3367c4-2cb6-41b7-bb45-1d9ff8147231" returned: 0 in 0.368s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ecd431b2-42e3-4d73-9734-964f8d7551d6 tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bb3367c4-2cb6-41b7-bb45-1d9ff8147231 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:16 devstack sudo[102877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bb3367c4-2cb6-41b7-bb45-1d9ff8147231 Nov 03 20:31:16 devstack sudo[102877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:16 devstack sudo[102877]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ecd431b2-42e3-4d73-9734-964f8d7551d6 tempest-VolumeRetypeWithoutMigrationTest-941698186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-bb3367c4-2cb6-41b7-bb45-1d9ff8147231" returned: 0 in 0.292s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:16 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ecd431b2-42e3-4d73-9734-964f8d7551d6 tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Lock "cinder-quobyte-bb3367c4-2cb6-41b7-bb45-1d9ff8147231" released by "delete_volume" :: held 0.711s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:16 devstack cinder-volume[87248]: WARNING cinder.quota [None req-ecd431b2-42e3-4d73-9734-964f8d7551d6 tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:31:16 devstack cinder-volume[87248]: WARNING cinder.quota [None req-ecd431b2-42e3-4d73-9734-964f8d7551d6 tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:31:16 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-ecd431b2-42e3-4d73-9734-964f8d7551d6 tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Created reservations ['dfa348be-cf9a-4f7b-af72-84a4aff73971', '5a3881a7-ca82-4a3e-885e-e0d8550a3711', '1da29588-1247-4311-81ee-64a71bac9807', '7bbc578c-3653-4aca-81d7-ed49e10b1aee'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:31:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ecd431b2-42e3-4d73-9734-964f8d7551d6 tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ecd431b2-42e3-4d73-9734-964f8d7551d6 tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:16 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-ecd431b2-42e3-4d73-9734-964f8d7551d6 tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:31:16 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-ecd431b2-42e3-4d73-9734-964f8d7551d6 tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:31:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ecd431b2-42e3-4d73-9734-964f8d7551d6 tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ecd431b2-42e3-4d73-9734-964f8d7551d6 tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:16 devstack sudo[102881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:31:16 devstack sudo[102881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:16 devstack sudo[102881]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ecd431b2-42e3-4d73-9734-964f8d7551d6 tempest-VolumeRetypeWithoutMigrationTest-941698186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.265s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:16 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-ecd431b2-42e3-4d73-9734-964f8d7551d6 tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:31:16 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-ecd431b2-42e3-4d73-9734-964f8d7551d6 tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Deleted volume successfully. Nov 03 20:31:16 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ecd431b2-42e3-4d73-9734-964f8d7551d6 tempest-VolumeRetypeWithoutMigrationTest-941698186 None] Lock "cinder-bb3367c4-2cb6-41b7-bb45-1d9ff8147231-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:21 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-d81d82e5-4ddf-49e6-9b9a-d5152555c249 req-cc439315-1e83-4c90-b432-6a179783d8d5 tempest-TestShelveInstance-965880078 None] Terminate volume connection completed successfully. Nov 03 20:31:21 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-d81d82e5-4ddf-49e6-9b9a-d5152555c249 req-cc439315-1e83-4c90-b432-6a179783d8d5 tempest-TestShelveInstance-965880078 None] Deleting attachment 66476043-ba14-4c25-8b0f-4b6922b0ec6b. {{(pid=87248) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 20:31:21 devstack cinder-volume[87248]: DEBUG cinder.coordination [req-d81d82e5-4ddf-49e6-9b9a-d5152555c249 req-713c9a41-09ce-4cd3-a33b-f06053cf7b3e tempest-TestShelveInstance-965880078 None] Acquiring lock "cinder-e66183fe-35e0-4de3-ac30-d3c443b74bde-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:21 devstack cinder-volume[87248]: DEBUG cinder.coordination [req-d81d82e5-4ddf-49e6-9b9a-d5152555c249 req-713c9a41-09ce-4cd3-a33b-f06053cf7b3e tempest-TestShelveInstance-965880078 None] Lock "cinder-e66183fe-35e0-4de3-ac30-d3c443b74bde-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:21 devstack cinder-volume[87248]: DEBUG cinder.coordination [req-d81d82e5-4ddf-49e6-9b9a-d5152555c249 req-713c9a41-09ce-4cd3-a33b-f06053cf7b3e tempest-TestShelveInstance-965880078 None] Acquiring lock "cinder-quobyte-e66183fe-35e0-4de3-ac30-d3c443b74bde" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:21 devstack cinder-volume[87248]: DEBUG cinder.coordination [req-d81d82e5-4ddf-49e6-9b9a-d5152555c249 req-713c9a41-09ce-4cd3-a33b-f06053cf7b3e tempest-TestShelveInstance-965880078 None] Lock "cinder-quobyte-e66183fe-35e0-4de3-ac30-d3c443b74bde" acquired by "delete_volume" :: waited 0.021s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:21 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[633ca7e7-f090-4b42-9a57-cb307837234d]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:31:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-d81d82e5-4ddf-49e6-9b9a-d5152555c249 req-713c9a41-09ce-4cd3-a33b-f06053cf7b3e tempest-TestShelveInstance-965880078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e66183fe-35e0-4de3-ac30-d3c443b74bde {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:21 devstack sudo[102915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e66183fe-35e0-4de3-ac30-d3c443b74bde Nov 03 20:31:21 devstack sudo[102915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:22 devstack sudo[102915]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-d81d82e5-4ddf-49e6-9b9a-d5152555c249 req-713c9a41-09ce-4cd3-a33b-f06053cf7b3e tempest-TestShelveInstance-965880078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e66183fe-35e0-4de3-ac30-d3c443b74bde" returned: 0 in 0.477s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-d81d82e5-4ddf-49e6-9b9a-d5152555c249 req-713c9a41-09ce-4cd3-a33b-f06053cf7b3e tempest-TestShelveInstance-965880078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e66183fe-35e0-4de3-ac30-d3c443b74bde {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:22 devstack sudo[102922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e66183fe-35e0-4de3-ac30-d3c443b74bde Nov 03 20:31:22 devstack sudo[102922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:22 devstack sudo[102922]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-d81d82e5-4ddf-49e6-9b9a-d5152555c249 req-713c9a41-09ce-4cd3-a33b-f06053cf7b3e tempest-TestShelveInstance-965880078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-e66183fe-35e0-4de3-ac30-d3c443b74bde" returned: 0 in 0.385s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:22 devstack cinder-volume[87248]: DEBUG cinder.coordination [req-d81d82e5-4ddf-49e6-9b9a-d5152555c249 req-713c9a41-09ce-4cd3-a33b-f06053cf7b3e tempest-TestShelveInstance-965880078 None] Lock "cinder-quobyte-e66183fe-35e0-4de3-ac30-d3c443b74bde" released by "delete_volume" :: held 0.930s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:22 devstack cinder-volume[87248]: DEBUG cinder.quota [req-d81d82e5-4ddf-49e6-9b9a-d5152555c249 req-713c9a41-09ce-4cd3-a33b-f06053cf7b3e tempest-TestShelveInstance-965880078 None] Created reservations ['ff7c57c7-9fed-41e0-a567-bd332073c18b', '45528224-2ce3-4338-8d24-57cb762e0eff', '57a24eba-b3a4-4e48-b98c-be6fdd66c0bd', '55fe7b57-fdbb-4213-9c44-e10fbd9560ac'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:31:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-d81d82e5-4ddf-49e6-9b9a-d5152555c249 req-713c9a41-09ce-4cd3-a33b-f06053cf7b3e tempest-TestShelveInstance-965880078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-d81d82e5-4ddf-49e6-9b9a-d5152555c249 req-713c9a41-09ce-4cd3-a33b-f06053cf7b3e tempest-TestShelveInstance-965880078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:22 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [req-d81d82e5-4ddf-49e6-9b9a-d5152555c249 req-713c9a41-09ce-4cd3-a33b-f06053cf7b3e tempest-TestShelveInstance-965880078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:31:22 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [req-d81d82e5-4ddf-49e6-9b9a-d5152555c249 req-713c9a41-09ce-4cd3-a33b-f06053cf7b3e tempest-TestShelveInstance-965880078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:31:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-d81d82e5-4ddf-49e6-9b9a-d5152555c249 req-713c9a41-09ce-4cd3-a33b-f06053cf7b3e tempest-TestShelveInstance-965880078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-d81d82e5-4ddf-49e6-9b9a-d5152555c249 req-713c9a41-09ce-4cd3-a33b-f06053cf7b3e tempest-TestShelveInstance-965880078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:22 devstack sudo[102925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:31:22 devstack sudo[102925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:23 devstack sudo[102925]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [req-d81d82e5-4ddf-49e6-9b9a-d5152555c249 req-713c9a41-09ce-4cd3-a33b-f06053cf7b3e tempest-TestShelveInstance-965880078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.275s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:23 devstack cinder-volume[87248]: DEBUG cinder.manager [req-d81d82e5-4ddf-49e6-9b9a-d5152555c249 req-713c9a41-09ce-4cd3-a33b-f06053cf7b3e tempest-TestShelveInstance-965880078 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:31:23 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-d81d82e5-4ddf-49e6-9b9a-d5152555c249 req-713c9a41-09ce-4cd3-a33b-f06053cf7b3e tempest-TestShelveInstance-965880078 None] Deleted volume successfully. Nov 03 20:31:23 devstack cinder-volume[87248]: DEBUG cinder.coordination [req-d81d82e5-4ddf-49e6-9b9a-d5152555c249 req-713c9a41-09ce-4cd3-a33b-f06053cf7b3e tempest-TestShelveInstance-965880078 None] Lock "cinder-e66183fe-35e0-4de3-ac30-d3c443b74bde-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:28 devstack cinder-volume[87248]: DEBUG oslo_service.periodic_task [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:31:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:31:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:31:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:28 devstack sudo[102932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:31:28 devstack sudo[102932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:29 devstack sudo[102932]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.398s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:29 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:31:29 devstack cinder-volume[87248]: DEBUG oslo_service.periodic_task [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running periodic task VolumeManager._thread_info {{(pid=87248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:31:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] thread count: 28 {{(pid=87248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:31:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] thread info: [<_MainThread(MainThread, started 124862067372160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:31:32 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:SELECT=22,cinder:UPDATE=28,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:31:33 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:SELECT=30,cinder:INSERT=8,cinder:UPDATE=35,cinder:DELETE=2 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:31:51 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b49d66c-e2d7-4a18-8ec9-2b969dbc8d18 tempest-ProjectReaderTests-1119053767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:31:51 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0b49d66c-e2d7-4a18-8ec9-2b969dbc8d18 tempest-ProjectReaderTests-1119053767 None] Flow 'volume_create_manager' (69589f85-23a6-498c-afcb-f3baade6737d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:31:51 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0b49d66c-e2d7-4a18-8ec9-2b969dbc8d18 tempest-ProjectReaderTests-1119053767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d6aea6e-951a-417e-b9b3-9e0e2f58dd3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:51 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0b49d66c-e2d7-4a18-8ec9-2b969dbc8d18 tempest-ProjectReaderTests-1119053767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d6aea6e-951a-417e-b9b3-9e0e2f58dd3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1311658734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a40b4b7-5f5d-4877-bb66-6abe85d08162,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f33b162d06a4871851975255221660f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:31:51Z,use_quota=True,user_id='fdf0007b72b349dc923b487190622a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:51 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0b49d66c-e2d7-4a18-8ec9-2b969dbc8d18 tempest-ProjectReaderTests-1119053767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (825e356f-07ad-4881-8770-079f8116572f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:51 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0b49d66c-e2d7-4a18-8ec9-2b969dbc8d18 tempest-ProjectReaderTests-1119053767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (825e356f-07ad-4881-8770-079f8116572f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:51 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0b49d66c-e2d7-4a18-8ec9-2b969dbc8d18 tempest-ProjectReaderTests-1119053767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abb139c6-f5d7-488d-be0e-a45aed3df169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:51 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0b49d66c-e2d7-4a18-8ec9-2b969dbc8d18 tempest-ProjectReaderTests-1119053767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abb139c6-f5d7-488d-be0e-a45aed3df169) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a40b4b7-5f5d-4877-bb66-6abe85d08162', 'volume_name': 'volume-9a40b4b7-5f5d-4877-bb66-6abe85d08162', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:51 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0b49d66c-e2d7-4a18-8ec9-2b969dbc8d18 tempest-ProjectReaderTests-1119053767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f323ac94-32f4-4eb8-b809-9bc12225b81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:51 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0b49d66c-e2d7-4a18-8ec9-2b969dbc8d18 tempest-ProjectReaderTests-1119053767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f323ac94-32f4-4eb8-b809-9bc12225b81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:51 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0b49d66c-e2d7-4a18-8ec9-2b969dbc8d18 tempest-ProjectReaderTests-1119053767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd39edb1-7783-4c28-98bb-cbc4e7fa9f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:51 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-0b49d66c-e2d7-4a18-8ec9-2b969dbc8d18 tempest-ProjectReaderTests-1119053767 None] Volume 9a40b4b7-5f5d-4877-bb66-6abe85d08162: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a40b4b7-5f5d-4877-bb66-6abe85d08162', 'volume_size': 1} Nov 03 20:31:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-0b49d66c-e2d7-4a18-8ec9-2b969dbc8d18 tempest-ProjectReaderTests-1119053767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-0b49d66c-e2d7-4a18-8ec9-2b969dbc8d18 tempest-ProjectReaderTests-1119053767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:51 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-0b49d66c-e2d7-4a18-8ec9-2b969dbc8d18 tempest-ProjectReaderTests-1119053767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1311658734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a40b4b7-5f5d-4877-bb66-6abe85d08162,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f33b162d06a4871851975255221660f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:31:51Z,use_quota=True,user_id='fdf0007b72b349dc923b487190622a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:31:51 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-0b49d66c-e2d7-4a18-8ec9-2b969dbc8d18 tempest-ProjectReaderTests-1119053767 None] Creating volume 9a40b4b7-5f5d-4877-bb66-6abe85d08162 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:31:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-0b49d66c-e2d7-4a18-8ec9-2b969dbc8d18 tempest-ProjectReaderTests-1119053767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-0b49d66c-e2d7-4a18-8ec9-2b969dbc8d18 tempest-ProjectReaderTests-1119053767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:51 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-0b49d66c-e2d7-4a18-8ec9-2b969dbc8d18 tempest-ProjectReaderTests-1119053767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:31:51 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-0b49d66c-e2d7-4a18-8ec9-2b969dbc8d18 tempest-ProjectReaderTests-1119053767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:31:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-0b49d66c-e2d7-4a18-8ec9-2b969dbc8d18 tempest-ProjectReaderTests-1119053767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:51 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-0b49d66c-e2d7-4a18-8ec9-2b969dbc8d18 tempest-ProjectReaderTests-1119053767 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:31:51 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-0b49d66c-e2d7-4a18-8ec9-2b969dbc8d18 tempest-ProjectReaderTests-1119053767 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:31:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-0b49d66c-e2d7-4a18-8ec9-2b969dbc8d18 tempest-ProjectReaderTests-1119053767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-9a40b4b7-5f5d-4877-bb66-6abe85d08162 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:51 devstack sudo[102941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-9a40b4b7-5f5d-4877-bb66-6abe85d08162 1073741824 Nov 03 20:31:51 devstack sudo[102941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:52 devstack sudo[102941]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-0b49d66c-e2d7-4a18-8ec9-2b969dbc8d18 tempest-ProjectReaderTests-1119053767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-9a40b4b7-5f5d-4877-bb66-6abe85d08162 1073741824" returned: 0 in 0.545s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-0b49d66c-e2d7-4a18-8ec9-2b969dbc8d18 tempest-ProjectReaderTests-1119053767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-9a40b4b7-5f5d-4877-bb66-6abe85d08162 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:52 devstack sudo[102948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-9a40b4b7-5f5d-4877-bb66-6abe85d08162 Nov 03 20:31:52 devstack sudo[102948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:52 devstack sudo[102948]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-0b49d66c-e2d7-4a18-8ec9-2b969dbc8d18 tempest-ProjectReaderTests-1119053767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-9a40b4b7-5f5d-4877-bb66-6abe85d08162" returned: 0 in 0.293s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:52 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-0b49d66c-e2d7-4a18-8ec9-2b969dbc8d18 tempest-ProjectReaderTests-1119053767 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:31:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-0b49d66c-e2d7-4a18-8ec9-2b969dbc8d18 tempest-ProjectReaderTests-1119053767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:52 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0b49d66c-e2d7-4a18-8ec9-2b969dbc8d18 tempest-ProjectReaderTests-1119053767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd39edb1-7783-4c28-98bb-cbc4e7fa9f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a40b4b7-5f5d-4877-bb66-6abe85d08162', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:52 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0b49d66c-e2d7-4a18-8ec9-2b969dbc8d18 tempest-ProjectReaderTests-1119053767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ea00a2c-0fef-4055-842f-d3d095d2b0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:52 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-0b49d66c-e2d7-4a18-8ec9-2b969dbc8d18 tempest-ProjectReaderTests-1119053767 None] Volume volume-9a40b4b7-5f5d-4877-bb66-6abe85d08162 (9a40b4b7-5f5d-4877-bb66-6abe85d08162): created successfully Nov 03 20:31:52 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0b49d66c-e2d7-4a18-8ec9-2b969dbc8d18 tempest-ProjectReaderTests-1119053767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ea00a2c-0fef-4055-842f-d3d095d2b0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:52 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-0b49d66c-e2d7-4a18-8ec9-2b969dbc8d18 tempest-ProjectReaderTests-1119053767 None] Flow 'volume_create_manager' (69589f85-23a6-498c-afcb-f3baade6737d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:31:52 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-0b49d66c-e2d7-4a18-8ec9-2b969dbc8d18 tempest-ProjectReaderTests-1119053767 None] Created volume successfully. Nov 03 20:31:53 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-bd313067-bee4-48f6-8880-4c65f70554ea tempest-ProjectReaderTests-1119053767 None] Acquiring lock "cinder-9a40b4b7-5f5d-4877-bb66-6abe85d08162-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:53 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-bd313067-bee4-48f6-8880-4c65f70554ea tempest-ProjectReaderTests-1119053767 None] Lock "cinder-9a40b4b7-5f5d-4877-bb66-6abe85d08162-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:53 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-bd313067-bee4-48f6-8880-4c65f70554ea tempest-ProjectReaderTests-1119053767 None] Acquiring lock "cinder-quobyte-9a40b4b7-5f5d-4877-bb66-6abe85d08162" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:53 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-bd313067-bee4-48f6-8880-4c65f70554ea tempest-ProjectReaderTests-1119053767 None] Lock "cinder-quobyte-9a40b4b7-5f5d-4877-bb66-6abe85d08162" acquired by "delete_volume" :: waited 0.017s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:53 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[a268627b-cf38-4d0e-8222-5f699cd196d3]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:31:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-bd313067-bee4-48f6-8880-4c65f70554ea tempest-ProjectReaderTests-1119053767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-9a40b4b7-5f5d-4877-bb66-6abe85d08162 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:54 devstack sudo[102951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-9a40b4b7-5f5d-4877-bb66-6abe85d08162 Nov 03 20:31:54 devstack sudo[102951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:54 devstack sudo[102951]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-bd313067-bee4-48f6-8880-4c65f70554ea tempest-ProjectReaderTests-1119053767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-9a40b4b7-5f5d-4877-bb66-6abe85d08162" returned: 0 in 0.514s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-bd313067-bee4-48f6-8880-4c65f70554ea tempest-ProjectReaderTests-1119053767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-9a40b4b7-5f5d-4877-bb66-6abe85d08162 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:54 devstack sudo[102956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-9a40b4b7-5f5d-4877-bb66-6abe85d08162 Nov 03 20:31:54 devstack sudo[102956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:54 devstack sudo[102956]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-bd313067-bee4-48f6-8880-4c65f70554ea tempest-ProjectReaderTests-1119053767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-9a40b4b7-5f5d-4877-bb66-6abe85d08162" returned: 0 in 0.298s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:54 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-bd313067-bee4-48f6-8880-4c65f70554ea tempest-ProjectReaderTests-1119053767 None] Lock "cinder-quobyte-9a40b4b7-5f5d-4877-bb66-6abe85d08162" released by "delete_volume" :: held 0.871s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:54 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-bd313067-bee4-48f6-8880-4c65f70554ea tempest-ProjectReaderTests-1119053767 None] Created reservations ['2a7d2e42-7ddd-45c4-b2fa-340a25576e92', '9d6dda28-246e-4d30-b326-0e4e0e14f2ab', '4f8ea9b3-9600-4dbc-a35a-ed2b9701abd5', '62b59fd0-3068-4174-9c70-17faa9a3f7ac'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:31:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-bd313067-bee4-48f6-8880-4c65f70554ea tempest-ProjectReaderTests-1119053767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-bd313067-bee4-48f6-8880-4c65f70554ea tempest-ProjectReaderTests-1119053767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:54 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-bd313067-bee4-48f6-8880-4c65f70554ea tempest-ProjectReaderTests-1119053767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:31:54 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-bd313067-bee4-48f6-8880-4c65f70554ea tempest-ProjectReaderTests-1119053767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:31:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-bd313067-bee4-48f6-8880-4c65f70554ea tempest-ProjectReaderTests-1119053767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-bd313067-bee4-48f6-8880-4c65f70554ea tempest-ProjectReaderTests-1119053767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:55 devstack sudo[102959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:31:55 devstack sudo[102959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:55 devstack sudo[102959]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-bd313067-bee4-48f6-8880-4c65f70554ea tempest-ProjectReaderTests-1119053767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.438s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:55 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-bd313067-bee4-48f6-8880-4c65f70554ea tempest-ProjectReaderTests-1119053767 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:31:55 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-bd313067-bee4-48f6-8880-4c65f70554ea tempest-ProjectReaderTests-1119053767 None] Deleted volume successfully. Nov 03 20:31:55 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-bd313067-bee4-48f6-8880-4c65f70554ea tempest-ProjectReaderTests-1119053767 None] Lock "cinder-9a40b4b7-5f5d-4877-bb66-6abe85d08162-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:55 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-07278190-46f6-4144-9ba2-4968e3dfc18a tempest-ProjectReaderTests-1119053767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:31:55 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-07278190-46f6-4144-9ba2-4968e3dfc18a tempest-ProjectReaderTests-1119053767 None] Flow 'volume_create_manager' (55ce76a6-4e8f-4f26-8dd8-f017383441e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:31:55 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-07278190-46f6-4144-9ba2-4968e3dfc18a tempest-ProjectReaderTests-1119053767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87e2e2ce-64d3-4b4c-84a0-6b05f21e66c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:55 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-07278190-46f6-4144-9ba2-4968e3dfc18a tempest-ProjectReaderTests-1119053767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87e2e2ce-64d3-4b4c-84a0-6b05f21e66c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1784049041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f80f256-18d8-4fe0-9d63-1c85af3f95cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f33b162d06a4871851975255221660f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:31:56Z,use_quota=True,user_id='fdf0007b72b349dc923b487190622a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:55 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-07278190-46f6-4144-9ba2-4968e3dfc18a tempest-ProjectReaderTests-1119053767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b79f53da-76ca-4fca-ba8e-03bdd35b111e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:55 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-07278190-46f6-4144-9ba2-4968e3dfc18a tempest-ProjectReaderTests-1119053767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b79f53da-76ca-4fca-ba8e-03bdd35b111e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:55 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-07278190-46f6-4144-9ba2-4968e3dfc18a tempest-ProjectReaderTests-1119053767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12a3e3e3-fc16-4c1a-bae3-da74865d9a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:55 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-07278190-46f6-4144-9ba2-4968e3dfc18a tempest-ProjectReaderTests-1119053767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12a3e3e3-fc16-4c1a-bae3-da74865d9a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f80f256-18d8-4fe0-9d63-1c85af3f95cc', 'volume_name': 'volume-6f80f256-18d8-4fe0-9d63-1c85af3f95cc', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:55 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-07278190-46f6-4144-9ba2-4968e3dfc18a tempest-ProjectReaderTests-1119053767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89abd7b7-9c1e-4b8f-8262-1910b0ef6d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:55 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-07278190-46f6-4144-9ba2-4968e3dfc18a tempest-ProjectReaderTests-1119053767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89abd7b7-9c1e-4b8f-8262-1910b0ef6d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:55 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-07278190-46f6-4144-9ba2-4968e3dfc18a tempest-ProjectReaderTests-1119053767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ab9737a-36fc-4e7c-a621-ba47331a6212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:55 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-07278190-46f6-4144-9ba2-4968e3dfc18a tempest-ProjectReaderTests-1119053767 None] Volume 6f80f256-18d8-4fe0-9d63-1c85af3f95cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f80f256-18d8-4fe0-9d63-1c85af3f95cc', 'volume_size': 1} Nov 03 20:31:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-07278190-46f6-4144-9ba2-4968e3dfc18a tempest-ProjectReaderTests-1119053767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-07278190-46f6-4144-9ba2-4968e3dfc18a tempest-ProjectReaderTests-1119053767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:55 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-07278190-46f6-4144-9ba2-4968e3dfc18a tempest-ProjectReaderTests-1119053767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1784049041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f80f256-18d8-4fe0-9d63-1c85af3f95cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f33b162d06a4871851975255221660f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:31:56Z,use_quota=True,user_id='fdf0007b72b349dc923b487190622a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:31:55 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-07278190-46f6-4144-9ba2-4968e3dfc18a tempest-ProjectReaderTests-1119053767 None] Creating volume 6f80f256-18d8-4fe0-9d63-1c85af3f95cc {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:31:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-07278190-46f6-4144-9ba2-4968e3dfc18a tempest-ProjectReaderTests-1119053767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-07278190-46f6-4144-9ba2-4968e3dfc18a tempest-ProjectReaderTests-1119053767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:55 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-07278190-46f6-4144-9ba2-4968e3dfc18a tempest-ProjectReaderTests-1119053767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:31:55 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-07278190-46f6-4144-9ba2-4968e3dfc18a tempest-ProjectReaderTests-1119053767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:31:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-07278190-46f6-4144-9ba2-4968e3dfc18a tempest-ProjectReaderTests-1119053767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:55 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-07278190-46f6-4144-9ba2-4968e3dfc18a tempest-ProjectReaderTests-1119053767 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:31:55 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-07278190-46f6-4144-9ba2-4968e3dfc18a tempest-ProjectReaderTests-1119053767 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:31:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-07278190-46f6-4144-9ba2-4968e3dfc18a tempest-ProjectReaderTests-1119053767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6f80f256-18d8-4fe0-9d63-1c85af3f95cc 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:55 devstack sudo[102962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6f80f256-18d8-4fe0-9d63-1c85af3f95cc 1073741824 Nov 03 20:31:55 devstack sudo[102962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:56 devstack sudo[102962]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-07278190-46f6-4144-9ba2-4968e3dfc18a tempest-ProjectReaderTests-1119053767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6f80f256-18d8-4fe0-9d63-1c85af3f95cc 1073741824" returned: 0 in 0.561s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-07278190-46f6-4144-9ba2-4968e3dfc18a tempest-ProjectReaderTests-1119053767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6f80f256-18d8-4fe0-9d63-1c85af3f95cc {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:56 devstack sudo[102968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6f80f256-18d8-4fe0-9d63-1c85af3f95cc Nov 03 20:31:56 devstack sudo[102968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:56 devstack sudo[102968]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-07278190-46f6-4144-9ba2-4968e3dfc18a tempest-ProjectReaderTests-1119053767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6f80f256-18d8-4fe0-9d63-1c85af3f95cc" returned: 0 in 0.286s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:56 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-07278190-46f6-4144-9ba2-4968e3dfc18a tempest-ProjectReaderTests-1119053767 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:31:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-07278190-46f6-4144-9ba2-4968e3dfc18a tempest-ProjectReaderTests-1119053767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-07278190-46f6-4144-9ba2-4968e3dfc18a tempest-ProjectReaderTests-1119053767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ab9737a-36fc-4e7c-a621-ba47331a6212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f80f256-18d8-4fe0-9d63-1c85af3f95cc', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-07278190-46f6-4144-9ba2-4968e3dfc18a tempest-ProjectReaderTests-1119053767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (305d4f78-405c-4bed-acdc-d8578f5b867b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:56 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-07278190-46f6-4144-9ba2-4968e3dfc18a tempest-ProjectReaderTests-1119053767 None] Volume volume-6f80f256-18d8-4fe0-9d63-1c85af3f95cc (6f80f256-18d8-4fe0-9d63-1c85af3f95cc): created successfully Nov 03 20:31:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-07278190-46f6-4144-9ba2-4968e3dfc18a tempest-ProjectReaderTests-1119053767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (305d4f78-405c-4bed-acdc-d8578f5b867b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-07278190-46f6-4144-9ba2-4968e3dfc18a tempest-ProjectReaderTests-1119053767 None] Flow 'volume_create_manager' (55ce76a6-4e8f-4f26-8dd8-f017383441e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:31:56 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-07278190-46f6-4144-9ba2-4968e3dfc18a tempest-ProjectReaderTests-1119053767 None] Created volume successfully. Nov 03 20:31:57 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-071509eb-824e-4342-8196-2b1347a505e4 tempest-ProjectReaderTests-1119053767 None] Acquiring lock "cinder-6f80f256-18d8-4fe0-9d63-1c85af3f95cc-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:57 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-071509eb-824e-4342-8196-2b1347a505e4 tempest-ProjectReaderTests-1119053767 None] Lock "cinder-6f80f256-18d8-4fe0-9d63-1c85af3f95cc-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:57 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-071509eb-824e-4342-8196-2b1347a505e4 tempest-ProjectReaderTests-1119053767 None] Acquiring lock "cinder-quobyte-6f80f256-18d8-4fe0-9d63-1c85af3f95cc" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:31:57 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-071509eb-824e-4342-8196-2b1347a505e4 tempest-ProjectReaderTests-1119053767 None] Lock "cinder-quobyte-6f80f256-18d8-4fe0-9d63-1c85af3f95cc" acquired by "delete_volume" :: waited 0.022s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:31:57 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b33057-95d2-4b52-9776-d6e46288668f]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:31:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-071509eb-824e-4342-8196-2b1347a505e4 tempest-ProjectReaderTests-1119053767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6f80f256-18d8-4fe0-9d63-1c85af3f95cc {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:58 devstack sudo[102971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6f80f256-18d8-4fe0-9d63-1c85af3f95cc Nov 03 20:31:58 devstack sudo[102971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:58 devstack sudo[102971]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-071509eb-824e-4342-8196-2b1347a505e4 tempest-ProjectReaderTests-1119053767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6f80f256-18d8-4fe0-9d63-1c85af3f95cc" returned: 0 in 0.473s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-071509eb-824e-4342-8196-2b1347a505e4 tempest-ProjectReaderTests-1119053767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6f80f256-18d8-4fe0-9d63-1c85af3f95cc {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:58 devstack sudo[102976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6f80f256-18d8-4fe0-9d63-1c85af3f95cc Nov 03 20:31:58 devstack sudo[102976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:58 devstack sudo[102976]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-071509eb-824e-4342-8196-2b1347a505e4 tempest-ProjectReaderTests-1119053767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6f80f256-18d8-4fe0-9d63-1c85af3f95cc" returned: 0 in 0.315s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:58 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-071509eb-824e-4342-8196-2b1347a505e4 tempest-ProjectReaderTests-1119053767 None] Lock "cinder-quobyte-6f80f256-18d8-4fe0-9d63-1c85af3f95cc" released by "delete_volume" :: held 0.850s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:58 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-071509eb-824e-4342-8196-2b1347a505e4 tempest-ProjectReaderTests-1119053767 None] Created reservations ['62eaa405-1ed7-4f97-b411-7f7980ac34e9', '49fdd77f-9496-46aa-8c40-c9dba27cd6f9', 'd6319f4d-030a-480e-bae1-cbbb1022f99b', '09778bfb-ea86-4297-b529-5adc8f096110'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:31:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-071509eb-824e-4342-8196-2b1347a505e4 tempest-ProjectReaderTests-1119053767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-071509eb-824e-4342-8196-2b1347a505e4 tempest-ProjectReaderTests-1119053767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:58 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-071509eb-824e-4342-8196-2b1347a505e4 tempest-ProjectReaderTests-1119053767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:31:58 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-071509eb-824e-4342-8196-2b1347a505e4 tempest-ProjectReaderTests-1119053767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:31:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-071509eb-824e-4342-8196-2b1347a505e4 tempest-ProjectReaderTests-1119053767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-071509eb-824e-4342-8196-2b1347a505e4 tempest-ProjectReaderTests-1119053767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:58 devstack sudo[102979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:31:58 devstack sudo[102979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:59 devstack sudo[102979]: pam_unix(sudo:session): session closed for user root Nov 03 20:31:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-071509eb-824e-4342-8196-2b1347a505e4 tempest-ProjectReaderTests-1119053767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.372s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:31:59 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-071509eb-824e-4342-8196-2b1347a505e4 tempest-ProjectReaderTests-1119053767 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:31:59 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-071509eb-824e-4342-8196-2b1347a505e4 tempest-ProjectReaderTests-1119053767 None] Deleted volume successfully. Nov 03 20:31:59 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-071509eb-824e-4342-8196-2b1347a505e4 tempest-ProjectReaderTests-1119053767 None] Lock "cinder-6f80f256-18d8-4fe0-9d63-1c85af3f95cc-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:31:59 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0726979-0e32-4c01-aa6e-0b27ccbf7002 tempest-TestStampPattern-702523091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:31:59 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d0726979-0e32-4c01-aa6e-0b27ccbf7002 tempest-TestStampPattern-702523091 None] Flow 'volume_create_manager' (aec4e364-2d9a-4531-8bd1-2de348c6fd13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:31:59 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d0726979-0e32-4c01-aa6e-0b27ccbf7002 tempest-TestStampPattern-702523091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (143ada94-0259-4fef-aebd-1ce3df691329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:59 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d0726979-0e32-4c01-aa6e-0b27ccbf7002 tempest-TestStampPattern-702523091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (143ada94-0259-4fef-aebd-1ce3df691329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2146821931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a43636c-c09b-4e28-9677-4809934aaa98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47b9476691b4455a88048666dfdb475e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:32:00Z,use_quota=True,user_id='2bf3ce54ed3a4ed4b06bcdba8f2d74ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:59 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d0726979-0e32-4c01-aa6e-0b27ccbf7002 tempest-TestStampPattern-702523091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2423f9d-318a-40c9-837b-d764030c60fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:59 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d0726979-0e32-4c01-aa6e-0b27ccbf7002 tempest-TestStampPattern-702523091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2423f9d-318a-40c9-837b-d764030c60fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:59 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d0726979-0e32-4c01-aa6e-0b27ccbf7002 tempest-TestStampPattern-702523091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12d0f070-ec10-4dc0-86f8-2e82e0a480c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:59 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d0726979-0e32-4c01-aa6e-0b27ccbf7002 tempest-TestStampPattern-702523091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12d0f070-ec10-4dc0-86f8-2e82e0a480c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a43636c-c09b-4e28-9677-4809934aaa98', 'volume_name': 'volume-0a43636c-c09b-4e28-9677-4809934aaa98', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:59 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d0726979-0e32-4c01-aa6e-0b27ccbf7002 tempest-TestStampPattern-702523091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46bd66f2-4342-4be5-a89a-ae2f3e6d2984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:59 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d0726979-0e32-4c01-aa6e-0b27ccbf7002 tempest-TestStampPattern-702523091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46bd66f2-4342-4be5-a89a-ae2f3e6d2984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:31:59 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d0726979-0e32-4c01-aa6e-0b27ccbf7002 tempest-TestStampPattern-702523091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9f8a4a7-4174-4bef-9ed6-2e341df14b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:31:59 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-d0726979-0e32-4c01-aa6e-0b27ccbf7002 tempest-TestStampPattern-702523091 None] Volume 0a43636c-c09b-4e28-9677-4809934aaa98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a43636c-c09b-4e28-9677-4809934aaa98', 'volume_size': 1} Nov 03 20:31:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d0726979-0e32-4c01-aa6e-0b27ccbf7002 tempest-TestStampPattern-702523091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d0726979-0e32-4c01-aa6e-0b27ccbf7002 tempest-TestStampPattern-702523091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:59 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-d0726979-0e32-4c01-aa6e-0b27ccbf7002 tempest-TestStampPattern-702523091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2146821931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a43636c-c09b-4e28-9677-4809934aaa98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47b9476691b4455a88048666dfdb475e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:32:00Z,use_quota=True,user_id='2bf3ce54ed3a4ed4b06bcdba8f2d74ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:31:59 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-d0726979-0e32-4c01-aa6e-0b27ccbf7002 tempest-TestStampPattern-702523091 None] Creating volume 0a43636c-c09b-4e28-9677-4809934aaa98 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:31:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d0726979-0e32-4c01-aa6e-0b27ccbf7002 tempest-TestStampPattern-702523091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:31:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d0726979-0e32-4c01-aa6e-0b27ccbf7002 tempest-TestStampPattern-702523091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:31:59 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-d0726979-0e32-4c01-aa6e-0b27ccbf7002 tempest-TestStampPattern-702523091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:31:59 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-d0726979-0e32-4c01-aa6e-0b27ccbf7002 tempest-TestStampPattern-702523091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:31:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d0726979-0e32-4c01-aa6e-0b27ccbf7002 tempest-TestStampPattern-702523091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:31:59 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-d0726979-0e32-4c01-aa6e-0b27ccbf7002 tempest-TestStampPattern-702523091 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:31:59 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-d0726979-0e32-4c01-aa6e-0b27ccbf7002 tempest-TestStampPattern-702523091 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:31:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d0726979-0e32-4c01-aa6e-0b27ccbf7002 tempest-TestStampPattern-702523091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:31:59 devstack sudo[102982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98 1073741824 Nov 03 20:31:59 devstack sudo[102982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:31:59 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-2512c79d-0505-4928-a873-9e2cb3322a1d tempest-ProjectReaderTests-1119053767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:32:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2512c79d-0505-4928-a873-9e2cb3322a1d tempest-ProjectReaderTests-1119053767 None] Flow 'volume_create_manager' (fe97d766-e925-4886-a398-25ca54be677c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:32:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2512c79d-0505-4928-a873-9e2cb3322a1d tempest-ProjectReaderTests-1119053767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a7feab8-2079-4565-836c-302ac032bca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2512c79d-0505-4928-a873-9e2cb3322a1d tempest-ProjectReaderTests-1119053767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a7feab8-2079-4565-836c-302ac032bca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1266709635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46f43eb9-3a93-4002-9edf-4be246659a12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f33b162d06a4871851975255221660f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:32:00Z,use_quota=True,user_id='fdf0007b72b349dc923b487190622a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2512c79d-0505-4928-a873-9e2cb3322a1d tempest-ProjectReaderTests-1119053767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4456e16b-04ff-4a88-aa6b-d69f2bce47f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2512c79d-0505-4928-a873-9e2cb3322a1d tempest-ProjectReaderTests-1119053767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4456e16b-04ff-4a88-aa6b-d69f2bce47f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2512c79d-0505-4928-a873-9e2cb3322a1d tempest-ProjectReaderTests-1119053767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53b35704-e857-4fb8-8fa3-47943b9116d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2512c79d-0505-4928-a873-9e2cb3322a1d tempest-ProjectReaderTests-1119053767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53b35704-e857-4fb8-8fa3-47943b9116d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46f43eb9-3a93-4002-9edf-4be246659a12', 'volume_name': 'volume-46f43eb9-3a93-4002-9edf-4be246659a12', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2512c79d-0505-4928-a873-9e2cb3322a1d tempest-ProjectReaderTests-1119053767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7433dab0-32b8-45cf-827d-b95a516d825a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2512c79d-0505-4928-a873-9e2cb3322a1d tempest-ProjectReaderTests-1119053767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7433dab0-32b8-45cf-827d-b95a516d825a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2512c79d-0505-4928-a873-9e2cb3322a1d tempest-ProjectReaderTests-1119053767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ee3665-fcb8-4ea8-b8a7-65fd96203940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:00 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-2512c79d-0505-4928-a873-9e2cb3322a1d tempest-ProjectReaderTests-1119053767 None] Volume 46f43eb9-3a93-4002-9edf-4be246659a12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46f43eb9-3a93-4002-9edf-4be246659a12', 'volume_size': 1} Nov 03 20:32:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2512c79d-0505-4928-a873-9e2cb3322a1d tempest-ProjectReaderTests-1119053767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:00 devstack sudo[102982]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d0726979-0e32-4c01-aa6e-0b27ccbf7002 tempest-TestStampPattern-702523091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98 1073741824" returned: 0 in 0.595s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d0726979-0e32-4c01-aa6e-0b27ccbf7002 tempest-TestStampPattern-702523091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:00 devstack sudo[102988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98 Nov 03 20:32:00 devstack sudo[102988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:00 devstack sudo[102988]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d0726979-0e32-4c01-aa6e-0b27ccbf7002 tempest-TestStampPattern-702523091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98" returned: 0 in 0.326s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:00 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-d0726979-0e32-4c01-aa6e-0b27ccbf7002 tempest-TestStampPattern-702523091 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:32:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d0726979-0e32-4c01-aa6e-0b27ccbf7002 tempest-TestStampPattern-702523091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2512c79d-0505-4928-a873-9e2cb3322a1d tempest-ProjectReaderTests-1119053767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.776s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:00 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2512c79d-0505-4928-a873-9e2cb3322a1d tempest-ProjectReaderTests-1119053767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1266709635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46f43eb9-3a93-4002-9edf-4be246659a12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f33b162d06a4871851975255221660f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:32:00Z,use_quota=True,user_id='fdf0007b72b349dc923b487190622a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:32:00 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-2512c79d-0505-4928-a873-9e2cb3322a1d tempest-ProjectReaderTests-1119053767 None] Creating volume 46f43eb9-3a93-4002-9edf-4be246659a12 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:32:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2512c79d-0505-4928-a873-9e2cb3322a1d tempest-ProjectReaderTests-1119053767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2512c79d-0505-4928-a873-9e2cb3322a1d tempest-ProjectReaderTests-1119053767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:00 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2512c79d-0505-4928-a873-9e2cb3322a1d tempest-ProjectReaderTests-1119053767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:32:00 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2512c79d-0505-4928-a873-9e2cb3322a1d tempest-ProjectReaderTests-1119053767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:32:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2512c79d-0505-4928-a873-9e2cb3322a1d tempest-ProjectReaderTests-1119053767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:00 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2512c79d-0505-4928-a873-9e2cb3322a1d tempest-ProjectReaderTests-1119053767 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:32:00 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-2512c79d-0505-4928-a873-9e2cb3322a1d tempest-ProjectReaderTests-1119053767 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:32:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2512c79d-0505-4928-a873-9e2cb3322a1d tempest-ProjectReaderTests-1119053767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-46f43eb9-3a93-4002-9edf-4be246659a12 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d0726979-0e32-4c01-aa6e-0b27ccbf7002 tempest-TestStampPattern-702523091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9f8a4a7-4174-4bef-9ed6-2e341df14b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a43636c-c09b-4e28-9677-4809934aaa98', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:00 devstack sudo[102994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-46f43eb9-3a93-4002-9edf-4be246659a12 1073741824 Nov 03 20:32:00 devstack sudo[102994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d0726979-0e32-4c01-aa6e-0b27ccbf7002 tempest-TestStampPattern-702523091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fb550a0-1139-4d41-bb10-10cf855ffadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:00 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-d0726979-0e32-4c01-aa6e-0b27ccbf7002 tempest-TestStampPattern-702523091 None] Volume volume-0a43636c-c09b-4e28-9677-4809934aaa98 (0a43636c-c09b-4e28-9677-4809934aaa98): created successfully Nov 03 20:32:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d0726979-0e32-4c01-aa6e-0b27ccbf7002 tempest-TestStampPattern-702523091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fb550a0-1139-4d41-bb10-10cf855ffadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d0726979-0e32-4c01-aa6e-0b27ccbf7002 tempest-TestStampPattern-702523091 None] Flow 'volume_create_manager' (aec4e364-2d9a-4531-8bd1-2de348c6fd13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:32:00 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-d0726979-0e32-4c01-aa6e-0b27ccbf7002 tempest-TestStampPattern-702523091 None] Created volume successfully. Nov 03 20:32:01 devstack sudo[102994]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2512c79d-0505-4928-a873-9e2cb3322a1d tempest-ProjectReaderTests-1119053767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-46f43eb9-3a93-4002-9edf-4be246659a12 1073741824" returned: 0 in 0.527s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2512c79d-0505-4928-a873-9e2cb3322a1d tempest-ProjectReaderTests-1119053767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-46f43eb9-3a93-4002-9edf-4be246659a12 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:01 devstack sudo[102999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-46f43eb9-3a93-4002-9edf-4be246659a12 Nov 03 20:32:01 devstack sudo[102999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:01 devstack sudo[102999]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2512c79d-0505-4928-a873-9e2cb3322a1d tempest-ProjectReaderTests-1119053767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-46f43eb9-3a93-4002-9edf-4be246659a12" returned: 0 in 0.313s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:01 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2512c79d-0505-4928-a873-9e2cb3322a1d tempest-ProjectReaderTests-1119053767 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:32:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2512c79d-0505-4928-a873-9e2cb3322a1d tempest-ProjectReaderTests-1119053767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2512c79d-0505-4928-a873-9e2cb3322a1d tempest-ProjectReaderTests-1119053767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ee3665-fcb8-4ea8-b8a7-65fd96203940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46f43eb9-3a93-4002-9edf-4be246659a12', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2512c79d-0505-4928-a873-9e2cb3322a1d tempest-ProjectReaderTests-1119053767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c1de53b-c21f-43a1-aa43-0ded50d927e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:01 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-2512c79d-0505-4928-a873-9e2cb3322a1d tempest-ProjectReaderTests-1119053767 None] Volume volume-46f43eb9-3a93-4002-9edf-4be246659a12 (46f43eb9-3a93-4002-9edf-4be246659a12): created successfully Nov 03 20:32:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2512c79d-0505-4928-a873-9e2cb3322a1d tempest-ProjectReaderTests-1119053767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c1de53b-c21f-43a1-aa43-0ded50d927e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2512c79d-0505-4928-a873-9e2cb3322a1d tempest-ProjectReaderTests-1119053767 None] Flow 'volume_create_manager' (fe97d766-e925-4886-a398-25ca54be677c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:32:01 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-2512c79d-0505-4928-a873-9e2cb3322a1d tempest-ProjectReaderTests-1119053767 None] Created volume successfully. Nov 03 20:32:02 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e62aac81-4137-426b-81f8-7abd6c821a6a tempest-ProjectReaderTests-1119053767 None] Acquiring lock "cinder-46f43eb9-3a93-4002-9edf-4be246659a12-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:32:02 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e62aac81-4137-426b-81f8-7abd6c821a6a tempest-ProjectReaderTests-1119053767 None] Lock "cinder-46f43eb9-3a93-4002-9edf-4be246659a12-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:32:02 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e62aac81-4137-426b-81f8-7abd6c821a6a tempest-ProjectReaderTests-1119053767 None] Acquiring lock "cinder-quobyte-46f43eb9-3a93-4002-9edf-4be246659a12" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:32:02 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e62aac81-4137-426b-81f8-7abd6c821a6a tempest-ProjectReaderTests-1119053767 None] Lock "cinder-quobyte-46f43eb9-3a93-4002-9edf-4be246659a12" acquired by "delete_volume" :: waited 0.024s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:32:02 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[4247330b-94d3-42e6-a7e4-2bc0c6ae87ac]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:32:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e62aac81-4137-426b-81f8-7abd6c821a6a tempest-ProjectReaderTests-1119053767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-46f43eb9-3a93-4002-9edf-4be246659a12 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:02 devstack sudo[103006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-46f43eb9-3a93-4002-9edf-4be246659a12 Nov 03 20:32:02 devstack sudo[103006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:02 devstack sudo[103006]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e62aac81-4137-426b-81f8-7abd6c821a6a tempest-ProjectReaderTests-1119053767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-46f43eb9-3a93-4002-9edf-4be246659a12" returned: 0 in 0.498s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e62aac81-4137-426b-81f8-7abd6c821a6a tempest-ProjectReaderTests-1119053767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-46f43eb9-3a93-4002-9edf-4be246659a12 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:02 devstack sudo[103022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-46f43eb9-3a93-4002-9edf-4be246659a12 Nov 03 20:32:02 devstack sudo[103022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:03 devstack sudo[103022]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e62aac81-4137-426b-81f8-7abd6c821a6a tempest-ProjectReaderTests-1119053767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-46f43eb9-3a93-4002-9edf-4be246659a12" returned: 0 in 0.329s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:03 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e62aac81-4137-426b-81f8-7abd6c821a6a tempest-ProjectReaderTests-1119053767 None] Lock "cinder-quobyte-46f43eb9-3a93-4002-9edf-4be246659a12" released by "delete_volume" :: held 0.920s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:32:03 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-e62aac81-4137-426b-81f8-7abd6c821a6a tempest-ProjectReaderTests-1119053767 None] Created reservations ['cd9952fc-0461-407b-bf3d-694fca16eee5', '5e0d605d-2762-4869-ba85-4b30c149a15b', '5c0d2f4b-3562-406d-b17e-11f4f3363ab9', '881a7707-1c7e-4088-ab62-238f219aff55'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:32:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e62aac81-4137-426b-81f8-7abd6c821a6a tempest-ProjectReaderTests-1119053767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e62aac81-4137-426b-81f8-7abd6c821a6a tempest-ProjectReaderTests-1119053767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:03 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e62aac81-4137-426b-81f8-7abd6c821a6a tempest-ProjectReaderTests-1119053767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:32:03 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e62aac81-4137-426b-81f8-7abd6c821a6a tempest-ProjectReaderTests-1119053767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:32:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e62aac81-4137-426b-81f8-7abd6c821a6a tempest-ProjectReaderTests-1119053767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e62aac81-4137-426b-81f8-7abd6c821a6a tempest-ProjectReaderTests-1119053767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:03 devstack sudo[103037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:32:03 devstack sudo[103037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:03 devstack sudo[103037]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e62aac81-4137-426b-81f8-7abd6c821a6a tempest-ProjectReaderTests-1119053767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.330s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:03 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-e62aac81-4137-426b-81f8-7abd6c821a6a tempest-ProjectReaderTests-1119053767 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:32:03 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-e62aac81-4137-426b-81f8-7abd6c821a6a tempest-ProjectReaderTests-1119053767 None] Deleted volume successfully. Nov 03 20:32:03 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e62aac81-4137-426b-81f8-7abd6c821a6a tempest-ProjectReaderTests-1119053767 None] Lock "cinder-46f43eb9-3a93-4002-9edf-4be246659a12-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:32:05 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-68181dba-7b21-4937-9c30-b3090eab7cda tempest-ProjectReaderTests-1119053767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:32:05 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-68181dba-7b21-4937-9c30-b3090eab7cda tempest-ProjectReaderTests-1119053767 None] Flow 'volume_create_manager' (f8160612-5961-4814-b602-7179514234b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:32:05 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-68181dba-7b21-4937-9c30-b3090eab7cda tempest-ProjectReaderTests-1119053767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33931cd8-c62e-46b9-b929-7c968b92fe41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:05 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-68181dba-7b21-4937-9c30-b3090eab7cda tempest-ProjectReaderTests-1119053767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33931cd8-c62e-46b9-b929-7c968b92fe41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-213361019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82394dbd-a7b8-4e03-ae79-412a864e4ddd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f33b162d06a4871851975255221660f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:32:05Z,use_quota=True,user_id='fdf0007b72b349dc923b487190622a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:05 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-68181dba-7b21-4937-9c30-b3090eab7cda tempest-ProjectReaderTests-1119053767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (594ba442-1b68-4c7f-8e02-a33695fbc900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:05 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-68181dba-7b21-4937-9c30-b3090eab7cda tempest-ProjectReaderTests-1119053767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (594ba442-1b68-4c7f-8e02-a33695fbc900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:05 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-68181dba-7b21-4937-9c30-b3090eab7cda tempest-ProjectReaderTests-1119053767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2752134c-db36-4fbd-a128-4da6a6e60fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:05 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-68181dba-7b21-4937-9c30-b3090eab7cda tempest-ProjectReaderTests-1119053767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2752134c-db36-4fbd-a128-4da6a6e60fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82394dbd-a7b8-4e03-ae79-412a864e4ddd', 'volume_name': 'volume-82394dbd-a7b8-4e03-ae79-412a864e4ddd', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:05 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-68181dba-7b21-4937-9c30-b3090eab7cda tempest-ProjectReaderTests-1119053767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56c36041-16f9-4d5f-879f-3835c5560258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:05 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-68181dba-7b21-4937-9c30-b3090eab7cda tempest-ProjectReaderTests-1119053767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56c36041-16f9-4d5f-879f-3835c5560258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:05 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-68181dba-7b21-4937-9c30-b3090eab7cda tempest-ProjectReaderTests-1119053767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfe3b67d-5574-4e68-9b3d-7f041c1b83e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:05 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-68181dba-7b21-4937-9c30-b3090eab7cda tempest-ProjectReaderTests-1119053767 None] Volume 82394dbd-a7b8-4e03-ae79-412a864e4ddd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82394dbd-a7b8-4e03-ae79-412a864e4ddd', 'volume_size': 1} Nov 03 20:32:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-68181dba-7b21-4937-9c30-b3090eab7cda tempest-ProjectReaderTests-1119053767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-68181dba-7b21-4937-9c30-b3090eab7cda tempest-ProjectReaderTests-1119053767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:05 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-68181dba-7b21-4937-9c30-b3090eab7cda tempest-ProjectReaderTests-1119053767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-213361019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82394dbd-a7b8-4e03-ae79-412a864e4ddd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f33b162d06a4871851975255221660f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:32:05Z,use_quota=True,user_id='fdf0007b72b349dc923b487190622a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:32:05 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-68181dba-7b21-4937-9c30-b3090eab7cda tempest-ProjectReaderTests-1119053767 None] Creating volume 82394dbd-a7b8-4e03-ae79-412a864e4ddd {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:32:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-68181dba-7b21-4937-9c30-b3090eab7cda tempest-ProjectReaderTests-1119053767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-68181dba-7b21-4937-9c30-b3090eab7cda tempest-ProjectReaderTests-1119053767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:05 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-68181dba-7b21-4937-9c30-b3090eab7cda tempest-ProjectReaderTests-1119053767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:32:05 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-68181dba-7b21-4937-9c30-b3090eab7cda tempest-ProjectReaderTests-1119053767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:32:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-68181dba-7b21-4937-9c30-b3090eab7cda tempest-ProjectReaderTests-1119053767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:05 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-68181dba-7b21-4937-9c30-b3090eab7cda tempest-ProjectReaderTests-1119053767 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:32:05 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-68181dba-7b21-4937-9c30-b3090eab7cda tempest-ProjectReaderTests-1119053767 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:32:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-68181dba-7b21-4937-9c30-b3090eab7cda tempest-ProjectReaderTests-1119053767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-82394dbd-a7b8-4e03-ae79-412a864e4ddd 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:05 devstack sudo[103056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-82394dbd-a7b8-4e03-ae79-412a864e4ddd 1073741824 Nov 03 20:32:05 devstack sudo[103056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:05 devstack sudo[103056]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-68181dba-7b21-4937-9c30-b3090eab7cda tempest-ProjectReaderTests-1119053767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-82394dbd-a7b8-4e03-ae79-412a864e4ddd 1073741824" returned: 0 in 0.573s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-68181dba-7b21-4937-9c30-b3090eab7cda tempest-ProjectReaderTests-1119053767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-82394dbd-a7b8-4e03-ae79-412a864e4ddd {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:05 devstack sudo[103063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-82394dbd-a7b8-4e03-ae79-412a864e4ddd Nov 03 20:32:05 devstack sudo[103063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:06 devstack sudo[103063]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-68181dba-7b21-4937-9c30-b3090eab7cda tempest-ProjectReaderTests-1119053767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-82394dbd-a7b8-4e03-ae79-412a864e4ddd" returned: 0 in 0.342s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-68181dba-7b21-4937-9c30-b3090eab7cda tempest-ProjectReaderTests-1119053767 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:32:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-68181dba-7b21-4937-9c30-b3090eab7cda tempest-ProjectReaderTests-1119053767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-68181dba-7b21-4937-9c30-b3090eab7cda tempest-ProjectReaderTests-1119053767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfe3b67d-5574-4e68-9b3d-7f041c1b83e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82394dbd-a7b8-4e03-ae79-412a864e4ddd', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-68181dba-7b21-4937-9c30-b3090eab7cda tempest-ProjectReaderTests-1119053767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c9b7ccf-8041-4d14-bc5c-d34464a2a81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:06 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-68181dba-7b21-4937-9c30-b3090eab7cda tempest-ProjectReaderTests-1119053767 None] Volume volume-82394dbd-a7b8-4e03-ae79-412a864e4ddd (82394dbd-a7b8-4e03-ae79-412a864e4ddd): created successfully Nov 03 20:32:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-68181dba-7b21-4937-9c30-b3090eab7cda tempest-ProjectReaderTests-1119053767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c9b7ccf-8041-4d14-bc5c-d34464a2a81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-68181dba-7b21-4937-9c30-b3090eab7cda tempest-ProjectReaderTests-1119053767 None] Flow 'volume_create_manager' (f8160612-5961-4814-b602-7179514234b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:32:06 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-68181dba-7b21-4937-9c30-b3090eab7cda tempest-ProjectReaderTests-1119053767 None] Created volume successfully. Nov 03 20:32:07 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-95202bfb-d116-4fea-9e27-5a17086aad11 tempest-ProjectReaderTests-1119053767 None] Acquiring lock "cinder-82394dbd-a7b8-4e03-ae79-412a864e4ddd-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:32:07 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-95202bfb-d116-4fea-9e27-5a17086aad11 tempest-ProjectReaderTests-1119053767 None] Lock "cinder-82394dbd-a7b8-4e03-ae79-412a864e4ddd-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:32:07 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-95202bfb-d116-4fea-9e27-5a17086aad11 tempest-ProjectReaderTests-1119053767 None] Acquiring lock "cinder-quobyte-82394dbd-a7b8-4e03-ae79-412a864e4ddd" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:32:07 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-95202bfb-d116-4fea-9e27-5a17086aad11 tempest-ProjectReaderTests-1119053767 None] Lock "cinder-quobyte-82394dbd-a7b8-4e03-ae79-412a864e4ddd" acquired by "delete_volume" :: waited 0.015s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:32:07 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[39331356-f8e5-43fb-98e6-a008f0988bf5]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:32:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-95202bfb-d116-4fea-9e27-5a17086aad11 tempest-ProjectReaderTests-1119053767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-82394dbd-a7b8-4e03-ae79-412a864e4ddd {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:08 devstack sudo[103156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-82394dbd-a7b8-4e03-ae79-412a864e4ddd Nov 03 20:32:08 devstack sudo[103156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:08 devstack sudo[103156]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-95202bfb-d116-4fea-9e27-5a17086aad11 tempest-ProjectReaderTests-1119053767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-82394dbd-a7b8-4e03-ae79-412a864e4ddd" returned: 0 in 0.620s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-95202bfb-d116-4fea-9e27-5a17086aad11 tempest-ProjectReaderTests-1119053767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-82394dbd-a7b8-4e03-ae79-412a864e4ddd {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:08 devstack sudo[103176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-82394dbd-a7b8-4e03-ae79-412a864e4ddd Nov 03 20:32:08 devstack sudo[103176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:08 devstack sudo[103176]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-95202bfb-d116-4fea-9e27-5a17086aad11 tempest-ProjectReaderTests-1119053767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-82394dbd-a7b8-4e03-ae79-412a864e4ddd" returned: 0 in 0.459s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:08 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-95202bfb-d116-4fea-9e27-5a17086aad11 tempest-ProjectReaderTests-1119053767 None] Lock "cinder-quobyte-82394dbd-a7b8-4e03-ae79-412a864e4ddd" released by "delete_volume" :: held 1.206s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:32:09 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-95202bfb-d116-4fea-9e27-5a17086aad11 tempest-ProjectReaderTests-1119053767 None] Created reservations ['7ec474a2-f2eb-4081-ae58-dbb2a8b41269', '9085cd0d-cb48-4b42-ab35-c74d458b050f', '24b35e7f-d821-4b01-bb35-0fcbc8fe23e9', '82f2e48a-f70a-4b98-a260-35e1a22d8e4a'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:32:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-95202bfb-d116-4fea-9e27-5a17086aad11 tempest-ProjectReaderTests-1119053767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-95202bfb-d116-4fea-9e27-5a17086aad11 tempest-ProjectReaderTests-1119053767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:09 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-95202bfb-d116-4fea-9e27-5a17086aad11 tempest-ProjectReaderTests-1119053767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:32:09 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-95202bfb-d116-4fea-9e27-5a17086aad11 tempest-ProjectReaderTests-1119053767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:32:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-95202bfb-d116-4fea-9e27-5a17086aad11 tempest-ProjectReaderTests-1119053767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-95202bfb-d116-4fea-9e27-5a17086aad11 tempest-ProjectReaderTests-1119053767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:09 devstack sudo[103200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:32:09 devstack sudo[103200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:10 devstack sudo[103200]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-95202bfb-d116-4fea-9e27-5a17086aad11 tempest-ProjectReaderTests-1119053767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.754s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:10 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-95202bfb-d116-4fea-9e27-5a17086aad11 tempest-ProjectReaderTests-1119053767 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:32:10 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-95202bfb-d116-4fea-9e27-5a17086aad11 tempest-ProjectReaderTests-1119053767 None] Deleted volume successfully. Nov 03 20:32:10 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-95202bfb-d116-4fea-9e27-5a17086aad11 tempest-ProjectReaderTests-1119053767 None] Lock "cinder-82394dbd-a7b8-4e03-ae79-412a864e4ddd-delete_volume" released by "delete_volume" :: held 2.614s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:32:12 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-265146aa-6a7e-4b56-bf2a-e97e647f032b tempest-VolumesActionsTest-815521375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:32:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-265146aa-6a7e-4b56-bf2a-e97e647f032b tempest-VolumesActionsTest-815521375 None] Flow 'volume_create_manager' (04afdbf4-1ef8-49f6-a053-c079d586e34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:32:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-265146aa-6a7e-4b56-bf2a-e97e647f032b tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0819ec0-a8e7-4b04-a6ae-6dc18cc7e221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-265146aa-6a7e-4b56-bf2a-e97e647f032b tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0819ec0-a8e7-4b04-a6ae-6dc18cc7e221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-270032747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3841f85-0f88-40c3-aa07-18ddcd70e694,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdfde9853c8e4d66a631042200334251',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:32:12Z,use_quota=True,user_id='a5a8e0481bdf44e4aeec8e8ea79feca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-265146aa-6a7e-4b56-bf2a-e97e647f032b tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82b6c591-d255-4587-8b16-b7d32bb79127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-265146aa-6a7e-4b56-bf2a-e97e647f032b tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82b6c591-d255-4587-8b16-b7d32bb79127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-265146aa-6a7e-4b56-bf2a-e97e647f032b tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3969fce-8e86-4d70-b083-7b211df06a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-265146aa-6a7e-4b56-bf2a-e97e647f032b tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3969fce-8e86-4d70-b083-7b211df06a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3841f85-0f88-40c3-aa07-18ddcd70e694', 'volume_name': 'volume-a3841f85-0f88-40c3-aa07-18ddcd70e694', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-265146aa-6a7e-4b56-bf2a-e97e647f032b tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1876c74-6554-482c-9606-db0e61333506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-265146aa-6a7e-4b56-bf2a-e97e647f032b tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1876c74-6554-482c-9606-db0e61333506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-265146aa-6a7e-4b56-bf2a-e97e647f032b tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3176840-21ac-4fbe-8473-739da8a2f12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:12 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-265146aa-6a7e-4b56-bf2a-e97e647f032b tempest-VolumesActionsTest-815521375 None] Volume a3841f85-0f88-40c3-aa07-18ddcd70e694: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3841f85-0f88-40c3-aa07-18ddcd70e694', 'volume_size': 1} Nov 03 20:32:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-265146aa-6a7e-4b56-bf2a-e97e647f032b tempest-VolumesActionsTest-815521375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-265146aa-6a7e-4b56-bf2a-e97e647f032b tempest-VolumesActionsTest-815521375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:12 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-265146aa-6a7e-4b56-bf2a-e97e647f032b tempest-VolumesActionsTest-815521375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-270032747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3841f85-0f88-40c3-aa07-18ddcd70e694,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdfde9853c8e4d66a631042200334251',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:32:12Z,use_quota=True,user_id='a5a8e0481bdf44e4aeec8e8ea79feca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:32:12 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-265146aa-6a7e-4b56-bf2a-e97e647f032b tempest-VolumesActionsTest-815521375 None] Creating volume a3841f85-0f88-40c3-aa07-18ddcd70e694 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:32:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-265146aa-6a7e-4b56-bf2a-e97e647f032b tempest-VolumesActionsTest-815521375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-265146aa-6a7e-4b56-bf2a-e97e647f032b tempest-VolumesActionsTest-815521375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:12 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-265146aa-6a7e-4b56-bf2a-e97e647f032b tempest-VolumesActionsTest-815521375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:32:12 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-265146aa-6a7e-4b56-bf2a-e97e647f032b tempest-VolumesActionsTest-815521375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:32:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-265146aa-6a7e-4b56-bf2a-e97e647f032b tempest-VolumesActionsTest-815521375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:12 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-265146aa-6a7e-4b56-bf2a-e97e647f032b tempest-VolumesActionsTest-815521375 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:32:12 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-265146aa-6a7e-4b56-bf2a-e97e647f032b tempest-VolumesActionsTest-815521375 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:32:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-265146aa-6a7e-4b56-bf2a-e97e647f032b tempest-VolumesActionsTest-815521375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-a3841f85-0f88-40c3-aa07-18ddcd70e694 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:12 devstack sudo[103244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-a3841f85-0f88-40c3-aa07-18ddcd70e694 1073741824 Nov 03 20:32:12 devstack sudo[103244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:13 devstack sudo[103244]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-265146aa-6a7e-4b56-bf2a-e97e647f032b tempest-VolumesActionsTest-815521375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-a3841f85-0f88-40c3-aa07-18ddcd70e694 1073741824" returned: 0 in 0.947s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-265146aa-6a7e-4b56-bf2a-e97e647f032b tempest-VolumesActionsTest-815521375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-a3841f85-0f88-40c3-aa07-18ddcd70e694 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:13 devstack sudo[103250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-a3841f85-0f88-40c3-aa07-18ddcd70e694 Nov 03 20:32:13 devstack sudo[103250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:13 devstack sudo[103250]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-265146aa-6a7e-4b56-bf2a-e97e647f032b tempest-VolumesActionsTest-815521375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-a3841f85-0f88-40c3-aa07-18ddcd70e694" returned: 0 in 0.437s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:13 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-265146aa-6a7e-4b56-bf2a-e97e647f032b tempest-VolumesActionsTest-815521375 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:32:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-265146aa-6a7e-4b56-bf2a-e97e647f032b tempest-VolumesActionsTest-815521375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-265146aa-6a7e-4b56-bf2a-e97e647f032b tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3176840-21ac-4fbe-8473-739da8a2f12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3841f85-0f88-40c3-aa07-18ddcd70e694', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-265146aa-6a7e-4b56-bf2a-e97e647f032b tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (967a0a1d-41e9-4cfe-952c-6a248aea78fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:13 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-265146aa-6a7e-4b56-bf2a-e97e647f032b tempest-VolumesActionsTest-815521375 None] Volume volume-a3841f85-0f88-40c3-aa07-18ddcd70e694 (a3841f85-0f88-40c3-aa07-18ddcd70e694): created successfully Nov 03 20:32:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-265146aa-6a7e-4b56-bf2a-e97e647f032b tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (967a0a1d-41e9-4cfe-952c-6a248aea78fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-265146aa-6a7e-4b56-bf2a-e97e647f032b tempest-VolumesActionsTest-815521375 None] Flow 'volume_create_manager' (04afdbf4-1ef8-49f6-a053-c079d586e34f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:32:13 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-265146aa-6a7e-4b56-bf2a-e97e647f032b tempest-VolumesActionsTest-815521375 None] Created volume successfully. Nov 03 20:32:14 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-cc7812ce-bb1b-476f-a167-15ccbf54b14e tempest-VolumesActionsTest-815521375 None] Acquiring lock "cinder-a3841f85-0f88-40c3-aa07-18ddcd70e694" by "attach_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:32:14 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-cc7812ce-bb1b-476f-a167-15ccbf54b14e tempest-VolumesActionsTest-815521375 None] Lock "cinder-a3841f85-0f88-40c3-aa07-18ddcd70e694" acquired by "attach_volume" :: waited 0.033s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:32:14 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-cc7812ce-bb1b-476f-a167-15ccbf54b14e tempest-VolumesActionsTest-815521375 None] Attaching volume a3841f85-0f88-40c3-aa07-18ddcd70e694 to instance f2fff5b6-7c7d-46d8-b06d-42ff98669dbd at mountpoint /dev/vdb on host None. Nov 03 20:32:14 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-cc7812ce-bb1b-476f-a167-15ccbf54b14e tempest-VolumesActionsTest-815521375 None] Attach volume completed successfully. Nov 03 20:32:14 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-cc7812ce-bb1b-476f-a167-15ccbf54b14e tempest-VolumesActionsTest-815521375 None] Lock "cinder-a3841f85-0f88-40c3-aa07-18ddcd70e694" released by "attach_volume" :: held 0.178s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:32:15 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-496aa8a2-5e53-4dcb-b92a-784957d3d2f1 tempest-VolumesActionsTest-1330627080 None] Terminate volume connection completed successfully. Nov 03 20:32:15 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-496aa8a2-5e53-4dcb-b92a-784957d3d2f1 tempest-VolumesActionsTest-1330627080 None] Acquiring lock "cinder-a3841f85-0f88-40c3-aa07-18ddcd70e694-detach_volume" by "detach_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:32:15 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-496aa8a2-5e53-4dcb-b92a-784957d3d2f1 tempest-VolumesActionsTest-1330627080 None] Lock "cinder-a3841f85-0f88-40c3-aa07-18ddcd70e694-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:32:15 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-496aa8a2-5e53-4dcb-b92a-784957d3d2f1 tempest-VolumesActionsTest-1330627080 None] Detaching volume a3841f85-0f88-40c3-aa07-18ddcd70e694 from instance f2fff5b6-7c7d-46d8-b06d-42ff98669dbd. Nov 03 20:32:15 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-496aa8a2-5e53-4dcb-b92a-784957d3d2f1 tempest-VolumesActionsTest-1330627080 None] Detach volume completed successfully. Nov 03 20:32:15 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-496aa8a2-5e53-4dcb-b92a-784957d3d2f1 tempest-VolumesActionsTest-1330627080 None] Lock "cinder-a3841f85-0f88-40c3-aa07-18ddcd70e694-detach_volume" released by "detach_volume" :: held 0.111s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:32:16 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d1b90de5-c7e0-4eb5-b03a-d7fa54a97b26 tempest-VolumesActionsTest-815521375 None] Acquiring lock "cinder-a3841f85-0f88-40c3-aa07-18ddcd70e694-detach_volume" by "detach_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:32:16 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d1b90de5-c7e0-4eb5-b03a-d7fa54a97b26 tempest-VolumesActionsTest-815521375 None] Lock "cinder-a3841f85-0f88-40c3-aa07-18ddcd70e694-detach_volume" acquired by "detach_volume" :: waited 0.041s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:32:16 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-d1b90de5-c7e0-4eb5-b03a-d7fa54a97b26 tempest-VolumesActionsTest-815521375 None] Volume detach called, but volume not attached. Nov 03 20:32:16 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d1b90de5-c7e0-4eb5-b03a-d7fa54a97b26 tempest-VolumesActionsTest-815521375 None] Lock "cinder-a3841f85-0f88-40c3-aa07-18ddcd70e694-detach_volume" released by "detach_volume" :: held 0.026s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:32:16 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-da40fa3c-4500-4d18-9386-98cb0b68d32c tempest-VolumesActionsTest-815521375 None] Acquiring lock "cinder-a3841f85-0f88-40c3-aa07-18ddcd70e694-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:32:16 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-da40fa3c-4500-4d18-9386-98cb0b68d32c tempest-VolumesActionsTest-815521375 None] Lock "cinder-a3841f85-0f88-40c3-aa07-18ddcd70e694-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:32:16 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-da40fa3c-4500-4d18-9386-98cb0b68d32c tempest-VolumesActionsTest-815521375 None] Acquiring lock "cinder-quobyte-a3841f85-0f88-40c3-aa07-18ddcd70e694" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:32:16 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-da40fa3c-4500-4d18-9386-98cb0b68d32c tempest-VolumesActionsTest-815521375 None] Lock "cinder-quobyte-a3841f85-0f88-40c3-aa07-18ddcd70e694" acquired by "delete_volume" :: waited 0.021s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:32:16 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd2e3da-fda4-4600-92b5-17d7f028669b]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:32:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-da40fa3c-4500-4d18-9386-98cb0b68d32c tempest-VolumesActionsTest-815521375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-a3841f85-0f88-40c3-aa07-18ddcd70e694 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:16 devstack sudo[103257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-a3841f85-0f88-40c3-aa07-18ddcd70e694 Nov 03 20:32:16 devstack sudo[103257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:16 devstack sudo[103257]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-da40fa3c-4500-4d18-9386-98cb0b68d32c tempest-VolumesActionsTest-815521375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-a3841f85-0f88-40c3-aa07-18ddcd70e694" returned: 0 in 0.376s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-da40fa3c-4500-4d18-9386-98cb0b68d32c tempest-VolumesActionsTest-815521375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-a3841f85-0f88-40c3-aa07-18ddcd70e694 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:16 devstack sudo[103262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-a3841f85-0f88-40c3-aa07-18ddcd70e694 Nov 03 20:32:16 devstack sudo[103262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:17 devstack sudo[103262]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-da40fa3c-4500-4d18-9386-98cb0b68d32c tempest-VolumesActionsTest-815521375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-a3841f85-0f88-40c3-aa07-18ddcd70e694" returned: 0 in 0.252s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:17 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-da40fa3c-4500-4d18-9386-98cb0b68d32c tempest-VolumesActionsTest-815521375 None] Lock "cinder-quobyte-a3841f85-0f88-40c3-aa07-18ddcd70e694" released by "delete_volume" :: held 0.677s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:32:17 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-da40fa3c-4500-4d18-9386-98cb0b68d32c tempest-VolumesActionsTest-815521375 None] Created reservations ['62c46dee-f4dc-44ce-8c76-f44dd559d921', '01c89724-aa89-48cb-89ef-e6fba2bf7e01', 'ad8cf60e-28e2-47a1-b9a4-ebcfa922e347', 'be1d0bb6-f8ef-42b8-b53f-595b040ab6a4'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:32:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-da40fa3c-4500-4d18-9386-98cb0b68d32c tempest-VolumesActionsTest-815521375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-da40fa3c-4500-4d18-9386-98cb0b68d32c tempest-VolumesActionsTest-815521375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:17 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-da40fa3c-4500-4d18-9386-98cb0b68d32c tempest-VolumesActionsTest-815521375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:32:17 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-da40fa3c-4500-4d18-9386-98cb0b68d32c tempest-VolumesActionsTest-815521375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:32:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-da40fa3c-4500-4d18-9386-98cb0b68d32c tempest-VolumesActionsTest-815521375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-da40fa3c-4500-4d18-9386-98cb0b68d32c tempest-VolumesActionsTest-815521375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:17 devstack sudo[103267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:32:17 devstack sudo[103267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:17 devstack sudo[103267]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-da40fa3c-4500-4d18-9386-98cb0b68d32c tempest-VolumesActionsTest-815521375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.314s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:17 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-da40fa3c-4500-4d18-9386-98cb0b68d32c tempest-VolumesActionsTest-815521375 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:32:17 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-da40fa3c-4500-4d18-9386-98cb0b68d32c tempest-VolumesActionsTest-815521375 None] Deleted volume successfully. Nov 03 20:32:17 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-da40fa3c-4500-4d18-9386-98cb0b68d32c tempest-VolumesActionsTest-815521375 None] Lock "cinder-a3841f85-0f88-40c3-aa07-18ddcd70e694-delete_volume" released by "delete_volume" :: held 1.279s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:32:20 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0ce760d-4034-4492-8cb5-d87f363e2b2f tempest-VolumesActionsTest-815521375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:32:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e0ce760d-4034-4492-8cb5-d87f363e2b2f tempest-VolumesActionsTest-815521375 None] Flow 'volume_create_manager' (6b63385e-29d9-4610-99be-8fbf4552bf16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:32:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e0ce760d-4034-4492-8cb5-d87f363e2b2f tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9987af93-2656-4938-8155-ce84fba709d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e0ce760d-4034-4492-8cb5-d87f363e2b2f tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9987af93-2656-4938-8155-ce84fba709d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-611871752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e529d6c-cff3-410c-a781-6e899f38f554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdfde9853c8e4d66a631042200334251',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:32:21Z,use_quota=True,user_id='a5a8e0481bdf44e4aeec8e8ea79feca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e0ce760d-4034-4492-8cb5-d87f363e2b2f tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f12035ec-c510-4acc-8a79-ed9a852b8240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e0ce760d-4034-4492-8cb5-d87f363e2b2f tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f12035ec-c510-4acc-8a79-ed9a852b8240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e0ce760d-4034-4492-8cb5-d87f363e2b2f tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75ed5dc4-a9b4-4f79-9da4-42ae97787472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e0ce760d-4034-4492-8cb5-d87f363e2b2f tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75ed5dc4-a9b4-4f79-9da4-42ae97787472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e529d6c-cff3-410c-a781-6e899f38f554', 'volume_name': 'volume-2e529d6c-cff3-410c-a781-6e899f38f554', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:21 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e0ce760d-4034-4492-8cb5-d87f363e2b2f tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (223f4fa4-27f3-4623-b977-c445411886e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:21 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e0ce760d-4034-4492-8cb5-d87f363e2b2f tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (223f4fa4-27f3-4623-b977-c445411886e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:21 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e0ce760d-4034-4492-8cb5-d87f363e2b2f tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69216f05-dfb5-42af-84bf-57b7b402c08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:21 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-e0ce760d-4034-4492-8cb5-d87f363e2b2f tempest-VolumesActionsTest-815521375 None] Volume 2e529d6c-cff3-410c-a781-6e899f38f554: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e529d6c-cff3-410c-a781-6e899f38f554', 'volume_size': 1} Nov 03 20:32:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e0ce760d-4034-4492-8cb5-d87f363e2b2f tempest-VolumesActionsTest-815521375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e0ce760d-4034-4492-8cb5-d87f363e2b2f tempest-VolumesActionsTest-815521375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e0ce760d-4034-4492-8cb5-d87f363e2b2f tempest-VolumesActionsTest-815521375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-611871752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e529d6c-cff3-410c-a781-6e899f38f554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdfde9853c8e4d66a631042200334251',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:32:21Z,use_quota=True,user_id='a5a8e0481bdf44e4aeec8e8ea79feca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:32:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-e0ce760d-4034-4492-8cb5-d87f363e2b2f tempest-VolumesActionsTest-815521375 None] Creating volume 2e529d6c-cff3-410c-a781-6e899f38f554 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:32:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e0ce760d-4034-4492-8cb5-d87f363e2b2f tempest-VolumesActionsTest-815521375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e0ce760d-4034-4492-8cb5-d87f363e2b2f tempest-VolumesActionsTest-815521375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e0ce760d-4034-4492-8cb5-d87f363e2b2f tempest-VolumesActionsTest-815521375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:32:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e0ce760d-4034-4492-8cb5-d87f363e2b2f tempest-VolumesActionsTest-815521375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:32:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e0ce760d-4034-4492-8cb5-d87f363e2b2f tempest-VolumesActionsTest-815521375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e0ce760d-4034-4492-8cb5-d87f363e2b2f tempest-VolumesActionsTest-815521375 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:32:21 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-e0ce760d-4034-4492-8cb5-d87f363e2b2f tempest-VolumesActionsTest-815521375 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:32:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e0ce760d-4034-4492-8cb5-d87f363e2b2f tempest-VolumesActionsTest-815521375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2e529d6c-cff3-410c-a781-6e899f38f554 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:21 devstack sudo[103295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2e529d6c-cff3-410c-a781-6e899f38f554 1073741824 Nov 03 20:32:21 devstack sudo[103295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:21 devstack sudo[103295]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e0ce760d-4034-4492-8cb5-d87f363e2b2f tempest-VolumesActionsTest-815521375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2e529d6c-cff3-410c-a781-6e899f38f554 1073741824" returned: 0 in 0.416s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e0ce760d-4034-4492-8cb5-d87f363e2b2f tempest-VolumesActionsTest-815521375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2e529d6c-cff3-410c-a781-6e899f38f554 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:21 devstack sudo[103300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2e529d6c-cff3-410c-a781-6e899f38f554 Nov 03 20:32:21 devstack sudo[103300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:21 devstack sudo[103300]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e0ce760d-4034-4492-8cb5-d87f363e2b2f tempest-VolumesActionsTest-815521375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2e529d6c-cff3-410c-a781-6e899f38f554" returned: 0 in 0.253s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e0ce760d-4034-4492-8cb5-d87f363e2b2f tempest-VolumesActionsTest-815521375 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:32:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e0ce760d-4034-4492-8cb5-d87f363e2b2f tempest-VolumesActionsTest-815521375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:21 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e0ce760d-4034-4492-8cb5-d87f363e2b2f tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69216f05-dfb5-42af-84bf-57b7b402c08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e529d6c-cff3-410c-a781-6e899f38f554', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:21 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e0ce760d-4034-4492-8cb5-d87f363e2b2f tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eceec3c-fd06-415f-86b6-984a168653fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:21 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-e0ce760d-4034-4492-8cb5-d87f363e2b2f tempest-VolumesActionsTest-815521375 None] Volume volume-2e529d6c-cff3-410c-a781-6e899f38f554 (2e529d6c-cff3-410c-a781-6e899f38f554): created successfully Nov 03 20:32:21 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e0ce760d-4034-4492-8cb5-d87f363e2b2f tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eceec3c-fd06-415f-86b6-984a168653fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:21 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e0ce760d-4034-4492-8cb5-d87f363e2b2f tempest-VolumesActionsTest-815521375 None] Flow 'volume_create_manager' (6b63385e-29d9-4610-99be-8fbf4552bf16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:32:21 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-e0ce760d-4034-4492-8cb5-d87f363e2b2f tempest-VolumesActionsTest-815521375 None] Created volume successfully. Nov 03 20:32:22 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a1f4d4a1-8038-4edd-9dec-8131df2af0b9 tempest-VolumesActionsTest-1330627080 None] Acquiring lock "cinder-2e529d6c-cff3-410c-a781-6e899f38f554-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:32:22 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a1f4d4a1-8038-4edd-9dec-8131df2af0b9 tempest-VolumesActionsTest-1330627080 None] Lock "cinder-2e529d6c-cff3-410c-a781-6e899f38f554-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:32:22 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a1f4d4a1-8038-4edd-9dec-8131df2af0b9 tempest-VolumesActionsTest-1330627080 None] Acquiring lock "cinder-quobyte-2e529d6c-cff3-410c-a781-6e899f38f554" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:32:22 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a1f4d4a1-8038-4edd-9dec-8131df2af0b9 tempest-VolumesActionsTest-1330627080 None] Lock "cinder-quobyte-2e529d6c-cff3-410c-a781-6e899f38f554" acquired by "delete_volume" :: waited 0.017s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:32:22 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[69175090-3b5e-4b4e-ba91-7f1253280d2e]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:32:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a1f4d4a1-8038-4edd-9dec-8131df2af0b9 tempest-VolumesActionsTest-1330627080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2e529d6c-cff3-410c-a781-6e899f38f554 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:22 devstack sudo[103304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2e529d6c-cff3-410c-a781-6e899f38f554 Nov 03 20:32:22 devstack sudo[103304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:22 devstack sudo[103304]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a1f4d4a1-8038-4edd-9dec-8131df2af0b9 tempest-VolumesActionsTest-1330627080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2e529d6c-cff3-410c-a781-6e899f38f554" returned: 0 in 0.425s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a1f4d4a1-8038-4edd-9dec-8131df2af0b9 tempest-VolumesActionsTest-1330627080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2e529d6c-cff3-410c-a781-6e899f38f554 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:22 devstack sudo[103324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2e529d6c-cff3-410c-a781-6e899f38f554 Nov 03 20:32:22 devstack sudo[103324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:22 devstack sudo[103324]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a1f4d4a1-8038-4edd-9dec-8131df2af0b9 tempest-VolumesActionsTest-1330627080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2e529d6c-cff3-410c-a781-6e899f38f554" returned: 0 in 0.256s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:22 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a1f4d4a1-8038-4edd-9dec-8131df2af0b9 tempest-VolumesActionsTest-1330627080 None] Lock "cinder-quobyte-2e529d6c-cff3-410c-a781-6e899f38f554" released by "delete_volume" :: held 0.735s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:32:22 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-a1f4d4a1-8038-4edd-9dec-8131df2af0b9 tempest-VolumesActionsTest-1330627080 None] Created reservations ['c3a03efe-6f46-475f-a927-aa83b00ceffc', '42094a48-99f5-4c71-b730-74f8209dd09c', 'db072b38-6ad6-4ce8-b88b-21fb0a2102b9', '2901df17-d743-4fc7-b54b-e2e4880e9ec2'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:32:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a1f4d4a1-8038-4edd-9dec-8131df2af0b9 tempest-VolumesActionsTest-1330627080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a1f4d4a1-8038-4edd-9dec-8131df2af0b9 tempest-VolumesActionsTest-1330627080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:23 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a1f4d4a1-8038-4edd-9dec-8131df2af0b9 tempest-VolumesActionsTest-1330627080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:32:23 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a1f4d4a1-8038-4edd-9dec-8131df2af0b9 tempest-VolumesActionsTest-1330627080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:32:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a1f4d4a1-8038-4edd-9dec-8131df2af0b9 tempest-VolumesActionsTest-1330627080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a1f4d4a1-8038-4edd-9dec-8131df2af0b9 tempest-VolumesActionsTest-1330627080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:23 devstack sudo[103327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:32:23 devstack sudo[103327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:23 devstack sudo[103327]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a1f4d4a1-8038-4edd-9dec-8131df2af0b9 tempest-VolumesActionsTest-1330627080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.265s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:23 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-a1f4d4a1-8038-4edd-9dec-8131df2af0b9 tempest-VolumesActionsTest-1330627080 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:32:23 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-a1f4d4a1-8038-4edd-9dec-8131df2af0b9 tempest-VolumesActionsTest-1330627080 None] Deleted volume successfully. Nov 03 20:32:23 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a1f4d4a1-8038-4edd-9dec-8131df2af0b9 tempest-VolumesActionsTest-1330627080 None] Lock "cinder-2e529d6c-cff3-410c-a781-6e899f38f554-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:32:23 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1993194-1adb-495c-9eee-33c6a0fdd05b tempest-VolumesActionsTest-815521375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:32:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c1993194-1adb-495c-9eee-33c6a0fdd05b tempest-VolumesActionsTest-815521375 None] Flow 'volume_create_manager' (e3b93500-05ec-4f5e-826a-ec48320632b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:32:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c1993194-1adb-495c-9eee-33c6a0fdd05b tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e757510-e5c9-4dd8-81ae-eb28104ce3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c1993194-1adb-495c-9eee-33c6a0fdd05b tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e757510-e5c9-4dd8-81ae-eb28104ce3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:32:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-487827542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34c5ba09-c1f1-49c3-b203-743edbafce1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdfde9853c8e4d66a631042200334251',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:32:24Z,use_quota=True,user_id='a5a8e0481bdf44e4aeec8e8ea79feca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c1993194-1adb-495c-9eee-33c6a0fdd05b tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a24ebbd4-8703-43f3-b13e-2828ad68a38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c1993194-1adb-495c-9eee-33c6a0fdd05b tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a24ebbd4-8703-43f3-b13e-2828ad68a38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c1993194-1adb-495c-9eee-33c6a0fdd05b tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6df16eda-3e65-4e47-945a-1933c494c42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c1993194-1adb-495c-9eee-33c6a0fdd05b tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6df16eda-3e65-4e47-945a-1933c494c42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34c5ba09-c1f1-49c3-b203-743edbafce1a', 'volume_name': 'volume-34c5ba09-c1f1-49c3-b203-743edbafce1a', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c1993194-1adb-495c-9eee-33c6a0fdd05b tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1622f854-4759-4e08-8a94-06bfd8f8f961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c1993194-1adb-495c-9eee-33c6a0fdd05b tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1622f854-4759-4e08-8a94-06bfd8f8f961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c1993194-1adb-495c-9eee-33c6a0fdd05b tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4155fe8a-e2be-474d-b4a2-c5e83428552d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:23 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-c1993194-1adb-495c-9eee-33c6a0fdd05b tempest-VolumesActionsTest-815521375 None] Volume 34c5ba09-c1f1-49c3-b203-743edbafce1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34c5ba09-c1f1-49c3-b203-743edbafce1a', 'volume_size': 1} Nov 03 20:32:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c1993194-1adb-495c-9eee-33c6a0fdd05b tempest-VolumesActionsTest-815521375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c1993194-1adb-495c-9eee-33c6a0fdd05b tempest-VolumesActionsTest-815521375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:23 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c1993194-1adb-495c-9eee-33c6a0fdd05b tempest-VolumesActionsTest-815521375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:32:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-487827542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34c5ba09-c1f1-49c3-b203-743edbafce1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdfde9853c8e4d66a631042200334251',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:32:24Z,use_quota=True,user_id='a5a8e0481bdf44e4aeec8e8ea79feca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:32:23 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-c1993194-1adb-495c-9eee-33c6a0fdd05b tempest-VolumesActionsTest-815521375 None] Creating volume 34c5ba09-c1f1-49c3-b203-743edbafce1a {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:32:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c1993194-1adb-495c-9eee-33c6a0fdd05b tempest-VolumesActionsTest-815521375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c1993194-1adb-495c-9eee-33c6a0fdd05b tempest-VolumesActionsTest-815521375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:23 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c1993194-1adb-495c-9eee-33c6a0fdd05b tempest-VolumesActionsTest-815521375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:32:23 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c1993194-1adb-495c-9eee-33c6a0fdd05b tempest-VolumesActionsTest-815521375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:32:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c1993194-1adb-495c-9eee-33c6a0fdd05b tempest-VolumesActionsTest-815521375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:23 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c1993194-1adb-495c-9eee-33c6a0fdd05b tempest-VolumesActionsTest-815521375 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:32:23 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-c1993194-1adb-495c-9eee-33c6a0fdd05b tempest-VolumesActionsTest-815521375 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:32:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c1993194-1adb-495c-9eee-33c6a0fdd05b tempest-VolumesActionsTest-815521375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-34c5ba09-c1f1-49c3-b203-743edbafce1a 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:23 devstack sudo[103330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-34c5ba09-c1f1-49c3-b203-743edbafce1a 1073741824 Nov 03 20:32:23 devstack sudo[103330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:24 devstack sudo[103330]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c1993194-1adb-495c-9eee-33c6a0fdd05b tempest-VolumesActionsTest-815521375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-34c5ba09-c1f1-49c3-b203-743edbafce1a 1073741824" returned: 0 in 0.406s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c1993194-1adb-495c-9eee-33c6a0fdd05b tempest-VolumesActionsTest-815521375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-34c5ba09-c1f1-49c3-b203-743edbafce1a {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:24 devstack sudo[103335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-34c5ba09-c1f1-49c3-b203-743edbafce1a Nov 03 20:32:24 devstack sudo[103335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:24 devstack sudo[103335]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c1993194-1adb-495c-9eee-33c6a0fdd05b tempest-VolumesActionsTest-815521375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-34c5ba09-c1f1-49c3-b203-743edbafce1a" returned: 0 in 0.265s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:24 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c1993194-1adb-495c-9eee-33c6a0fdd05b tempest-VolumesActionsTest-815521375 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:32:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c1993194-1adb-495c-9eee-33c6a0fdd05b tempest-VolumesActionsTest-815521375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:24 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c1993194-1adb-495c-9eee-33c6a0fdd05b tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4155fe8a-e2be-474d-b4a2-c5e83428552d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34c5ba09-c1f1-49c3-b203-743edbafce1a', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:24 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c1993194-1adb-495c-9eee-33c6a0fdd05b tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d189ad87-ba67-4c68-b6ec-ba5b814390c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:24 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-c1993194-1adb-495c-9eee-33c6a0fdd05b tempest-VolumesActionsTest-815521375 None] Volume volume-34c5ba09-c1f1-49c3-b203-743edbafce1a (34c5ba09-c1f1-49c3-b203-743edbafce1a): created successfully Nov 03 20:32:24 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c1993194-1adb-495c-9eee-33c6a0fdd05b tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d189ad87-ba67-4c68-b6ec-ba5b814390c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:24 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c1993194-1adb-495c-9eee-33c6a0fdd05b tempest-VolumesActionsTest-815521375 None] Flow 'volume_create_manager' (e3b93500-05ec-4f5e-826a-ec48320632b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:32:24 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-c1993194-1adb-495c-9eee-33c6a0fdd05b tempest-VolumesActionsTest-815521375 None] Created volume successfully. Nov 03 20:32:24 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-541a7fc4-1faf-4fdc-bb91-5c11b4d1722b tempest-VolumesActionsTest-1330627080 None] Acquiring lock "cinder-34c5ba09-c1f1-49c3-b203-743edbafce1a-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:32:24 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-541a7fc4-1faf-4fdc-bb91-5c11b4d1722b tempest-VolumesActionsTest-1330627080 None] Lock "cinder-34c5ba09-c1f1-49c3-b203-743edbafce1a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:32:24 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-541a7fc4-1faf-4fdc-bb91-5c11b4d1722b tempest-VolumesActionsTest-1330627080 None] Acquiring lock "cinder-quobyte-34c5ba09-c1f1-49c3-b203-743edbafce1a" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:32:24 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-541a7fc4-1faf-4fdc-bb91-5c11b4d1722b tempest-VolumesActionsTest-1330627080 None] Lock "cinder-quobyte-34c5ba09-c1f1-49c3-b203-743edbafce1a" acquired by "delete_volume" :: waited 0.013s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:32:24 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[59563176-5151-415b-aac3-29cb8905b46a]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:32:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-541a7fc4-1faf-4fdc-bb91-5c11b4d1722b tempest-VolumesActionsTest-1330627080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-34c5ba09-c1f1-49c3-b203-743edbafce1a {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:25 devstack sudo[103338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-34c5ba09-c1f1-49c3-b203-743edbafce1a Nov 03 20:32:25 devstack sudo[103338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:25 devstack sudo[103338]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-541a7fc4-1faf-4fdc-bb91-5c11b4d1722b tempest-VolumesActionsTest-1330627080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-34c5ba09-c1f1-49c3-b203-743edbafce1a" returned: 0 in 0.355s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-541a7fc4-1faf-4fdc-bb91-5c11b4d1722b tempest-VolumesActionsTest-1330627080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-34c5ba09-c1f1-49c3-b203-743edbafce1a {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:25 devstack sudo[103343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-34c5ba09-c1f1-49c3-b203-743edbafce1a Nov 03 20:32:25 devstack sudo[103343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:25 devstack sudo[103343]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-541a7fc4-1faf-4fdc-bb91-5c11b4d1722b tempest-VolumesActionsTest-1330627080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-34c5ba09-c1f1-49c3-b203-743edbafce1a" returned: 0 in 0.245s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:25 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-541a7fc4-1faf-4fdc-bb91-5c11b4d1722b tempest-VolumesActionsTest-1330627080 None] Lock "cinder-quobyte-34c5ba09-c1f1-49c3-b203-743edbafce1a" released by "delete_volume" :: held 0.640s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:32:25 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-541a7fc4-1faf-4fdc-bb91-5c11b4d1722b tempest-VolumesActionsTest-1330627080 None] Created reservations ['0de7ff40-e7bd-4dee-b01a-249651893d4a', 'a523cc93-5e80-49f6-9894-2aa12d30b508', 'e9245aca-fda7-4efe-a933-ce97ef6406ce', '6b3b7bf0-e8c3-4e05-a0ff-a73f61df427c'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:32:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-541a7fc4-1faf-4fdc-bb91-5c11b4d1722b tempest-VolumesActionsTest-1330627080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-541a7fc4-1faf-4fdc-bb91-5c11b4d1722b tempest-VolumesActionsTest-1330627080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:25 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-541a7fc4-1faf-4fdc-bb91-5c11b4d1722b tempest-VolumesActionsTest-1330627080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:32:25 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-541a7fc4-1faf-4fdc-bb91-5c11b4d1722b tempest-VolumesActionsTest-1330627080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:32:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-541a7fc4-1faf-4fdc-bb91-5c11b4d1722b tempest-VolumesActionsTest-1330627080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-541a7fc4-1faf-4fdc-bb91-5c11b4d1722b tempest-VolumesActionsTest-1330627080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:25 devstack sudo[103346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:32:25 devstack sudo[103346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:25 devstack sudo[103346]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-541a7fc4-1faf-4fdc-bb91-5c11b4d1722b tempest-VolumesActionsTest-1330627080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.241s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:25 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-541a7fc4-1faf-4fdc-bb91-5c11b4d1722b tempest-VolumesActionsTest-1330627080 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:32:25 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-541a7fc4-1faf-4fdc-bb91-5c11b4d1722b tempest-VolumesActionsTest-1330627080 None] Deleted volume successfully. Nov 03 20:32:25 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-541a7fc4-1faf-4fdc-bb91-5c11b4d1722b tempest-VolumesActionsTest-1330627080 None] Lock "cinder-34c5ba09-c1f1-49c3-b203-743edbafce1a-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:32:26 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-039d4c15-4ce7-4bdb-9145-70ab0b4a8549 tempest-VolumesActionsTest-815521375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:32:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-039d4c15-4ce7-4bdb-9145-70ab0b4a8549 tempest-VolumesActionsTest-815521375 None] Flow 'volume_create_manager' (24778339-1308-4f78-ad3a-71f189c3d1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:32:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-039d4c15-4ce7-4bdb-9145-70ab0b4a8549 tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e905c5c9-e95a-4738-8453-62fd45e80bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-039d4c15-4ce7-4bdb-9145-70ab0b4a8549 tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e905c5c9-e95a-4738-8453-62fd45e80bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1300286613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a89b71-ddb2-459c-b0c2-e751ce33e1c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdfde9853c8e4d66a631042200334251',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:32:26Z,use_quota=True,user_id='a5a8e0481bdf44e4aeec8e8ea79feca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-039d4c15-4ce7-4bdb-9145-70ab0b4a8549 tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd296978-10c3-4849-b874-06a7522a3dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-039d4c15-4ce7-4bdb-9145-70ab0b4a8549 tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd296978-10c3-4849-b874-06a7522a3dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-039d4c15-4ce7-4bdb-9145-70ab0b4a8549 tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adde0571-2cdb-4f8b-ae23-06db27c09f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-039d4c15-4ce7-4bdb-9145-70ab0b4a8549 tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adde0571-2cdb-4f8b-ae23-06db27c09f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19a89b71-ddb2-459c-b0c2-e751ce33e1c0', 'volume_name': 'volume-19a89b71-ddb2-459c-b0c2-e751ce33e1c0', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-039d4c15-4ce7-4bdb-9145-70ab0b4a8549 tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e631a1e-7b5f-4c5a-a432-a5252382a369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-039d4c15-4ce7-4bdb-9145-70ab0b4a8549 tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e631a1e-7b5f-4c5a-a432-a5252382a369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-039d4c15-4ce7-4bdb-9145-70ab0b4a8549 tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db8b6f8c-64d6-4e9d-908d-0ccac5cb19b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:26 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-039d4c15-4ce7-4bdb-9145-70ab0b4a8549 tempest-VolumesActionsTest-815521375 None] Volume 19a89b71-ddb2-459c-b0c2-e751ce33e1c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19a89b71-ddb2-459c-b0c2-e751ce33e1c0', 'volume_size': 1} Nov 03 20:32:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-039d4c15-4ce7-4bdb-9145-70ab0b4a8549 tempest-VolumesActionsTest-815521375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-039d4c15-4ce7-4bdb-9145-70ab0b4a8549 tempest-VolumesActionsTest-815521375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:26 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-039d4c15-4ce7-4bdb-9145-70ab0b4a8549 tempest-VolumesActionsTest-815521375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1300286613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a89b71-ddb2-459c-b0c2-e751ce33e1c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdfde9853c8e4d66a631042200334251',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:32:26Z,use_quota=True,user_id='a5a8e0481bdf44e4aeec8e8ea79feca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:32:26 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-039d4c15-4ce7-4bdb-9145-70ab0b4a8549 tempest-VolumesActionsTest-815521375 None] Creating volume 19a89b71-ddb2-459c-b0c2-e751ce33e1c0 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:32:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-039d4c15-4ce7-4bdb-9145-70ab0b4a8549 tempest-VolumesActionsTest-815521375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-039d4c15-4ce7-4bdb-9145-70ab0b4a8549 tempest-VolumesActionsTest-815521375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:26 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-039d4c15-4ce7-4bdb-9145-70ab0b4a8549 tempest-VolumesActionsTest-815521375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:32:26 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-039d4c15-4ce7-4bdb-9145-70ab0b4a8549 tempest-VolumesActionsTest-815521375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:32:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-039d4c15-4ce7-4bdb-9145-70ab0b4a8549 tempest-VolumesActionsTest-815521375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:26 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-039d4c15-4ce7-4bdb-9145-70ab0b4a8549 tempest-VolumesActionsTest-815521375 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:32:26 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-039d4c15-4ce7-4bdb-9145-70ab0b4a8549 tempest-VolumesActionsTest-815521375 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:32:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-039d4c15-4ce7-4bdb-9145-70ab0b4a8549 tempest-VolumesActionsTest-815521375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-19a89b71-ddb2-459c-b0c2-e751ce33e1c0 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:26 devstack sudo[103349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-19a89b71-ddb2-459c-b0c2-e751ce33e1c0 1073741824 Nov 03 20:32:26 devstack sudo[103349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:26 devstack sudo[103349]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-039d4c15-4ce7-4bdb-9145-70ab0b4a8549 tempest-VolumesActionsTest-815521375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-19a89b71-ddb2-459c-b0c2-e751ce33e1c0 1073741824" returned: 0 in 0.399s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-039d4c15-4ce7-4bdb-9145-70ab0b4a8549 tempest-VolumesActionsTest-815521375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-19a89b71-ddb2-459c-b0c2-e751ce33e1c0 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:27 devstack sudo[103354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-19a89b71-ddb2-459c-b0c2-e751ce33e1c0 Nov 03 20:32:27 devstack sudo[103354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:27 devstack sudo[103354]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-039d4c15-4ce7-4bdb-9145-70ab0b4a8549 tempest-VolumesActionsTest-815521375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-19a89b71-ddb2-459c-b0c2-e751ce33e1c0" returned: 0 in 0.241s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:27 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-039d4c15-4ce7-4bdb-9145-70ab0b4a8549 tempest-VolumesActionsTest-815521375 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:32:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-039d4c15-4ce7-4bdb-9145-70ab0b4a8549 tempest-VolumesActionsTest-815521375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:27 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-039d4c15-4ce7-4bdb-9145-70ab0b4a8549 tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db8b6f8c-64d6-4e9d-908d-0ccac5cb19b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19a89b71-ddb2-459c-b0c2-e751ce33e1c0', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:27 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-039d4c15-4ce7-4bdb-9145-70ab0b4a8549 tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (640b5295-a4b0-4809-8e19-1f6cb7424efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:27 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-039d4c15-4ce7-4bdb-9145-70ab0b4a8549 tempest-VolumesActionsTest-815521375 None] Volume volume-19a89b71-ddb2-459c-b0c2-e751ce33e1c0 (19a89b71-ddb2-459c-b0c2-e751ce33e1c0): created successfully Nov 03 20:32:27 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-039d4c15-4ce7-4bdb-9145-70ab0b4a8549 tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (640b5295-a4b0-4809-8e19-1f6cb7424efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:27 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-039d4c15-4ce7-4bdb-9145-70ab0b4a8549 tempest-VolumesActionsTest-815521375 None] Flow 'volume_create_manager' (24778339-1308-4f78-ad3a-71f189c3d1db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:32:27 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-039d4c15-4ce7-4bdb-9145-70ab0b4a8549 tempest-VolumesActionsTest-815521375 None] Created volume successfully. Nov 03 20:32:27 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-dd8cfe0d-1027-4c9e-9440-e445fdd26072 tempest-VolumesActionsTest-1330627080 None] Acquiring lock "cinder-19a89b71-ddb2-459c-b0c2-e751ce33e1c0-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:32:27 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-dd8cfe0d-1027-4c9e-9440-e445fdd26072 tempest-VolumesActionsTest-1330627080 None] Lock "cinder-19a89b71-ddb2-459c-b0c2-e751ce33e1c0-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:32:27 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-dd8cfe0d-1027-4c9e-9440-e445fdd26072 tempest-VolumesActionsTest-1330627080 None] Acquiring lock "cinder-quobyte-19a89b71-ddb2-459c-b0c2-e751ce33e1c0" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:32:27 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-dd8cfe0d-1027-4c9e-9440-e445fdd26072 tempest-VolumesActionsTest-1330627080 None] Lock "cinder-quobyte-19a89b71-ddb2-459c-b0c2-e751ce33e1c0" acquired by "delete_volume" :: waited 0.015s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:32:27 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[e380b9e4-1719-4ac2-b118-b534f45b8f8d]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:32:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-dd8cfe0d-1027-4c9e-9440-e445fdd26072 tempest-VolumesActionsTest-1330627080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-19a89b71-ddb2-459c-b0c2-e751ce33e1c0 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:27 devstack sudo[103357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-19a89b71-ddb2-459c-b0c2-e751ce33e1c0 Nov 03 20:32:27 devstack sudo[103357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:28 devstack sudo[103357]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-dd8cfe0d-1027-4c9e-9440-e445fdd26072 tempest-VolumesActionsTest-1330627080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-19a89b71-ddb2-459c-b0c2-e751ce33e1c0" returned: 0 in 0.348s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-dd8cfe0d-1027-4c9e-9440-e445fdd26072 tempest-VolumesActionsTest-1330627080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-19a89b71-ddb2-459c-b0c2-e751ce33e1c0 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:28 devstack sudo[103362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-19a89b71-ddb2-459c-b0c2-e751ce33e1c0 Nov 03 20:32:28 devstack sudo[103362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:28 devstack sudo[103362]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-dd8cfe0d-1027-4c9e-9440-e445fdd26072 tempest-VolumesActionsTest-1330627080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-19a89b71-ddb2-459c-b0c2-e751ce33e1c0" returned: 0 in 0.251s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:28 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-dd8cfe0d-1027-4c9e-9440-e445fdd26072 tempest-VolumesActionsTest-1330627080 None] Lock "cinder-quobyte-19a89b71-ddb2-459c-b0c2-e751ce33e1c0" released by "delete_volume" :: held 0.644s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:32:28 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-dd8cfe0d-1027-4c9e-9440-e445fdd26072 tempest-VolumesActionsTest-1330627080 None] Created reservations ['153fa056-f3d0-4022-bb06-6b6cf5cb4c61', '3ffd774a-c147-46a0-a2eb-1801db1b2178', '6e4dc5e5-a970-4c45-bc56-bcb0d3c7ecd6', '05e50331-2a01-4202-b122-97c59de5bc4e'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:32:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-dd8cfe0d-1027-4c9e-9440-e445fdd26072 tempest-VolumesActionsTest-1330627080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-dd8cfe0d-1027-4c9e-9440-e445fdd26072 tempest-VolumesActionsTest-1330627080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-dd8cfe0d-1027-4c9e-9440-e445fdd26072 tempest-VolumesActionsTest-1330627080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:32:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-dd8cfe0d-1027-4c9e-9440-e445fdd26072 tempest-VolumesActionsTest-1330627080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:32:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-dd8cfe0d-1027-4c9e-9440-e445fdd26072 tempest-VolumesActionsTest-1330627080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-dd8cfe0d-1027-4c9e-9440-e445fdd26072 tempest-VolumesActionsTest-1330627080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:28 devstack sudo[103365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:32:28 devstack sudo[103365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:28 devstack sudo[103365]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-dd8cfe0d-1027-4c9e-9440-e445fdd26072 tempest-VolumesActionsTest-1330627080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.239s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:28 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-dd8cfe0d-1027-4c9e-9440-e445fdd26072 tempest-VolumesActionsTest-1330627080 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:32:28 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-dd8cfe0d-1027-4c9e-9440-e445fdd26072 tempest-VolumesActionsTest-1330627080 None] Deleted volume successfully. Nov 03 20:32:28 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-dd8cfe0d-1027-4c9e-9440-e445fdd26072 tempest-VolumesActionsTest-1330627080 None] Lock "cinder-19a89b71-ddb2-459c-b0c2-e751ce33e1c0-delete_volume" released by "delete_volume" :: held 1.092s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:32:28 devstack cinder-volume[87248]: DEBUG oslo_service.periodic_task [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:32:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:32:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:32:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:28 devstack sudo[103368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:32:28 devstack sudo[103368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:28 devstack sudo[103368]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.248s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:29 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:32:29 devstack cinder-volume[87248]: DEBUG oslo_service.periodic_task [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running periodic task VolumeManager._thread_info {{(pid=87248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:32:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] thread count: 28 {{(pid=87248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:32:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] thread info: [<_MainThread(MainThread, started 124862067372160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:32:29 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-48af7f54-7a9d-4a50-a413-3ceb1cb53eda tempest-VolumesActionsTest-815521375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:32:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-48af7f54-7a9d-4a50-a413-3ceb1cb53eda tempest-VolumesActionsTest-815521375 None] Flow 'volume_create_manager' (d42a4071-ee4b-4da6-a76d-6a0e71f1900a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:32:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-48af7f54-7a9d-4a50-a413-3ceb1cb53eda tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18f835e9-89a1-4b0b-9e15-5f625cd72426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-48af7f54-7a9d-4a50-a413-3ceb1cb53eda tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18f835e9-89a1-4b0b-9e15-5f625cd72426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:32:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1452545914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9d813e7-5c34-4708-8d33-cc2484195f19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdfde9853c8e4d66a631042200334251',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:32:29Z,use_quota=True,user_id='a5a8e0481bdf44e4aeec8e8ea79feca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-48af7f54-7a9d-4a50-a413-3ceb1cb53eda tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd6f50e7-ecea-4552-b922-a3f79aaf8173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-48af7f54-7a9d-4a50-a413-3ceb1cb53eda tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd6f50e7-ecea-4552-b922-a3f79aaf8173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-48af7f54-7a9d-4a50-a413-3ceb1cb53eda tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7e0df0e-f272-4424-86a3-2e815f9793c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-48af7f54-7a9d-4a50-a413-3ceb1cb53eda tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7e0df0e-f272-4424-86a3-2e815f9793c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9d813e7-5c34-4708-8d33-cc2484195f19', 'volume_name': 'volume-b9d813e7-5c34-4708-8d33-cc2484195f19', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-48af7f54-7a9d-4a50-a413-3ceb1cb53eda tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20f526df-8ed9-4079-99d7-74507a98249c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-48af7f54-7a9d-4a50-a413-3ceb1cb53eda tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20f526df-8ed9-4079-99d7-74507a98249c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-48af7f54-7a9d-4a50-a413-3ceb1cb53eda tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71a03b37-25c6-4aa7-a8f7-bf8db641a4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:29 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-48af7f54-7a9d-4a50-a413-3ceb1cb53eda tempest-VolumesActionsTest-815521375 None] Volume b9d813e7-5c34-4708-8d33-cc2484195f19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9d813e7-5c34-4708-8d33-cc2484195f19', 'volume_size': 1} Nov 03 20:32:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-48af7f54-7a9d-4a50-a413-3ceb1cb53eda tempest-VolumesActionsTest-815521375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-48af7f54-7a9d-4a50-a413-3ceb1cb53eda tempest-VolumesActionsTest-815521375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:29 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-48af7f54-7a9d-4a50-a413-3ceb1cb53eda tempest-VolumesActionsTest-815521375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:32:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1452545914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9d813e7-5c34-4708-8d33-cc2484195f19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdfde9853c8e4d66a631042200334251',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:32:29Z,use_quota=True,user_id='a5a8e0481bdf44e4aeec8e8ea79feca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:32:29 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-48af7f54-7a9d-4a50-a413-3ceb1cb53eda tempest-VolumesActionsTest-815521375 None] Creating volume b9d813e7-5c34-4708-8d33-cc2484195f19 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:32:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-48af7f54-7a9d-4a50-a413-3ceb1cb53eda tempest-VolumesActionsTest-815521375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-48af7f54-7a9d-4a50-a413-3ceb1cb53eda tempest-VolumesActionsTest-815521375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:29 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-48af7f54-7a9d-4a50-a413-3ceb1cb53eda tempest-VolumesActionsTest-815521375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:32:29 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-48af7f54-7a9d-4a50-a413-3ceb1cb53eda tempest-VolumesActionsTest-815521375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:32:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-48af7f54-7a9d-4a50-a413-3ceb1cb53eda tempest-VolumesActionsTest-815521375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:29 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-48af7f54-7a9d-4a50-a413-3ceb1cb53eda tempest-VolumesActionsTest-815521375 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:32:29 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-48af7f54-7a9d-4a50-a413-3ceb1cb53eda tempest-VolumesActionsTest-815521375 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:32:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-48af7f54-7a9d-4a50-a413-3ceb1cb53eda tempest-VolumesActionsTest-815521375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b9d813e7-5c34-4708-8d33-cc2484195f19 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:29 devstack sudo[103371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b9d813e7-5c34-4708-8d33-cc2484195f19 1073741824 Nov 03 20:32:29 devstack sudo[103371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:29 devstack sudo[103371]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-48af7f54-7a9d-4a50-a413-3ceb1cb53eda tempest-VolumesActionsTest-815521375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b9d813e7-5c34-4708-8d33-cc2484195f19 1073741824" returned: 0 in 0.454s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-48af7f54-7a9d-4a50-a413-3ceb1cb53eda tempest-VolumesActionsTest-815521375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b9d813e7-5c34-4708-8d33-cc2484195f19 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:29 devstack sudo[103376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b9d813e7-5c34-4708-8d33-cc2484195f19 Nov 03 20:32:29 devstack sudo[103376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:30 devstack sudo[103376]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-48af7f54-7a9d-4a50-a413-3ceb1cb53eda tempest-VolumesActionsTest-815521375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b9d813e7-5c34-4708-8d33-cc2484195f19" returned: 0 in 0.289s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:30 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-48af7f54-7a9d-4a50-a413-3ceb1cb53eda tempest-VolumesActionsTest-815521375 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:32:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-48af7f54-7a9d-4a50-a413-3ceb1cb53eda tempest-VolumesActionsTest-815521375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:30 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-48af7f54-7a9d-4a50-a413-3ceb1cb53eda tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71a03b37-25c6-4aa7-a8f7-bf8db641a4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9d813e7-5c34-4708-8d33-cc2484195f19', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:30 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-48af7f54-7a9d-4a50-a413-3ceb1cb53eda tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83856077-e3a0-40dc-aae0-e64040a29f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:30 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-48af7f54-7a9d-4a50-a413-3ceb1cb53eda tempest-VolumesActionsTest-815521375 None] Volume volume-b9d813e7-5c34-4708-8d33-cc2484195f19 (b9d813e7-5c34-4708-8d33-cc2484195f19): created successfully Nov 03 20:32:30 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-48af7f54-7a9d-4a50-a413-3ceb1cb53eda tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83856077-e3a0-40dc-aae0-e64040a29f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:30 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-48af7f54-7a9d-4a50-a413-3ceb1cb53eda tempest-VolumesActionsTest-815521375 None] Flow 'volume_create_manager' (d42a4071-ee4b-4da6-a76d-6a0e71f1900a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:32:30 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-48af7f54-7a9d-4a50-a413-3ceb1cb53eda tempest-VolumesActionsTest-815521375 None] Created volume successfully. Nov 03 20:32:31 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-012072f3-66a2-4140-b90c-c056f83e97b1 tempest-VolumesActionsTest-1330627080 None] Acquiring lock "cinder-b9d813e7-5c34-4708-8d33-cc2484195f19-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:32:31 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-012072f3-66a2-4140-b90c-c056f83e97b1 tempest-VolumesActionsTest-1330627080 None] Lock "cinder-b9d813e7-5c34-4708-8d33-cc2484195f19-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:32:31 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-012072f3-66a2-4140-b90c-c056f83e97b1 tempest-VolumesActionsTest-1330627080 None] Acquiring lock "cinder-quobyte-b9d813e7-5c34-4708-8d33-cc2484195f19" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:32:31 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-012072f3-66a2-4140-b90c-c056f83e97b1 tempest-VolumesActionsTest-1330627080 None] Lock "cinder-quobyte-b9d813e7-5c34-4708-8d33-cc2484195f19" acquired by "delete_volume" :: waited 0.017s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:32:31 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7bc4e88-c504-4ec4-b7e5-9b112386cb8a]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:32:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-012072f3-66a2-4140-b90c-c056f83e97b1 tempest-VolumesActionsTest-1330627080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b9d813e7-5c34-4708-8d33-cc2484195f19 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:31 devstack sudo[103388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b9d813e7-5c34-4708-8d33-cc2484195f19 Nov 03 20:32:31 devstack sudo[103388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:31 devstack sudo[103388]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-012072f3-66a2-4140-b90c-c056f83e97b1 tempest-VolumesActionsTest-1330627080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b9d813e7-5c34-4708-8d33-cc2484195f19" returned: 0 in 0.362s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-012072f3-66a2-4140-b90c-c056f83e97b1 tempest-VolumesActionsTest-1330627080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b9d813e7-5c34-4708-8d33-cc2484195f19 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:32 devstack sudo[103393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b9d813e7-5c34-4708-8d33-cc2484195f19 Nov 03 20:32:32 devstack sudo[103393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:32 devstack sudo[103393]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-012072f3-66a2-4140-b90c-c056f83e97b1 tempest-VolumesActionsTest-1330627080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b9d813e7-5c34-4708-8d33-cc2484195f19" returned: 0 in 0.252s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:32 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-012072f3-66a2-4140-b90c-c056f83e97b1 tempest-VolumesActionsTest-1330627080 None] Lock "cinder-quobyte-b9d813e7-5c34-4708-8d33-cc2484195f19" released by "delete_volume" :: held 0.669s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:32:32 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-012072f3-66a2-4140-b90c-c056f83e97b1 tempest-VolumesActionsTest-1330627080 None] Created reservations ['f7bfff7a-05fb-4451-b1ca-f5e813711162', 'b9197f75-cd1e-4590-bb59-08e8d3254d0d', 'bbc360f8-1e11-40df-9149-68c7ccffbea1', '05b14c29-cd6a-4b03-93a0-f21fa086f9e5'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:32:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-012072f3-66a2-4140-b90c-c056f83e97b1 tempest-VolumesActionsTest-1330627080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-012072f3-66a2-4140-b90c-c056f83e97b1 tempest-VolumesActionsTest-1330627080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:32 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-012072f3-66a2-4140-b90c-c056f83e97b1 tempest-VolumesActionsTest-1330627080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:32:32 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-012072f3-66a2-4140-b90c-c056f83e97b1 tempest-VolumesActionsTest-1330627080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:32:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-012072f3-66a2-4140-b90c-c056f83e97b1 tempest-VolumesActionsTest-1330627080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-012072f3-66a2-4140-b90c-c056f83e97b1 tempest-VolumesActionsTest-1330627080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:32 devstack sudo[103397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:32:32 devstack sudo[103397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:32 devstack sudo[103397]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-012072f3-66a2-4140-b90c-c056f83e97b1 tempest-VolumesActionsTest-1330627080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.244s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:32 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-012072f3-66a2-4140-b90c-c056f83e97b1 tempest-VolumesActionsTest-1330627080 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:32:32 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-012072f3-66a2-4140-b90c-c056f83e97b1 tempest-VolumesActionsTest-1330627080 None] Deleted volume successfully. Nov 03 20:32:32 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-012072f3-66a2-4140-b90c-c056f83e97b1 tempest-VolumesActionsTest-1330627080 None] Lock "cinder-b9d813e7-5c34-4708-8d33-cc2484195f19-delete_volume" released by "delete_volume" :: held 1.135s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:32:33 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-b143e9a4-f695-4e51-8eb7-a7bbb7778dbb tempest-VolumesActionsTest-815521375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:32:33 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b143e9a4-f695-4e51-8eb7-a7bbb7778dbb tempest-VolumesActionsTest-815521375 None] Flow 'volume_create_manager' (55c6a27a-a86b-48c9-b12d-9d5d096a15ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:32:33 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b143e9a4-f695-4e51-8eb7-a7bbb7778dbb tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08551a4-2132-4baa-84c2-fbe75af74555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:33 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b143e9a4-f695-4e51-8eb7-a7bbb7778dbb tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08551a4-2132-4baa-84c2-fbe75af74555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2091826659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90385a26-d49b-4356-a2df-6a9f9e1cc22d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdfde9853c8e4d66a631042200334251',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:32:33Z,use_quota=True,user_id='a5a8e0481bdf44e4aeec8e8ea79feca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:33 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b143e9a4-f695-4e51-8eb7-a7bbb7778dbb tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (959deadb-1994-4f41-9345-50478e166ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:33 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b143e9a4-f695-4e51-8eb7-a7bbb7778dbb tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (959deadb-1994-4f41-9345-50478e166ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:33 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b143e9a4-f695-4e51-8eb7-a7bbb7778dbb tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26fc87b7-8d8a-48f5-9785-22836c80f1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:33 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b143e9a4-f695-4e51-8eb7-a7bbb7778dbb tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26fc87b7-8d8a-48f5-9785-22836c80f1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90385a26-d49b-4356-a2df-6a9f9e1cc22d', 'volume_name': 'volume-90385a26-d49b-4356-a2df-6a9f9e1cc22d', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:33 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b143e9a4-f695-4e51-8eb7-a7bbb7778dbb tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (743eaab8-bb02-45da-b200-6fb64de23b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:33 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b143e9a4-f695-4e51-8eb7-a7bbb7778dbb tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (743eaab8-bb02-45da-b200-6fb64de23b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:33 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b143e9a4-f695-4e51-8eb7-a7bbb7778dbb tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24749103-2ea9-4a81-8cc9-030cde1204dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:33 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-b143e9a4-f695-4e51-8eb7-a7bbb7778dbb tempest-VolumesActionsTest-815521375 None] Volume 90385a26-d49b-4356-a2df-6a9f9e1cc22d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90385a26-d49b-4356-a2df-6a9f9e1cc22d', 'volume_size': 1} Nov 03 20:32:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b143e9a4-f695-4e51-8eb7-a7bbb7778dbb tempest-VolumesActionsTest-815521375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b143e9a4-f695-4e51-8eb7-a7bbb7778dbb tempest-VolumesActionsTest-815521375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:33 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-b143e9a4-f695-4e51-8eb7-a7bbb7778dbb tempest-VolumesActionsTest-815521375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2091826659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90385a26-d49b-4356-a2df-6a9f9e1cc22d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdfde9853c8e4d66a631042200334251',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:32:33Z,use_quota=True,user_id='a5a8e0481bdf44e4aeec8e8ea79feca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:32:33 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-b143e9a4-f695-4e51-8eb7-a7bbb7778dbb tempest-VolumesActionsTest-815521375 None] Creating volume 90385a26-d49b-4356-a2df-6a9f9e1cc22d {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:32:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b143e9a4-f695-4e51-8eb7-a7bbb7778dbb tempest-VolumesActionsTest-815521375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b143e9a4-f695-4e51-8eb7-a7bbb7778dbb tempest-VolumesActionsTest-815521375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:33 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-b143e9a4-f695-4e51-8eb7-a7bbb7778dbb tempest-VolumesActionsTest-815521375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:32:33 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-b143e9a4-f695-4e51-8eb7-a7bbb7778dbb tempest-VolumesActionsTest-815521375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:32:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b143e9a4-f695-4e51-8eb7-a7bbb7778dbb tempest-VolumesActionsTest-815521375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:33 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-b143e9a4-f695-4e51-8eb7-a7bbb7778dbb tempest-VolumesActionsTest-815521375 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:32:33 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-b143e9a4-f695-4e51-8eb7-a7bbb7778dbb tempest-VolumesActionsTest-815521375 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:32:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b143e9a4-f695-4e51-8eb7-a7bbb7778dbb tempest-VolumesActionsTest-815521375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-90385a26-d49b-4356-a2df-6a9f9e1cc22d 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:33 devstack sudo[103400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-90385a26-d49b-4356-a2df-6a9f9e1cc22d 1073741824 Nov 03 20:32:33 devstack sudo[103400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:33 devstack sudo[103400]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b143e9a4-f695-4e51-8eb7-a7bbb7778dbb tempest-VolumesActionsTest-815521375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-90385a26-d49b-4356-a2df-6a9f9e1cc22d 1073741824" returned: 0 in 0.409s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b143e9a4-f695-4e51-8eb7-a7bbb7778dbb tempest-VolumesActionsTest-815521375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-90385a26-d49b-4356-a2df-6a9f9e1cc22d {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:33 devstack sudo[103408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-90385a26-d49b-4356-a2df-6a9f9e1cc22d Nov 03 20:32:33 devstack sudo[103408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:33 devstack sudo[103408]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b143e9a4-f695-4e51-8eb7-a7bbb7778dbb tempest-VolumesActionsTest-815521375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-90385a26-d49b-4356-a2df-6a9f9e1cc22d" returned: 0 in 0.246s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:33 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-b143e9a4-f695-4e51-8eb7-a7bbb7778dbb tempest-VolumesActionsTest-815521375 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:32:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b143e9a4-f695-4e51-8eb7-a7bbb7778dbb tempest-VolumesActionsTest-815521375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:33 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b143e9a4-f695-4e51-8eb7-a7bbb7778dbb tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24749103-2ea9-4a81-8cc9-030cde1204dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90385a26-d49b-4356-a2df-6a9f9e1cc22d', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:33 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b143e9a4-f695-4e51-8eb7-a7bbb7778dbb tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ae8836b-70d9-4947-8b3b-1c0d0da1a0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:33 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-b143e9a4-f695-4e51-8eb7-a7bbb7778dbb tempest-VolumesActionsTest-815521375 None] Volume volume-90385a26-d49b-4356-a2df-6a9f9e1cc22d (90385a26-d49b-4356-a2df-6a9f9e1cc22d): created successfully Nov 03 20:32:33 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b143e9a4-f695-4e51-8eb7-a7bbb7778dbb tempest-VolumesActionsTest-815521375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ae8836b-70d9-4947-8b3b-1c0d0da1a0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:33 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b143e9a4-f695-4e51-8eb7-a7bbb7778dbb tempest-VolumesActionsTest-815521375 None] Flow 'volume_create_manager' (55c6a27a-a86b-48c9-b12d-9d5d096a15ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:32:33 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-b143e9a4-f695-4e51-8eb7-a7bbb7778dbb tempest-VolumesActionsTest-815521375 None] Created volume successfully. Nov 03 20:32:34 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e03b69df-6049-404a-9254-519f2841fe17 tempest-VolumesActionsTest-815521375 None] Acquiring lock "cinder-90385a26-d49b-4356-a2df-6a9f9e1cc22d-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:32:34 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e03b69df-6049-404a-9254-519f2841fe17 tempest-VolumesActionsTest-815521375 None] Lock "cinder-90385a26-d49b-4356-a2df-6a9f9e1cc22d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:32:34 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e03b69df-6049-404a-9254-519f2841fe17 tempest-VolumesActionsTest-815521375 None] Acquiring lock "cinder-quobyte-90385a26-d49b-4356-a2df-6a9f9e1cc22d" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:32:34 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e03b69df-6049-404a-9254-519f2841fe17 tempest-VolumesActionsTest-815521375 None] Lock "cinder-quobyte-90385a26-d49b-4356-a2df-6a9f9e1cc22d" acquired by "delete_volume" :: waited 0.024s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:32:34 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[5749fe88-b03a-4ef8-8760-066975ce96d6]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:32:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e03b69df-6049-404a-9254-519f2841fe17 tempest-VolumesActionsTest-815521375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-90385a26-d49b-4356-a2df-6a9f9e1cc22d {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:34 devstack sudo[103415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-90385a26-d49b-4356-a2df-6a9f9e1cc22d Nov 03 20:32:34 devstack sudo[103415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:35 devstack sudo[103415]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e03b69df-6049-404a-9254-519f2841fe17 tempest-VolumesActionsTest-815521375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-90385a26-d49b-4356-a2df-6a9f9e1cc22d" returned: 0 in 0.376s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e03b69df-6049-404a-9254-519f2841fe17 tempest-VolumesActionsTest-815521375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-90385a26-d49b-4356-a2df-6a9f9e1cc22d {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:35 devstack sudo[103423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-90385a26-d49b-4356-a2df-6a9f9e1cc22d Nov 03 20:32:35 devstack sudo[103423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:35 devstack sudo[103423]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e03b69df-6049-404a-9254-519f2841fe17 tempest-VolumesActionsTest-815521375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-90385a26-d49b-4356-a2df-6a9f9e1cc22d" returned: 0 in 0.277s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:35 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e03b69df-6049-404a-9254-519f2841fe17 tempest-VolumesActionsTest-815521375 None] Lock "cinder-quobyte-90385a26-d49b-4356-a2df-6a9f9e1cc22d" released by "delete_volume" :: held 0.701s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:32:35 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-e03b69df-6049-404a-9254-519f2841fe17 tempest-VolumesActionsTest-815521375 None] Created reservations ['1de406a3-169f-4332-8811-db4294d10a40', '4cbfcc99-e743-4161-b851-c5fa2e6e5251', '49272dd2-3e98-4358-a434-919223f4f52f', '50208198-13c7-4500-ba14-921a4f13cbea'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:32:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e03b69df-6049-404a-9254-519f2841fe17 tempest-VolumesActionsTest-815521375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e03b69df-6049-404a-9254-519f2841fe17 tempest-VolumesActionsTest-815521375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:35 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e03b69df-6049-404a-9254-519f2841fe17 tempest-VolumesActionsTest-815521375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:32:35 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e03b69df-6049-404a-9254-519f2841fe17 tempest-VolumesActionsTest-815521375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:32:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e03b69df-6049-404a-9254-519f2841fe17 tempest-VolumesActionsTest-815521375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e03b69df-6049-404a-9254-519f2841fe17 tempest-VolumesActionsTest-815521375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-9dbf3671-a926-459b-abb0-78c02f3d9830 req-576d97d9-63ae-45cf-9db3-2c3dcdbb875c tempest-TestStampPattern-702523091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-9dbf3671-a926-459b-abb0-78c02f3d9830 req-576d97d9-63ae-45cf-9db3-2c3dcdbb875c tempest-TestStampPattern-702523091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:35 devstack sudo[103434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:32:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-9dbf3671-a926-459b-abb0-78c02f3d9830 req-576d97d9-63ae-45cf-9db3-2c3dcdbb875c tempest-TestStampPattern-702523091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:35 devstack sudo[103434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:35 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-9dbf3671-a926-459b-abb0-78c02f3d9830 req-576d97d9-63ae-45cf-9db3-2c3dcdbb875c tempest-TestStampPattern-702523091 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8', 'name': 'volume-0a43636c-c09b-4e28-9677-4809934aaa98', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b72902d7-a93c-4d47-bb49-3e6107fff5f6', 'enforce_multipath': True} {{(pid=87248) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 20:32:35 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-9dbf3671-a926-459b-abb0-78c02f3d9830 req-576d97d9-63ae-45cf-9db3-2c3dcdbb875c tempest-TestStampPattern-702523091 None] attachment_update completed successfully. Nov 03 20:32:35 devstack sudo[103434]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e03b69df-6049-404a-9254-519f2841fe17 tempest-VolumesActionsTest-815521375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.258s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:35 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-e03b69df-6049-404a-9254-519f2841fe17 tempest-VolumesActionsTest-815521375 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:32:35 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-e03b69df-6049-404a-9254-519f2841fe17 tempest-VolumesActionsTest-815521375 None] Deleted volume successfully. Nov 03 20:32:35 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e03b69df-6049-404a-9254-519f2841fe17 tempest-VolumesActionsTest-815521375 None] Lock "cinder-90385a26-d49b-4356-a2df-6a9f9e1cc22d-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:32:41 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-8c304231-d5ed-4cf6-b5e6-de06868e9f55 req-7f335163-89f8-4fc6-9e7e-d1e9f46d91a6 tempest-TestStampPattern-702523091 None] Terminate volume connection completed successfully. Nov 03 20:32:41 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-8c304231-d5ed-4cf6-b5e6-de06868e9f55 req-7f335163-89f8-4fc6-9e7e-d1e9f46d91a6 tempest-TestStampPattern-702523091 None] Deleting attachment b72902d7-a93c-4d47-bb49-3e6107fff5f6. {{(pid=87248) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 20:32:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f22a28b3-1a8b-4fbd-85f0-4545b949833d tempest-TestStampPattern-702523091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f22a28b3-1a8b-4fbd-85f0-4545b949833d tempest-TestStampPattern-702523091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:42 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-f22a28b3-1a8b-4fbd-85f0-4545b949833d tempest-TestStampPattern-702523091 None] Creating offline snapshot 3b7fba2c-ad7c-42f8-a796-374aa3e6b7ce of volume 0a43636c-c09b-4e28-9677-4809934aaa98 {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:32:42 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[594a446e-08cd-4350-b3e1-1a11ccd75eaa]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:32:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f22a28b3-1a8b-4fbd-85f0-4545b949833d tempest-TestStampPattern-702523091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:42 devstack sudo[103905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98 Nov 03 20:32:42 devstack sudo[103905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:42 devstack sudo[103905]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f22a28b3-1a8b-4fbd-85f0-4545b949833d tempest-TestStampPattern-702523091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98" returned: 0 in 0.394s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f22a28b3-1a8b-4fbd-85f0-4545b949833d tempest-TestStampPattern-702523091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98.3b7fba2c-ad7c-42f8-a796-374aa3e6b7ce 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:42 devstack sudo[103911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98.3b7fba2c-ad7c-42f8-a796-374aa3e6b7ce 1G Nov 03 20:32:42 devstack sudo[103911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:42 devstack sudo[103911]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f22a28b3-1a8b-4fbd-85f0-4545b949833d tempest-TestStampPattern-702523091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98.3b7fba2c-ad7c-42f8-a796-374aa3e6b7ce 1G" returned: 0 in 0.417s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f22a28b3-1a8b-4fbd-85f0-4545b949833d tempest-TestStampPattern-702523091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a43636c-c09b-4e28-9677-4809934aaa98 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98.3b7fba2c-ad7c-42f8-a796-374aa3e6b7ce {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:42 devstack sudo[103916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a43636c-c09b-4e28-9677-4809934aaa98 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98.3b7fba2c-ad7c-42f8-a796-374aa3e6b7ce Nov 03 20:32:42 devstack sudo[103916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:43 devstack sudo[103916]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f22a28b3-1a8b-4fbd-85f0-4545b949833d tempest-TestStampPattern-702523091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a43636c-c09b-4e28-9677-4809934aaa98 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98.3b7fba2c-ad7c-42f8-a796-374aa3e6b7ce" returned: 0 in 0.309s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:43 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-f22a28b3-1a8b-4fbd-85f0-4545b949833d tempest-TestStampPattern-702523091 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98.3b7fba2c-ad7c-42f8-a796-374aa3e6b7ce is being set with open permissions: ugo+rw Nov 03 20:32:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f22a28b3-1a8b-4fbd-85f0-4545b949833d tempest-TestStampPattern-702523091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98.3b7fba2c-ad7c-42f8-a796-374aa3e6b7ce {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:43 devstack sudo[103922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98.3b7fba2c-ad7c-42f8-a796-374aa3e6b7ce Nov 03 20:32:43 devstack sudo[103922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:43 devstack sudo[103922]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f22a28b3-1a8b-4fbd-85f0-4545b949833d tempest-TestStampPattern-702523091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98.3b7fba2c-ad7c-42f8-a796-374aa3e6b7ce" returned: 0 in 0.277s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:43 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:SELECT=91,cinder:UPDATE=121,cinder:INSERT=22,cinder:DELETE=8 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:32:43 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:UPDATE=117,cinder:SELECT=88,cinder:INSERT=31,cinder:DELETE=13 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:32:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f22a28b3-1a8b-4fbd-85f0-4545b949833d tempest-TestStampPattern-702523091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:43 devstack sudo[103925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98.info Nov 03 20:32:43 devstack sudo[103925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:43 devstack sudo[103925]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f22a28b3-1a8b-4fbd-85f0-4545b949833d tempest-TestStampPattern-702523091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98.info" returned: 0 in 0.249s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:43 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-f22a28b3-1a8b-4fbd-85f0-4545b949833d tempest-TestStampPattern-702523091 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98.info is being set with open permissions: ugo+rw Nov 03 20:32:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f22a28b3-1a8b-4fbd-85f0-4545b949833d tempest-TestStampPattern-702523091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:43 devstack sudo[103928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98.info Nov 03 20:32:43 devstack sudo[103928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:44 devstack sudo[103928]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f22a28b3-1a8b-4fbd-85f0-4545b949833d tempest-TestStampPattern-702523091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98.info" returned: 0 in 0.238s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f22a28b3-1a8b-4fbd-85f0-4545b949833d tempest-TestStampPattern-702523091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.990s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:44 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-f22a28b3-1a8b-4fbd-85f0-4545b949833d tempest-TestStampPattern-702523091 None] Create snapshot completed successfully Nov 03 20:32:51 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:32:51 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] Flow 'volume_create_manager' (f006d9d8-6c06-4a94-93e2-38f3e98d9173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:32:51 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4408a46f-8110-417c-ab4e-08190d9af3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:51 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4408a46f-8110-417c-ab4e-08190d9af3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-207470883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e19fa12-9c1b-4b3f-91da-89e5342c788a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47b9476691b4455a88048666dfdb475e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3b7fba2c-ad7c-42f8-a796-374aa3e6b7ce,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:32:51Z,use_quota=True,user_id='2bf3ce54ed3a4ed4b06bcdba8f2d74ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:51 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab7da7b4-ee14-491d-a4ab-5d100bf58011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:51 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab7da7b4-ee14-491d-a4ab-5d100bf58011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:51 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aad6afa-f303-4cd5-ba14-e7214d3c8c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:51 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aad6afa-f303-4cd5-ba14-e7214d3c8c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2e19fa12-9c1b-4b3f-91da-89e5342c788a', 'volume_name': 'volume-2e19fa12-9c1b-4b3f-91da-89e5342c788a', 'volume_size': 1, 'snapshot_id': '3b7fba2c-ad7c-42f8-a796-374aa3e6b7ce'}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:51 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcff6e72-c297-4f70-a388-edb1988cacf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:51 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcff6e72-c297-4f70-a388-edb1988cacf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:51 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee6899bf-fc70-4a14-9277-43a5dbf2ad8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:51 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] Volume 2e19fa12-9c1b-4b3f-91da-89e5342c788a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2e19fa12-9c1b-4b3f-91da-89e5342c788a', 'volume_size': 1, 'snapshot_id': '3b7fba2c-ad7c-42f8-a796-374aa3e6b7ce'} Nov 03 20:32:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:51 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] Acquiring lock "cinder-quobyte-3b7fba2c-ad7c-42f8-a796-374aa3e6b7ce-2e19fa12-9c1b-4b3f-91da-89e5342c788a" by "_create_volume_from_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:32:51 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] Lock "cinder-quobyte-3b7fba2c-ad7c-42f8-a796-374aa3e6b7ce-2e19fa12-9c1b-4b3f-91da-89e5342c788a" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:32:51 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] Creating volume 2e19fa12-9c1b-4b3f-91da-89e5342c788a from snapshot 3b7fba2c-ad7c-42f8-a796-374aa3e6b7ce {{(pid=87248) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 20:32:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:51 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:32:51 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:32:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:51 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:32:51 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] Acquiring lock "cinder-quobyte-2e19fa12-9c1b-4b3f-91da-89e5342c788a" by "_copy_volume_from_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:32:51 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] Lock "cinder-quobyte-2e19fa12-9c1b-4b3f-91da-89e5342c788a" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:32:51 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] snapshot: 3b7fba2c-ad7c-42f8-a796-374aa3e6b7ce, volume: 2e19fa12-9c1b-4b3f-91da-89e5342c788a, {{(pid=87248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 20:32:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:32:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:32:51 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:32:51 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:32:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:32:51 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbb533e-ea1f-46ae-8116-bb94bd974431]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:32:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98.3b7fba2c-ad7c-42f8-a796-374aa3e6b7ce {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:51 devstack sudo[103956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98.3b7fba2c-ad7c-42f8-a796-374aa3e6b7ce Nov 03 20:32:51 devstack sudo[103956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:51 devstack sudo[103956]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98.3b7fba2c-ad7c-42f8-a796-374aa3e6b7ce" returned: 0 in 0.428s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:51 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a43636c-c09b-4e28-9677-4809934aaa98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:32:51 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[7674a95e-2d85-4364-8c09-2900d7dc39f4]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:32:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:51 devstack sudo[103961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98 Nov 03 20:32:51 devstack sudo[103961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:52 devstack sudo[103961]: pam_unix(sudo:session): session closed for user root Nov 03 20:32:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98" returned: 0 in 0.427s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:32:52 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98 {{(pid=87248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 20:32:52 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] Creating direct copy from snapshot {{(pid=87248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 20:32:52 devstack cinder-volume[87248]: DEBUG cinder.utils [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] Path /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2e19fa12-9c1b-4b3f-91da-89e5342c788a not found in is_blk_device check {{(pid=87248) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 20:32:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2e19fa12-9c1b-4b3f-91da-89e5342c788a {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:32:52 devstack sudo[103970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2e19fa12-9c1b-4b3f-91da-89e5342c788a Nov 03 20:32:52 devstack sudo[103970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:32:56 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-532bc00d-e2a4-4278-98be-f09e38b7d3f5 tempest-VolumesTransfersV355Test-227769028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:32:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-532bc00d-e2a4-4278-98be-f09e38b7d3f5 tempest-VolumesTransfersV355Test-227769028 None] Flow 'volume_create_manager' (bf1c1622-f510-4186-984c-3cc39b330b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:32:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-532bc00d-e2a4-4278-98be-f09e38b7d3f5 tempest-VolumesTransfersV355Test-227769028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9fbda8a-9790-4d1b-aef1-0d1ffaaba2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-532bc00d-e2a4-4278-98be-f09e38b7d3f5 tempest-VolumesTransfersV355Test-227769028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9fbda8a-9790-4d1b-aef1-0d1ffaaba2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-257863611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90674e04-1c80-4daa-a0f5-985c7415625b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01486db53aeb43cc836fb5686f9900e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:32:56Z,use_quota=True,user_id='263425351d64489e9ed332cd35cb9bb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-532bc00d-e2a4-4278-98be-f09e38b7d3f5 tempest-VolumesTransfersV355Test-227769028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edabfd42-8b39-4527-a5ed-b90861badb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-532bc00d-e2a4-4278-98be-f09e38b7d3f5 tempest-VolumesTransfersV355Test-227769028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edabfd42-8b39-4527-a5ed-b90861badb08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-532bc00d-e2a4-4278-98be-f09e38b7d3f5 tempest-VolumesTransfersV355Test-227769028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77e5e0ef-fa97-4882-9c64-dbbbe44475d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-532bc00d-e2a4-4278-98be-f09e38b7d3f5 tempest-VolumesTransfersV355Test-227769028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77e5e0ef-fa97-4882-9c64-dbbbe44475d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90674e04-1c80-4daa-a0f5-985c7415625b', 'volume_name': 'volume-90674e04-1c80-4daa-a0f5-985c7415625b', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-532bc00d-e2a4-4278-98be-f09e38b7d3f5 tempest-VolumesTransfersV355Test-227769028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (010ec2f9-9868-4bb1-8fc0-c723f5cf76f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-532bc00d-e2a4-4278-98be-f09e38b7d3f5 tempest-VolumesTransfersV355Test-227769028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (010ec2f9-9868-4bb1-8fc0-c723f5cf76f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:32:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-532bc00d-e2a4-4278-98be-f09e38b7d3f5 tempest-VolumesTransfersV355Test-227769028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a2d4598-bd3c-4b40-aed8-04992932e42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:32:56 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-532bc00d-e2a4-4278-98be-f09e38b7d3f5 tempest-VolumesTransfersV355Test-227769028 None] Volume 90674e04-1c80-4daa-a0f5-985c7415625b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90674e04-1c80-4daa-a0f5-985c7415625b', 'volume_size': 1} Nov 03 20:32:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-532bc00d-e2a4-4278-98be-f09e38b7d3f5 tempest-VolumesTransfersV355Test-227769028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:33:01 devstack sudo[103970]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2e19fa12-9c1b-4b3f-91da-89e5342c788a" returned: 0 in 9.238s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:01 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] Image conversion details: src /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98, size 1024.00 MB, duration 9.24 sec, destination /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2e19fa12-9c1b-4b3f-91da-89e5342c788a {{(pid=87248) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:33:01 devstack cinder-volume[87248]: INFO cinder.image.image_utils [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] Converted 1024.00 MB image at 110.81 MB/s Nov 03 20:33:01 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2e19fa12-9c1b-4b3f-91da-89e5342c788a is being set with open permissions: ugo+rw Nov 03 20:33:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2e19fa12-9c1b-4b3f-91da-89e5342c788a {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:01 devstack sudo[104049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2e19fa12-9c1b-4b3f-91da-89e5342c788a Nov 03 20:33:01 devstack sudo[104049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:01 devstack sudo[104049]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2e19fa12-9c1b-4b3f-91da-89e5342c788a" returned: 0 in 0.253s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:01 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] Lock "cinder-quobyte-2e19fa12-9c1b-4b3f-91da-89e5342c788a" released by "_copy_volume_from_snapshot" :: held 10.445s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:33:01 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] Lock "cinder-quobyte-3b7fba2c-ad7c-42f8-a796-374aa3e6b7ce-2e19fa12-9c1b-4b3f-91da-89e5342c788a" released by "_create_volume_from_snapshot" :: held 10.520s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:33:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.540s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:33:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-532bc00d-e2a4-4278-98be-f09e38b7d3f5 tempest-VolumesTransfersV355Test-227769028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.150s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:33:01 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-532bc00d-e2a4-4278-98be-f09e38b7d3f5 tempest-VolumesTransfersV355Test-227769028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-257863611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90674e04-1c80-4daa-a0f5-985c7415625b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01486db53aeb43cc836fb5686f9900e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:32:56Z,use_quota=True,user_id='263425351d64489e9ed332cd35cb9bb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:33:01 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-532bc00d-e2a4-4278-98be-f09e38b7d3f5 tempest-VolumesTransfersV355Test-227769028 None] Creating volume 90674e04-1c80-4daa-a0f5-985c7415625b {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:33:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-532bc00d-e2a4-4278-98be-f09e38b7d3f5 tempest-VolumesTransfersV355Test-227769028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:33:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-532bc00d-e2a4-4278-98be-f09e38b7d3f5 tempest-VolumesTransfersV355Test-227769028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:33:01 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-532bc00d-e2a4-4278-98be-f09e38b7d3f5 tempest-VolumesTransfersV355Test-227769028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:33:01 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-532bc00d-e2a4-4278-98be-f09e38b7d3f5 tempest-VolumesTransfersV355Test-227769028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:33:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-532bc00d-e2a4-4278-98be-f09e38b7d3f5 tempest-VolumesTransfersV355Test-227769028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:33:01 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-532bc00d-e2a4-4278-98be-f09e38b7d3f5 tempest-VolumesTransfersV355Test-227769028 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:33:01 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-532bc00d-e2a4-4278-98be-f09e38b7d3f5 tempest-VolumesTransfersV355Test-227769028 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:33:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-532bc00d-e2a4-4278-98be-f09e38b7d3f5 tempest-VolumesTransfersV355Test-227769028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-90674e04-1c80-4daa-a0f5-985c7415625b 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:01 devstack sudo[104053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-90674e04-1c80-4daa-a0f5-985c7415625b 1073741824 Nov 03 20:33:01 devstack sudo[104053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee6899bf-fc70-4a14-9277-43a5dbf2ad8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e19fa12-9c1b-4b3f-91da-89e5342c788a', 'volume_size': 1, 'snapshot_id': '3b7fba2c-ad7c-42f8-a796-374aa3e6b7ce'}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:33:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12d4907d-b9bd-4b71-8a55-bd1fe1f09f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:33:01 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] Volume volume-2e19fa12-9c1b-4b3f-91da-89e5342c788a (2e19fa12-9c1b-4b3f-91da-89e5342c788a): created successfully Nov 03 20:33:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12d4907d-b9bd-4b71-8a55-bd1fe1f09f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:33:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] Flow 'volume_create_manager' (f006d9d8-6c06-4a94-93e2-38f3e98d9173) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:33:01 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-062dba79-1eff-453c-830a-e222b25a0d48 tempest-TestStampPattern-702523091 None] Created volume successfully. Nov 03 20:33:02 devstack sudo[104053]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-532bc00d-e2a4-4278-98be-f09e38b7d3f5 tempest-VolumesTransfersV355Test-227769028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-90674e04-1c80-4daa-a0f5-985c7415625b 1073741824" returned: 0 in 0.542s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-532bc00d-e2a4-4278-98be-f09e38b7d3f5 tempest-VolumesTransfersV355Test-227769028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-90674e04-1c80-4daa-a0f5-985c7415625b {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:02 devstack sudo[104062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-90674e04-1c80-4daa-a0f5-985c7415625b Nov 03 20:33:02 devstack sudo[104062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:02 devstack sudo[104062]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-532bc00d-e2a4-4278-98be-f09e38b7d3f5 tempest-VolumesTransfersV355Test-227769028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-90674e04-1c80-4daa-a0f5-985c7415625b" returned: 0 in 0.277s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:02 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-532bc00d-e2a4-4278-98be-f09e38b7d3f5 tempest-VolumesTransfersV355Test-227769028 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:33:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-532bc00d-e2a4-4278-98be-f09e38b7d3f5 tempest-VolumesTransfersV355Test-227769028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:33:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-532bc00d-e2a4-4278-98be-f09e38b7d3f5 tempest-VolumesTransfersV355Test-227769028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a2d4598-bd3c-4b40-aed8-04992932e42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90674e04-1c80-4daa-a0f5-985c7415625b', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:33:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-532bc00d-e2a4-4278-98be-f09e38b7d3f5 tempest-VolumesTransfersV355Test-227769028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce9c47c8-8de9-4af6-8c1d-c3cf780c18c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:33:02 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-532bc00d-e2a4-4278-98be-f09e38b7d3f5 tempest-VolumesTransfersV355Test-227769028 None] Volume volume-90674e04-1c80-4daa-a0f5-985c7415625b (90674e04-1c80-4daa-a0f5-985c7415625b): created successfully Nov 03 20:33:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-532bc00d-e2a4-4278-98be-f09e38b7d3f5 tempest-VolumesTransfersV355Test-227769028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce9c47c8-8de9-4af6-8c1d-c3cf780c18c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:33:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-532bc00d-e2a4-4278-98be-f09e38b7d3f5 tempest-VolumesTransfersV355Test-227769028 None] Flow 'volume_create_manager' (bf1c1622-f510-4186-984c-3cc39b330b08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:33:02 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-532bc00d-e2a4-4278-98be-f09e38b7d3f5 tempest-VolumesTransfersV355Test-227769028 None] Created volume successfully. Nov 03 20:33:03 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-23df63c4-ff0d-4227-9056-d1489cc9c071 tempest-VolumesTransfersV355Test-1558487693 None] Transfer volume completed successfully. Nov 03 20:33:04 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d31c3157-f11d-49d0-8a00-75e0f4db0f7a tempest-VolumesTransfersV355Test-1903122419 None] Acquiring lock "cinder-90674e04-1c80-4daa-a0f5-985c7415625b-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:33:04 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d31c3157-f11d-49d0-8a00-75e0f4db0f7a tempest-VolumesTransfersV355Test-1903122419 None] Lock "cinder-90674e04-1c80-4daa-a0f5-985c7415625b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:33:04 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d31c3157-f11d-49d0-8a00-75e0f4db0f7a tempest-VolumesTransfersV355Test-1903122419 None] Acquiring lock "cinder-quobyte-90674e04-1c80-4daa-a0f5-985c7415625b" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:33:04 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d31c3157-f11d-49d0-8a00-75e0f4db0f7a tempest-VolumesTransfersV355Test-1903122419 None] Lock "cinder-quobyte-90674e04-1c80-4daa-a0f5-985c7415625b" acquired by "delete_volume" :: waited 0.023s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:33:04 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[734122f4-6876-4322-ac50-6bf658967468]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:33:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d31c3157-f11d-49d0-8a00-75e0f4db0f7a tempest-VolumesTransfersV355Test-1903122419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-90674e04-1c80-4daa-a0f5-985c7415625b {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:04 devstack sudo[104072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-90674e04-1c80-4daa-a0f5-985c7415625b Nov 03 20:33:04 devstack sudo[104072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:04 devstack sudo[104072]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d31c3157-f11d-49d0-8a00-75e0f4db0f7a tempest-VolumesTransfersV355Test-1903122419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-90674e04-1c80-4daa-a0f5-985c7415625b" returned: 0 in 0.401s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d31c3157-f11d-49d0-8a00-75e0f4db0f7a tempest-VolumesTransfersV355Test-1903122419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-90674e04-1c80-4daa-a0f5-985c7415625b {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:04 devstack sudo[104077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-90674e04-1c80-4daa-a0f5-985c7415625b Nov 03 20:33:04 devstack sudo[104077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:05 devstack sudo[104077]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d31c3157-f11d-49d0-8a00-75e0f4db0f7a tempest-VolumesTransfersV355Test-1903122419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-90674e04-1c80-4daa-a0f5-985c7415625b" returned: 0 in 0.261s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:05 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d31c3157-f11d-49d0-8a00-75e0f4db0f7a tempest-VolumesTransfersV355Test-1903122419 None] Lock "cinder-quobyte-90674e04-1c80-4daa-a0f5-985c7415625b" released by "delete_volume" :: held 0.763s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:33:05 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-d31c3157-f11d-49d0-8a00-75e0f4db0f7a tempest-VolumesTransfersV355Test-1903122419 None] Created reservations ['8c1e7dff-c2ad-41f1-ad65-74fd3bfd2f8f', 'f8e51019-08a7-469d-8213-2f3b2e7a7391', '2cc89fd4-debd-45ee-86d3-ab17adc2f3b1', '110b5750-820d-4678-a396-5ad8c6435763'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:33:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d31c3157-f11d-49d0-8a00-75e0f4db0f7a tempest-VolumesTransfersV355Test-1903122419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:33:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d31c3157-f11d-49d0-8a00-75e0f4db0f7a tempest-VolumesTransfersV355Test-1903122419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:33:05 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-d31c3157-f11d-49d0-8a00-75e0f4db0f7a tempest-VolumesTransfersV355Test-1903122419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:33:05 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-d31c3157-f11d-49d0-8a00-75e0f4db0f7a tempest-VolumesTransfersV355Test-1903122419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:33:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d31c3157-f11d-49d0-8a00-75e0f4db0f7a tempest-VolumesTransfersV355Test-1903122419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:33:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d31c3157-f11d-49d0-8a00-75e0f4db0f7a tempest-VolumesTransfersV355Test-1903122419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:05 devstack sudo[104081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:33:05 devstack sudo[104081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:05 devstack sudo[104081]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d31c3157-f11d-49d0-8a00-75e0f4db0f7a tempest-VolumesTransfersV355Test-1903122419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.281s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:05 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-d31c3157-f11d-49d0-8a00-75e0f4db0f7a tempest-VolumesTransfersV355Test-1903122419 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:33:05 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-d31c3157-f11d-49d0-8a00-75e0f4db0f7a tempest-VolumesTransfersV355Test-1903122419 None] Deleted volume successfully. Nov 03 20:33:05 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-d31c3157-f11d-49d0-8a00-75e0f4db0f7a tempest-VolumesTransfersV355Test-1903122419 None] Lock "cinder-90674e04-1c80-4daa-a0f5-985c7415625b-delete_volume" released by "delete_volume" :: held 1.278s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:33:06 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6bf9791-623d-4bdc-8ccc-765bdfab6e59 tempest-VolumesTransfersV355Test-227769028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:33:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e6bf9791-623d-4bdc-8ccc-765bdfab6e59 tempest-VolumesTransfersV355Test-227769028 None] Flow 'volume_create_manager' (14c12fcb-3a21-4271-9ccd-f20dfc3fb726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:33:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e6bf9791-623d-4bdc-8ccc-765bdfab6e59 tempest-VolumesTransfersV355Test-227769028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdf41b83-b4ec-44ee-8d1b-02511f0359de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:33:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e6bf9791-623d-4bdc-8ccc-765bdfab6e59 tempest-VolumesTransfersV355Test-227769028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdf41b83-b4ec-44ee-8d1b-02511f0359de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-294031434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26d17756-aa9d-45d8-8f83-728ed3b1094b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01486db53aeb43cc836fb5686f9900e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:33:06Z,use_quota=True,user_id='263425351d64489e9ed332cd35cb9bb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:33:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e6bf9791-623d-4bdc-8ccc-765bdfab6e59 tempest-VolumesTransfersV355Test-227769028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c660bb91-3f1b-419f-8422-0f24042e100f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:33:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e6bf9791-623d-4bdc-8ccc-765bdfab6e59 tempest-VolumesTransfersV355Test-227769028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c660bb91-3f1b-419f-8422-0f24042e100f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:33:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e6bf9791-623d-4bdc-8ccc-765bdfab6e59 tempest-VolumesTransfersV355Test-227769028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c21dccd1-9202-4175-97f9-ccede272f30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:33:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e6bf9791-623d-4bdc-8ccc-765bdfab6e59 tempest-VolumesTransfersV355Test-227769028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c21dccd1-9202-4175-97f9-ccede272f30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26d17756-aa9d-45d8-8f83-728ed3b1094b', 'volume_name': 'volume-26d17756-aa9d-45d8-8f83-728ed3b1094b', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:33:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e6bf9791-623d-4bdc-8ccc-765bdfab6e59 tempest-VolumesTransfersV355Test-227769028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5016e345-36b3-4df0-9f6a-ac7dc14cc994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:33:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e6bf9791-623d-4bdc-8ccc-765bdfab6e59 tempest-VolumesTransfersV355Test-227769028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5016e345-36b3-4df0-9f6a-ac7dc14cc994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:33:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e6bf9791-623d-4bdc-8ccc-765bdfab6e59 tempest-VolumesTransfersV355Test-227769028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f1cc970-9dc3-43a5-a228-b60cfdffc698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:33:06 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-e6bf9791-623d-4bdc-8ccc-765bdfab6e59 tempest-VolumesTransfersV355Test-227769028 None] Volume 26d17756-aa9d-45d8-8f83-728ed3b1094b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26d17756-aa9d-45d8-8f83-728ed3b1094b', 'volume_size': 1} Nov 03 20:33:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e6bf9791-623d-4bdc-8ccc-765bdfab6e59 tempest-VolumesTransfersV355Test-227769028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:33:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e6bf9791-623d-4bdc-8ccc-765bdfab6e59 tempest-VolumesTransfersV355Test-227769028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:33:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e6bf9791-623d-4bdc-8ccc-765bdfab6e59 tempest-VolumesTransfersV355Test-227769028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-294031434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26d17756-aa9d-45d8-8f83-728ed3b1094b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01486db53aeb43cc836fb5686f9900e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:33:06Z,use_quota=True,user_id='263425351d64489e9ed332cd35cb9bb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:33:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-e6bf9791-623d-4bdc-8ccc-765bdfab6e59 tempest-VolumesTransfersV355Test-227769028 None] Creating volume 26d17756-aa9d-45d8-8f83-728ed3b1094b {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:33:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e6bf9791-623d-4bdc-8ccc-765bdfab6e59 tempest-VolumesTransfersV355Test-227769028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:33:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e6bf9791-623d-4bdc-8ccc-765bdfab6e59 tempest-VolumesTransfersV355Test-227769028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:33:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e6bf9791-623d-4bdc-8ccc-765bdfab6e59 tempest-VolumesTransfersV355Test-227769028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:33:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e6bf9791-623d-4bdc-8ccc-765bdfab6e59 tempest-VolumesTransfersV355Test-227769028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:33:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e6bf9791-623d-4bdc-8ccc-765bdfab6e59 tempest-VolumesTransfersV355Test-227769028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:33:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e6bf9791-623d-4bdc-8ccc-765bdfab6e59 tempest-VolumesTransfersV355Test-227769028 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:33:06 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-e6bf9791-623d-4bdc-8ccc-765bdfab6e59 tempest-VolumesTransfersV355Test-227769028 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:33:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e6bf9791-623d-4bdc-8ccc-765bdfab6e59 tempest-VolumesTransfersV355Test-227769028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-26d17756-aa9d-45d8-8f83-728ed3b1094b 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:06 devstack sudo[104084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-26d17756-aa9d-45d8-8f83-728ed3b1094b 1073741824 Nov 03 20:33:06 devstack sudo[104084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:06 devstack sudo[104084]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e6bf9791-623d-4bdc-8ccc-765bdfab6e59 tempest-VolumesTransfersV355Test-227769028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-26d17756-aa9d-45d8-8f83-728ed3b1094b 1073741824" returned: 0 in 0.424s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e6bf9791-623d-4bdc-8ccc-765bdfab6e59 tempest-VolumesTransfersV355Test-227769028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-26d17756-aa9d-45d8-8f83-728ed3b1094b {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:06 devstack sudo[104089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-26d17756-aa9d-45d8-8f83-728ed3b1094b Nov 03 20:33:06 devstack sudo[104089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:06 devstack sudo[104089]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e6bf9791-623d-4bdc-8ccc-765bdfab6e59 tempest-VolumesTransfersV355Test-227769028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-26d17756-aa9d-45d8-8f83-728ed3b1094b" returned: 0 in 0.247s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e6bf9791-623d-4bdc-8ccc-765bdfab6e59 tempest-VolumesTransfersV355Test-227769028 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:33:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e6bf9791-623d-4bdc-8ccc-765bdfab6e59 tempest-VolumesTransfersV355Test-227769028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:33:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e6bf9791-623d-4bdc-8ccc-765bdfab6e59 tempest-VolumesTransfersV355Test-227769028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f1cc970-9dc3-43a5-a228-b60cfdffc698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26d17756-aa9d-45d8-8f83-728ed3b1094b', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:33:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e6bf9791-623d-4bdc-8ccc-765bdfab6e59 tempest-VolumesTransfersV355Test-227769028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c07e437e-fee6-4b75-9a36-0cf82584b31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:33:06 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-e6bf9791-623d-4bdc-8ccc-765bdfab6e59 tempest-VolumesTransfersV355Test-227769028 None] Volume volume-26d17756-aa9d-45d8-8f83-728ed3b1094b (26d17756-aa9d-45d8-8f83-728ed3b1094b): created successfully Nov 03 20:33:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e6bf9791-623d-4bdc-8ccc-765bdfab6e59 tempest-VolumesTransfersV355Test-227769028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c07e437e-fee6-4b75-9a36-0cf82584b31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:33:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e6bf9791-623d-4bdc-8ccc-765bdfab6e59 tempest-VolumesTransfersV355Test-227769028 None] Flow 'volume_create_manager' (14c12fcb-3a21-4271-9ccd-f20dfc3fb726) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:33:06 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-e6bf9791-623d-4bdc-8ccc-765bdfab6e59 tempest-VolumesTransfersV355Test-227769028 None] Created volume successfully. Nov 03 20:33:07 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-75776f39-b4bf-4844-8299-27f25fb26159 tempest-VolumesTransfersV355Test-1903122419 None] Acquiring lock "cinder-26d17756-aa9d-45d8-8f83-728ed3b1094b-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:33:07 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-75776f39-b4bf-4844-8299-27f25fb26159 tempest-VolumesTransfersV355Test-1903122419 None] Lock "cinder-26d17756-aa9d-45d8-8f83-728ed3b1094b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:33:07 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-75776f39-b4bf-4844-8299-27f25fb26159 tempest-VolumesTransfersV355Test-1903122419 None] Acquiring lock "cinder-quobyte-26d17756-aa9d-45d8-8f83-728ed3b1094b" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:33:07 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-75776f39-b4bf-4844-8299-27f25fb26159 tempest-VolumesTransfersV355Test-1903122419 None] Lock "cinder-quobyte-26d17756-aa9d-45d8-8f83-728ed3b1094b" acquired by "delete_volume" :: waited 0.017s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:33:07 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c1cce4-e705-479f-81c4-ba9cf17c8ade]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:33:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75776f39-b4bf-4844-8299-27f25fb26159 tempest-VolumesTransfersV355Test-1903122419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-26d17756-aa9d-45d8-8f83-728ed3b1094b {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:07 devstack sudo[104092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-26d17756-aa9d-45d8-8f83-728ed3b1094b Nov 03 20:33:07 devstack sudo[104092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:07 devstack sudo[104092]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75776f39-b4bf-4844-8299-27f25fb26159 tempest-VolumesTransfersV355Test-1903122419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-26d17756-aa9d-45d8-8f83-728ed3b1094b" returned: 0 in 0.353s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75776f39-b4bf-4844-8299-27f25fb26159 tempest-VolumesTransfersV355Test-1903122419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-26d17756-aa9d-45d8-8f83-728ed3b1094b {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:07 devstack sudo[104097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-26d17756-aa9d-45d8-8f83-728ed3b1094b Nov 03 20:33:07 devstack sudo[104097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:08 devstack sudo[104097]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75776f39-b4bf-4844-8299-27f25fb26159 tempest-VolumesTransfersV355Test-1903122419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-26d17756-aa9d-45d8-8f83-728ed3b1094b" returned: 0 in 0.247s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:08 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-75776f39-b4bf-4844-8299-27f25fb26159 tempest-VolumesTransfersV355Test-1903122419 None] Lock "cinder-quobyte-26d17756-aa9d-45d8-8f83-728ed3b1094b" released by "delete_volume" :: held 0.655s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:33:08 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-75776f39-b4bf-4844-8299-27f25fb26159 tempest-VolumesTransfersV355Test-1903122419 None] Created reservations ['62a78eb7-2606-491d-bbce-8bc673ca356e', '134fb8d2-a7f8-4e08-beab-4cf6c775c1de', '503f8e11-ebb9-4298-b666-a50454890026', '9c216894-5d6b-4782-bf9b-46a268270357'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:33:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75776f39-b4bf-4844-8299-27f25fb26159 tempest-VolumesTransfersV355Test-1903122419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:33:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75776f39-b4bf-4844-8299-27f25fb26159 tempest-VolumesTransfersV355Test-1903122419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:33:08 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75776f39-b4bf-4844-8299-27f25fb26159 tempest-VolumesTransfersV355Test-1903122419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:33:08 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75776f39-b4bf-4844-8299-27f25fb26159 tempest-VolumesTransfersV355Test-1903122419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:33:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75776f39-b4bf-4844-8299-27f25fb26159 tempest-VolumesTransfersV355Test-1903122419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:33:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75776f39-b4bf-4844-8299-27f25fb26159 tempest-VolumesTransfersV355Test-1903122419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:08 devstack sudo[104100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:33:08 devstack sudo[104100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:08 devstack sudo[104100]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75776f39-b4bf-4844-8299-27f25fb26159 tempest-VolumesTransfersV355Test-1903122419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.260s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:08 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-75776f39-b4bf-4844-8299-27f25fb26159 tempest-VolumesTransfersV355Test-1903122419 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:33:08 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-75776f39-b4bf-4844-8299-27f25fb26159 tempest-VolumesTransfersV355Test-1903122419 None] Deleted volume successfully. Nov 03 20:33:08 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-75776f39-b4bf-4844-8299-27f25fb26159 tempest-VolumesTransfersV355Test-1903122419 None] Lock "cinder-26d17756-aa9d-45d8-8f83-728ed3b1094b-delete_volume" released by "delete_volume" :: held 1.149s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:33:14 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-22d925c7-491b-43eb-84b8-44636700dc2b tempest-VolumesCloneNegativeTest-1491602938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:33:14 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-22d925c7-491b-43eb-84b8-44636700dc2b tempest-VolumesCloneNegativeTest-1491602938 None] Flow 'volume_create_manager' (f79109f5-9403-4592-a746-ea8708697194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:33:14 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-22d925c7-491b-43eb-84b8-44636700dc2b tempest-VolumesCloneNegativeTest-1491602938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6596aad-cb9a-4d64-b2c7-73fb09f931e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:33:14 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-22d925c7-491b-43eb-84b8-44636700dc2b tempest-VolumesCloneNegativeTest-1491602938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6596aad-cb9a-4d64-b2c7-73fb09f931e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1607727241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8234ee03-30eb-49d8-8813-48b1ed3ed6b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3fca0f678f34cdf8dbca64a01e36b6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:33:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:33:15Z,use_quota=True,user_id='c5aeb297d4694ab68b0f2aa2af8c4941',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:33:14 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-22d925c7-491b-43eb-84b8-44636700dc2b tempest-VolumesCloneNegativeTest-1491602938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff90774f-be9f-4426-a3ff-1ed73ce92731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:33:14 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-22d925c7-491b-43eb-84b8-44636700dc2b tempest-VolumesCloneNegativeTest-1491602938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff90774f-be9f-4426-a3ff-1ed73ce92731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:33:14 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-22d925c7-491b-43eb-84b8-44636700dc2b tempest-VolumesCloneNegativeTest-1491602938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33e89cae-60fd-4ddc-a08b-c9dfb6259302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:33:14 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-22d925c7-491b-43eb-84b8-44636700dc2b tempest-VolumesCloneNegativeTest-1491602938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33e89cae-60fd-4ddc-a08b-c9dfb6259302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8234ee03-30eb-49d8-8813-48b1ed3ed6b9', 'volume_name': 'volume-8234ee03-30eb-49d8-8813-48b1ed3ed6b9', 'volume_size': 2}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:33:14 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-22d925c7-491b-43eb-84b8-44636700dc2b tempest-VolumesCloneNegativeTest-1491602938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79f27028-d29f-42fb-af5a-62954262ca25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:33:14 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-22d925c7-491b-43eb-84b8-44636700dc2b tempest-VolumesCloneNegativeTest-1491602938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79f27028-d29f-42fb-af5a-62954262ca25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:33:14 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-22d925c7-491b-43eb-84b8-44636700dc2b tempest-VolumesCloneNegativeTest-1491602938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50318977-ffb2-4478-928e-203eac0629a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:33:14 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-22d925c7-491b-43eb-84b8-44636700dc2b tempest-VolumesCloneNegativeTest-1491602938 None] Volume 8234ee03-30eb-49d8-8813-48b1ed3ed6b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8234ee03-30eb-49d8-8813-48b1ed3ed6b9', 'volume_size': 2} Nov 03 20:33:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-22d925c7-491b-43eb-84b8-44636700dc2b tempest-VolumesCloneNegativeTest-1491602938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:33:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-22d925c7-491b-43eb-84b8-44636700dc2b tempest-VolumesCloneNegativeTest-1491602938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:33:14 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-22d925c7-491b-43eb-84b8-44636700dc2b tempest-VolumesCloneNegativeTest-1491602938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1607727241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8234ee03-30eb-49d8-8813-48b1ed3ed6b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3fca0f678f34cdf8dbca64a01e36b6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:33:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:33:15Z,use_quota=True,user_id='c5aeb297d4694ab68b0f2aa2af8c4941',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:33:14 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-22d925c7-491b-43eb-84b8-44636700dc2b tempest-VolumesCloneNegativeTest-1491602938 None] Creating volume 8234ee03-30eb-49d8-8813-48b1ed3ed6b9 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:33:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-22d925c7-491b-43eb-84b8-44636700dc2b tempest-VolumesCloneNegativeTest-1491602938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:33:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-22d925c7-491b-43eb-84b8-44636700dc2b tempest-VolumesCloneNegativeTest-1491602938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:33:14 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-22d925c7-491b-43eb-84b8-44636700dc2b tempest-VolumesCloneNegativeTest-1491602938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:33:14 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-22d925c7-491b-43eb-84b8-44636700dc2b tempest-VolumesCloneNegativeTest-1491602938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:33:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-22d925c7-491b-43eb-84b8-44636700dc2b tempest-VolumesCloneNegativeTest-1491602938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:33:14 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-22d925c7-491b-43eb-84b8-44636700dc2b tempest-VolumesCloneNegativeTest-1491602938 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:33:14 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-22d925c7-491b-43eb-84b8-44636700dc2b tempest-VolumesCloneNegativeTest-1491602938 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:33:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-22d925c7-491b-43eb-84b8-44636700dc2b tempest-VolumesCloneNegativeTest-1491602938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8234ee03-30eb-49d8-8813-48b1ed3ed6b9 2147483648 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:14 devstack sudo[104153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8234ee03-30eb-49d8-8813-48b1ed3ed6b9 2147483648 Nov 03 20:33:14 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:15 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-22d925c7-491b-43eb-84b8-44636700dc2b tempest-VolumesCloneNegativeTest-1491602938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8234ee03-30eb-49d8-8813-48b1ed3ed6b9 2147483648" returned: 0 in 0.477s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-22d925c7-491b-43eb-84b8-44636700dc2b tempest-VolumesCloneNegativeTest-1491602938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8234ee03-30eb-49d8-8813-48b1ed3ed6b9 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:15 devstack sudo[104161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8234ee03-30eb-49d8-8813-48b1ed3ed6b9 Nov 03 20:33:15 devstack sudo[104161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:15 devstack sudo[104161]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-22d925c7-491b-43eb-84b8-44636700dc2b tempest-VolumesCloneNegativeTest-1491602938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8234ee03-30eb-49d8-8813-48b1ed3ed6b9" returned: 0 in 0.253s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:15 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-22d925c7-491b-43eb-84b8-44636700dc2b tempest-VolumesCloneNegativeTest-1491602938 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:33:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-22d925c7-491b-43eb-84b8-44636700dc2b tempest-VolumesCloneNegativeTest-1491602938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:33:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-22d925c7-491b-43eb-84b8-44636700dc2b tempest-VolumesCloneNegativeTest-1491602938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50318977-ffb2-4478-928e-203eac0629a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8234ee03-30eb-49d8-8813-48b1ed3ed6b9', 'volume_size': 2}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:33:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-22d925c7-491b-43eb-84b8-44636700dc2b tempest-VolumesCloneNegativeTest-1491602938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c52c1d8-7b2e-40e4-94f7-6ea63912e459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:33:15 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-22d925c7-491b-43eb-84b8-44636700dc2b tempest-VolumesCloneNegativeTest-1491602938 None] Volume volume-8234ee03-30eb-49d8-8813-48b1ed3ed6b9 (8234ee03-30eb-49d8-8813-48b1ed3ed6b9): created successfully Nov 03 20:33:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-22d925c7-491b-43eb-84b8-44636700dc2b tempest-VolumesCloneNegativeTest-1491602938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c52c1d8-7b2e-40e4-94f7-6ea63912e459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:33:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-22d925c7-491b-43eb-84b8-44636700dc2b tempest-VolumesCloneNegativeTest-1491602938 None] Flow 'volume_create_manager' (f79109f5-9403-4592-a746-ea8708697194) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:33:15 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-22d925c7-491b-43eb-84b8-44636700dc2b tempest-VolumesCloneNegativeTest-1491602938 None] Created volume successfully. Nov 03 20:33:16 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9d15620a-5998-4552-b889-bb394b1254c2 tempest-VolumesCloneNegativeTest-1491602938 None] Acquiring lock "cinder-8234ee03-30eb-49d8-8813-48b1ed3ed6b9-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:33:16 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9d15620a-5998-4552-b889-bb394b1254c2 tempest-VolumesCloneNegativeTest-1491602938 None] Lock "cinder-8234ee03-30eb-49d8-8813-48b1ed3ed6b9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:33:16 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9d15620a-5998-4552-b889-bb394b1254c2 tempest-VolumesCloneNegativeTest-1491602938 None] Acquiring lock "cinder-quobyte-8234ee03-30eb-49d8-8813-48b1ed3ed6b9" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:33:17 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9d15620a-5998-4552-b889-bb394b1254c2 tempest-VolumesCloneNegativeTest-1491602938 None] Lock "cinder-quobyte-8234ee03-30eb-49d8-8813-48b1ed3ed6b9" acquired by "delete_volume" :: waited 0.014s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:33:17 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[58cda702-3a16-42ec-b101-d464ccd2e090]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:33:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9d15620a-5998-4552-b889-bb394b1254c2 tempest-VolumesCloneNegativeTest-1491602938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8234ee03-30eb-49d8-8813-48b1ed3ed6b9 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:17 devstack sudo[104164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8234ee03-30eb-49d8-8813-48b1ed3ed6b9 Nov 03 20:33:17 devstack sudo[104164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:17 devstack sudo[104164]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9d15620a-5998-4552-b889-bb394b1254c2 tempest-VolumesCloneNegativeTest-1491602938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8234ee03-30eb-49d8-8813-48b1ed3ed6b9" returned: 0 in 0.360s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9d15620a-5998-4552-b889-bb394b1254c2 tempest-VolumesCloneNegativeTest-1491602938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8234ee03-30eb-49d8-8813-48b1ed3ed6b9 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:17 devstack sudo[104169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8234ee03-30eb-49d8-8813-48b1ed3ed6b9 Nov 03 20:33:17 devstack sudo[104169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:17 devstack sudo[104169]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9d15620a-5998-4552-b889-bb394b1254c2 tempest-VolumesCloneNegativeTest-1491602938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8234ee03-30eb-49d8-8813-48b1ed3ed6b9" returned: 0 in 0.238s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:17 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9d15620a-5998-4552-b889-bb394b1254c2 tempest-VolumesCloneNegativeTest-1491602938 None] Lock "cinder-quobyte-8234ee03-30eb-49d8-8813-48b1ed3ed6b9" released by "delete_volume" :: held 0.642s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:33:17 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-9d15620a-5998-4552-b889-bb394b1254c2 tempest-VolumesCloneNegativeTest-1491602938 None] Created reservations ['fa10f755-6d3f-4dde-91f8-f75e524ce9c7', '800c5dac-ff52-408c-adb0-d02b488b8c79', 'd8acbbb8-bac0-4786-81ef-b23a2dac399b', '1f5fb3c7-1b20-4fa9-8848-ef88e0dbee4f'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:33:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-9d15620a-5998-4552-b889-bb394b1254c2 tempest-VolumesCloneNegativeTest-1491602938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:33:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-9d15620a-5998-4552-b889-bb394b1254c2 tempest-VolumesCloneNegativeTest-1491602938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:33:17 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-9d15620a-5998-4552-b889-bb394b1254c2 tempest-VolumesCloneNegativeTest-1491602938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:33:17 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-9d15620a-5998-4552-b889-bb394b1254c2 tempest-VolumesCloneNegativeTest-1491602938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:33:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-9d15620a-5998-4552-b889-bb394b1254c2 tempest-VolumesCloneNegativeTest-1491602938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:33:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9d15620a-5998-4552-b889-bb394b1254c2 tempest-VolumesCloneNegativeTest-1491602938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:17 devstack sudo[104172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:33:17 devstack sudo[104172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:17 devstack sudo[104172]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9d15620a-5998-4552-b889-bb394b1254c2 tempest-VolumesCloneNegativeTest-1491602938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.238s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:17 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-9d15620a-5998-4552-b889-bb394b1254c2 tempest-VolumesCloneNegativeTest-1491602938 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:33:17 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-9d15620a-5998-4552-b889-bb394b1254c2 tempest-VolumesCloneNegativeTest-1491602938 None] Deleted volume successfully. Nov 03 20:33:18 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9d15620a-5998-4552-b889-bb394b1254c2 tempest-VolumesCloneNegativeTest-1491602938 None] Lock "cinder-8234ee03-30eb-49d8-8813-48b1ed3ed6b9-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:33:24 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8a94228-1920-4a61-9455-f444e233a29e tempest-VolumesNegativeTest-76211067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:33:24 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f8a94228-1920-4a61-9455-f444e233a29e tempest-VolumesNegativeTest-76211067 None] Flow 'volume_create_manager' (777bdb1d-7cee-4b4a-8241-01bb765411fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:33:24 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f8a94228-1920-4a61-9455-f444e233a29e tempest-VolumesNegativeTest-76211067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0350aef3-db96-4ef6-9b4b-0fce85df710e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:33:24 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f8a94228-1920-4a61-9455-f444e233a29e tempest-VolumesNegativeTest-76211067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0350aef3-db96-4ef6-9b4b-0fce85df710e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-134081410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f83fd028-4dae-4ead-9235-ae4e02223c25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff8c0d60b5a441cd929a1f80a98e244b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:33:24Z,use_quota=True,user_id='a86daed6cb334645a7c3b1d12a1bf167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:33:24 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f8a94228-1920-4a61-9455-f444e233a29e tempest-VolumesNegativeTest-76211067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fc8f2a3-f808-4e4c-8201-2c30431c3df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:33:24 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f8a94228-1920-4a61-9455-f444e233a29e tempest-VolumesNegativeTest-76211067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fc8f2a3-f808-4e4c-8201-2c30431c3df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:33:24 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f8a94228-1920-4a61-9455-f444e233a29e tempest-VolumesNegativeTest-76211067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b55e3835-8c51-4ec4-a123-948633151639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:33:24 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f8a94228-1920-4a61-9455-f444e233a29e tempest-VolumesNegativeTest-76211067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b55e3835-8c51-4ec4-a123-948633151639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f83fd028-4dae-4ead-9235-ae4e02223c25', 'volume_name': 'volume-f83fd028-4dae-4ead-9235-ae4e02223c25', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:33:24 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f8a94228-1920-4a61-9455-f444e233a29e tempest-VolumesNegativeTest-76211067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c210ce3-8d06-44e7-9348-a969a9600501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:33:24 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f8a94228-1920-4a61-9455-f444e233a29e tempest-VolumesNegativeTest-76211067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c210ce3-8d06-44e7-9348-a969a9600501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:33:24 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f8a94228-1920-4a61-9455-f444e233a29e tempest-VolumesNegativeTest-76211067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db32cf83-9cf2-4299-b88f-ea1b25045cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:33:24 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-f8a94228-1920-4a61-9455-f444e233a29e tempest-VolumesNegativeTest-76211067 None] Volume f83fd028-4dae-4ead-9235-ae4e02223c25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f83fd028-4dae-4ead-9235-ae4e02223c25', 'volume_size': 1} Nov 03 20:33:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f8a94228-1920-4a61-9455-f444e233a29e tempest-VolumesNegativeTest-76211067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:33:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f8a94228-1920-4a61-9455-f444e233a29e tempest-VolumesNegativeTest-76211067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:33:24 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-f8a94228-1920-4a61-9455-f444e233a29e tempest-VolumesNegativeTest-76211067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-134081410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f83fd028-4dae-4ead-9235-ae4e02223c25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff8c0d60b5a441cd929a1f80a98e244b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:33:24Z,use_quota=True,user_id='a86daed6cb334645a7c3b1d12a1bf167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:33:24 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-f8a94228-1920-4a61-9455-f444e233a29e tempest-VolumesNegativeTest-76211067 None] Creating volume f83fd028-4dae-4ead-9235-ae4e02223c25 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:33:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f8a94228-1920-4a61-9455-f444e233a29e tempest-VolumesNegativeTest-76211067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:33:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f8a94228-1920-4a61-9455-f444e233a29e tempest-VolumesNegativeTest-76211067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:33:24 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-f8a94228-1920-4a61-9455-f444e233a29e tempest-VolumesNegativeTest-76211067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:33:24 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-f8a94228-1920-4a61-9455-f444e233a29e tempest-VolumesNegativeTest-76211067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:33:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f8a94228-1920-4a61-9455-f444e233a29e tempest-VolumesNegativeTest-76211067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:33:24 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-f8a94228-1920-4a61-9455-f444e233a29e tempest-VolumesNegativeTest-76211067 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:33:24 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-f8a94228-1920-4a61-9455-f444e233a29e tempest-VolumesNegativeTest-76211067 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:33:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f8a94228-1920-4a61-9455-f444e233a29e tempest-VolumesNegativeTest-76211067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f83fd028-4dae-4ead-9235-ae4e02223c25 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:24 devstack sudo[104177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f83fd028-4dae-4ead-9235-ae4e02223c25 1073741824 Nov 03 20:33:24 devstack sudo[104177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:24 devstack sudo[104177]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f8a94228-1920-4a61-9455-f444e233a29e tempest-VolumesNegativeTest-76211067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f83fd028-4dae-4ead-9235-ae4e02223c25 1073741824" returned: 0 in 0.409s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f8a94228-1920-4a61-9455-f444e233a29e tempest-VolumesNegativeTest-76211067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f83fd028-4dae-4ead-9235-ae4e02223c25 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:24 devstack sudo[104182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f83fd028-4dae-4ead-9235-ae4e02223c25 Nov 03 20:33:24 devstack sudo[104182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:25 devstack sudo[104182]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f8a94228-1920-4a61-9455-f444e233a29e tempest-VolumesNegativeTest-76211067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f83fd028-4dae-4ead-9235-ae4e02223c25" returned: 0 in 0.238s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:25 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-f8a94228-1920-4a61-9455-f444e233a29e tempest-VolumesNegativeTest-76211067 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:33:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f8a94228-1920-4a61-9455-f444e233a29e tempest-VolumesNegativeTest-76211067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:33:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f8a94228-1920-4a61-9455-f444e233a29e tempest-VolumesNegativeTest-76211067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db32cf83-9cf2-4299-b88f-ea1b25045cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f83fd028-4dae-4ead-9235-ae4e02223c25', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:33:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f8a94228-1920-4a61-9455-f444e233a29e tempest-VolumesNegativeTest-76211067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5a21dde-9d10-448d-b51b-832013f8f1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:33:25 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-f8a94228-1920-4a61-9455-f444e233a29e tempest-VolumesNegativeTest-76211067 None] Volume volume-f83fd028-4dae-4ead-9235-ae4e02223c25 (f83fd028-4dae-4ead-9235-ae4e02223c25): created successfully Nov 03 20:33:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f8a94228-1920-4a61-9455-f444e233a29e tempest-VolumesNegativeTest-76211067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5a21dde-9d10-448d-b51b-832013f8f1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:33:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f8a94228-1920-4a61-9455-f444e233a29e tempest-VolumesNegativeTest-76211067 None] Flow 'volume_create_manager' (777bdb1d-7cee-4b4a-8241-01bb765411fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:33:25 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-f8a94228-1920-4a61-9455-f444e233a29e tempest-VolumesNegativeTest-76211067 None] Created volume successfully. Nov 03 20:33:28 devstack cinder-volume[87248]: DEBUG oslo_service.periodic_task [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running periodic task VolumeManager._thread_info {{(pid=87248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:33:28 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] thread count: 28 {{(pid=87248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:33:28 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] thread info: [<_MainThread(MainThread, started 124862067372160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:33:35 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:SELECT=27,cinder:DELETE=4,cinder:UPDATE=37,cinder:INSERT=11 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:33:35 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:SELECT=30,cinder:UPDATE=43,cinder:INSERT=7,cinder:DELETE=5 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:33:40 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-0c7b8f1a-dca6-4330-bec8-c2751cc7a8ad tempest-VolumesNegativeTest-76211067 None] Acquiring lock "cinder-f83fd028-4dae-4ead-9235-ae4e02223c25-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:33:40 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-0c7b8f1a-dca6-4330-bec8-c2751cc7a8ad tempest-VolumesNegativeTest-76211067 None] Lock "cinder-f83fd028-4dae-4ead-9235-ae4e02223c25-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:33:40 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-0c7b8f1a-dca6-4330-bec8-c2751cc7a8ad tempest-VolumesNegativeTest-76211067 None] Acquiring lock "cinder-quobyte-f83fd028-4dae-4ead-9235-ae4e02223c25" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:33:40 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-0c7b8f1a-dca6-4330-bec8-c2751cc7a8ad tempest-VolumesNegativeTest-76211067 None] Lock "cinder-quobyte-f83fd028-4dae-4ead-9235-ae4e02223c25" acquired by "delete_volume" :: waited 0.015s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:33:40 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[789c3fc7-75d3-44cd-bfbe-5783bfb26cc2]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:33:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-0c7b8f1a-dca6-4330-bec8-c2751cc7a8ad tempest-VolumesNegativeTest-76211067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f83fd028-4dae-4ead-9235-ae4e02223c25 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:40 devstack sudo[104318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f83fd028-4dae-4ead-9235-ae4e02223c25 Nov 03 20:33:40 devstack sudo[104318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:40 devstack sudo[104318]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-0c7b8f1a-dca6-4330-bec8-c2751cc7a8ad tempest-VolumesNegativeTest-76211067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f83fd028-4dae-4ead-9235-ae4e02223c25" returned: 0 in 0.346s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-0c7b8f1a-dca6-4330-bec8-c2751cc7a8ad tempest-VolumesNegativeTest-76211067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f83fd028-4dae-4ead-9235-ae4e02223c25 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:41 devstack sudo[104324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f83fd028-4dae-4ead-9235-ae4e02223c25 Nov 03 20:33:41 devstack sudo[104324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:41 devstack sudo[104324]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-0c7b8f1a-dca6-4330-bec8-c2751cc7a8ad tempest-VolumesNegativeTest-76211067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f83fd028-4dae-4ead-9235-ae4e02223c25" returned: 0 in 0.237s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:41 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-0c7b8f1a-dca6-4330-bec8-c2751cc7a8ad tempest-VolumesNegativeTest-76211067 None] Lock "cinder-quobyte-f83fd028-4dae-4ead-9235-ae4e02223c25" released by "delete_volume" :: held 0.622s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:33:41 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-0c7b8f1a-dca6-4330-bec8-c2751cc7a8ad tempest-VolumesNegativeTest-76211067 None] Created reservations ['57d8eb73-42da-4da3-bfc2-4d69cf97ac99', '7bdd6182-01a6-4914-9dd5-3b2239f48111', '49e0ffea-ed73-4e7d-9146-4ee78a85a303', '3b9a2a2e-973d-48bd-a0fb-3a45b197efde'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:33:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-0c7b8f1a-dca6-4330-bec8-c2751cc7a8ad tempest-VolumesNegativeTest-76211067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:33:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-0c7b8f1a-dca6-4330-bec8-c2751cc7a8ad tempest-VolumesNegativeTest-76211067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:33:41 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-0c7b8f1a-dca6-4330-bec8-c2751cc7a8ad tempest-VolumesNegativeTest-76211067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:33:41 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-0c7b8f1a-dca6-4330-bec8-c2751cc7a8ad tempest-VolumesNegativeTest-76211067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:33:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-0c7b8f1a-dca6-4330-bec8-c2751cc7a8ad tempest-VolumesNegativeTest-76211067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:33:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-0c7b8f1a-dca6-4330-bec8-c2751cc7a8ad tempest-VolumesNegativeTest-76211067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:41 devstack sudo[104331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:33:41 devstack sudo[104331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:41 devstack sudo[104331]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-0c7b8f1a-dca6-4330-bec8-c2751cc7a8ad tempest-VolumesNegativeTest-76211067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.258s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:41 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-0c7b8f1a-dca6-4330-bec8-c2751cc7a8ad tempest-VolumesNegativeTest-76211067 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:33:41 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-0c7b8f1a-dca6-4330-bec8-c2751cc7a8ad tempest-VolumesNegativeTest-76211067 None] Deleted volume successfully. Nov 03 20:33:41 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-0c7b8f1a-dca6-4330-bec8-c2751cc7a8ad tempest-VolumesNegativeTest-76211067 None] Lock "cinder-f83fd028-4dae-4ead-9235-ae4e02223c25-delete_volume" released by "delete_volume" :: held 1.092s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:33:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-5387a669-64c4-428f-b450-8c6ab179a34c req-83350784-40dc-410c-94b5-de217a98094a tempest-TestStampPattern-702523091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:33:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-5387a669-64c4-428f-b450-8c6ab179a34c req-83350784-40dc-410c-94b5-de217a98094a tempest-TestStampPattern-702523091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:33:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-5387a669-64c4-428f-b450-8c6ab179a34c req-83350784-40dc-410c-94b5-de217a98094a tempest-TestStampPattern-702523091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:33:42 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-5387a669-64c4-428f-b450-8c6ab179a34c req-83350784-40dc-410c-94b5-de217a98094a tempest-TestStampPattern-702523091 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8', 'name': 'volume-2e19fa12-9c1b-4b3f-91da-89e5342c788a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3eb4d81e-d93a-4653-8a34-bed1ed0fcd6a', 'enforce_multipath': True} {{(pid=87248) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 20:33:42 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-5387a669-64c4-428f-b450-8c6ab179a34c req-83350784-40dc-410c-94b5-de217a98094a tempest-TestStampPattern-702523091 None] attachment_update completed successfully. Nov 03 20:33:45 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-846374c6-05c8-4746-b1e3-39adfa4c6e2b req-a92e4149-0450-4fa2-8537-6a00abd38794 tempest-TestStampPattern-702523091 None] Terminate volume connection completed successfully. Nov 03 20:33:45 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-846374c6-05c8-4746-b1e3-39adfa4c6e2b req-a92e4149-0450-4fa2-8537-6a00abd38794 tempest-TestStampPattern-702523091 None] Deleting attachment 3eb4d81e-d93a-4653-8a34-bed1ed0fcd6a. {{(pid=87248) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 20:33:50 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c63c6f21-04d3-45b3-a2a2-b461cd9ab85c tempest-TestStampPattern-702523091 None] Acquiring lock "cinder-2e19fa12-9c1b-4b3f-91da-89e5342c788a-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:33:50 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c63c6f21-04d3-45b3-a2a2-b461cd9ab85c tempest-TestStampPattern-702523091 None] Lock "cinder-2e19fa12-9c1b-4b3f-91da-89e5342c788a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:33:50 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c63c6f21-04d3-45b3-a2a2-b461cd9ab85c tempest-TestStampPattern-702523091 None] Acquiring lock "cinder-quobyte-2e19fa12-9c1b-4b3f-91da-89e5342c788a" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:33:51 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c63c6f21-04d3-45b3-a2a2-b461cd9ab85c tempest-TestStampPattern-702523091 None] Lock "cinder-quobyte-2e19fa12-9c1b-4b3f-91da-89e5342c788a" acquired by "delete_volume" :: waited 0.021s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:33:51 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1821c5-98a1-4ee6-b622-7080221bad9a]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:33:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c63c6f21-04d3-45b3-a2a2-b461cd9ab85c tempest-TestStampPattern-702523091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2e19fa12-9c1b-4b3f-91da-89e5342c788a {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:51 devstack sudo[104832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2e19fa12-9c1b-4b3f-91da-89e5342c788a Nov 03 20:33:51 devstack sudo[104832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:51 devstack sudo[104832]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c63c6f21-04d3-45b3-a2a2-b461cd9ab85c tempest-TestStampPattern-702523091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2e19fa12-9c1b-4b3f-91da-89e5342c788a" returned: 0 in 0.379s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c63c6f21-04d3-45b3-a2a2-b461cd9ab85c tempest-TestStampPattern-702523091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2e19fa12-9c1b-4b3f-91da-89e5342c788a {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:51 devstack sudo[104837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2e19fa12-9c1b-4b3f-91da-89e5342c788a Nov 03 20:33:51 devstack sudo[104837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:51 devstack sudo[104837]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c63c6f21-04d3-45b3-a2a2-b461cd9ab85c tempest-TestStampPattern-702523091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2e19fa12-9c1b-4b3f-91da-89e5342c788a" returned: 0 in 0.276s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:51 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c63c6f21-04d3-45b3-a2a2-b461cd9ab85c tempest-TestStampPattern-702523091 None] Lock "cinder-quobyte-2e19fa12-9c1b-4b3f-91da-89e5342c788a" released by "delete_volume" :: held 0.700s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:33:51 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-c63c6f21-04d3-45b3-a2a2-b461cd9ab85c tempest-TestStampPattern-702523091 None] Created reservations ['6764d9dd-c7ba-44b1-8275-c4c5e7e197b2', '83c62c0a-18b3-4b71-9756-fa42b96d7ac0', '562f305e-831a-45e0-a443-f3001667e517', 'aaec4d5f-ce82-49c2-839a-094c98290338'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:33:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c63c6f21-04d3-45b3-a2a2-b461cd9ab85c tempest-TestStampPattern-702523091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:33:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c63c6f21-04d3-45b3-a2a2-b461cd9ab85c tempest-TestStampPattern-702523091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:33:51 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c63c6f21-04d3-45b3-a2a2-b461cd9ab85c tempest-TestStampPattern-702523091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:33:51 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c63c6f21-04d3-45b3-a2a2-b461cd9ab85c tempest-TestStampPattern-702523091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:33:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c63c6f21-04d3-45b3-a2a2-b461cd9ab85c tempest-TestStampPattern-702523091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:33:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c63c6f21-04d3-45b3-a2a2-b461cd9ab85c tempest-TestStampPattern-702523091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:51 devstack sudo[104840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:33:51 devstack sudo[104840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:52 devstack sudo[104840]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c63c6f21-04d3-45b3-a2a2-b461cd9ab85c tempest-TestStampPattern-702523091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.247s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:52 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-c63c6f21-04d3-45b3-a2a2-b461cd9ab85c tempest-TestStampPattern-702523091 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:33:52 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-c63c6f21-04d3-45b3-a2a2-b461cd9ab85c tempest-TestStampPattern-702523091 None] Deleted volume successfully. Nov 03 20:33:52 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c63c6f21-04d3-45b3-a2a2-b461cd9ab85c tempest-TestStampPattern-702523091 None] Lock "cinder-2e19fa12-9c1b-4b3f-91da-89e5342c788a-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:33:52 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8cd2b746-75c6-4e12-9b48-3cf8c39bb4b8 tempest-TestStampPattern-702523091 None] Acquiring lock "cinder-3b7fba2c-ad7c-42f8-a796-374aa3e6b7ce-delete_snapshot" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:33:52 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8cd2b746-75c6-4e12-9b48-3cf8c39bb4b8 tempest-TestStampPattern-702523091 None] Lock "cinder-3b7fba2c-ad7c-42f8-a796-374aa3e6b7ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:33:52 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8cd2b746-75c6-4e12-9b48-3cf8c39bb4b8 tempest-TestStampPattern-702523091 None] Acquiring lock "cinder-quobyte-0a43636c-c09b-4e28-9677-4809934aaa98" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:33:52 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8cd2b746-75c6-4e12-9b48-3cf8c39bb4b8 tempest-TestStampPattern-702523091 None] Lock "cinder-quobyte-0a43636c-c09b-4e28-9677-4809934aaa98" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:33:52 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8cd2b746-75c6-4e12-9b48-3cf8c39bb4b8 tempest-TestStampPattern-702523091 None] Acquiring lock "cinder-quobyte-3b7fba2c-ad7c-42f8-a796-374aa3e6b7ce" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:33:52 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8cd2b746-75c6-4e12-9b48-3cf8c39bb4b8 tempest-TestStampPattern-702523091 None] Lock "cinder-quobyte-3b7fba2c-ad7c-42f8-a796-374aa3e6b7ce" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:33:52 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-8cd2b746-75c6-4e12-9b48-3cf8c39bb4b8 tempest-TestStampPattern-702523091 None] Deleting offline snapshot 3b7fba2c-ad7c-42f8-a796-374aa3e6b7ce of volume 0a43636c-c09b-4e28-9677-4809934aaa98 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:33:52 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-8cd2b746-75c6-4e12-9b48-3cf8c39bb4b8 tempest-TestStampPattern-702523091 None] snapshot_file for this snap is: volume-0a43636c-c09b-4e28-9677-4809934aaa98.3b7fba2c-ad7c-42f8-a796-374aa3e6b7ce {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:33:52 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bba7bfa-401b-4e4a-8ef4-1439ec223429]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:33:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8cd2b746-75c6-4e12-9b48-3cf8c39bb4b8 tempest-TestStampPattern-702523091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98.3b7fba2c-ad7c-42f8-a796-374aa3e6b7ce {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:52 devstack sudo[104844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98.3b7fba2c-ad7c-42f8-a796-374aa3e6b7ce Nov 03 20:33:52 devstack sudo[104844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:52 devstack sudo[104844]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8cd2b746-75c6-4e12-9b48-3cf8c39bb4b8 tempest-TestStampPattern-702523091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98.3b7fba2c-ad7c-42f8-a796-374aa3e6b7ce" returned: 0 in 0.383s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:52 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-8cd2b746-75c6-4e12-9b48-3cf8c39bb4b8 tempest-TestStampPattern-702523091 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a43636c-c09b-4e28-9677-4809934aaa98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:33:52 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[b096bcd1-c4a1-4d9a-bff5-147dfc885add]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:33:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8cd2b746-75c6-4e12-9b48-3cf8c39bb4b8 tempest-TestStampPattern-702523091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:53 devstack sudo[104849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98 Nov 03 20:33:53 devstack sudo[104849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:53 devstack sudo[104849]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8cd2b746-75c6-4e12-9b48-3cf8c39bb4b8 tempest-TestStampPattern-702523091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98" returned: 0 in 0.527s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8cd2b746-75c6-4e12-9b48-3cf8c39bb4b8 tempest-TestStampPattern-702523091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98.3b7fba2c-ad7c-42f8-a796-374aa3e6b7ce {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:53 devstack sudo[104854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98.3b7fba2c-ad7c-42f8-a796-374aa3e6b7ce Nov 03 20:33:53 devstack sudo[104854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:53 devstack sudo[104854]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8cd2b746-75c6-4e12-9b48-3cf8c39bb4b8 tempest-TestStampPattern-702523091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98.3b7fba2c-ad7c-42f8-a796-374aa3e6b7ce" returned: 0 in 0.363s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8cd2b746-75c6-4e12-9b48-3cf8c39bb4b8 tempest-TestStampPattern-702523091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98.3b7fba2c-ad7c-42f8-a796-374aa3e6b7ce {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:53 devstack sudo[104860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98.3b7fba2c-ad7c-42f8-a796-374aa3e6b7ce Nov 03 20:33:53 devstack sudo[104860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:54 devstack sudo[104860]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8cd2b746-75c6-4e12-9b48-3cf8c39bb4b8 tempest-TestStampPattern-702523091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98.3b7fba2c-ad7c-42f8-a796-374aa3e6b7ce" returned: 0 in 0.274s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:54 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8cd2b746-75c6-4e12-9b48-3cf8c39bb4b8 tempest-TestStampPattern-702523091 None] Lock "cinder-quobyte-3b7fba2c-ad7c-42f8-a796-374aa3e6b7ce" released by "_delete_snapshot" :: held 1.681s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:33:54 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8cd2b746-75c6-4e12-9b48-3cf8c39bb4b8 tempest-TestStampPattern-702523091 None] Lock "cinder-quobyte-0a43636c-c09b-4e28-9677-4809934aaa98" released by "delete_snapshot" :: held 1.704s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:33:54 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-8cd2b746-75c6-4e12-9b48-3cf8c39bb4b8 tempest-TestStampPattern-702523091 None] Created reservations ['5bab0400-afe6-49c8-a6ec-d1f12d9892f0', 'dd786b6c-ab9c-4406-884a-7038e5e4f994', 'e68daa46-308f-489a-b424-797ed51ff8a6', 'e7055982-c74e-4c50-8fdb-b735feced3b8'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:33:54 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-8cd2b746-75c6-4e12-9b48-3cf8c39bb4b8 tempest-TestStampPattern-702523091 None] Delete snapshot completed successfully. Nov 03 20:33:54 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8cd2b746-75c6-4e12-9b48-3cf8c39bb4b8 tempest-TestStampPattern-702523091 None] Lock "cinder-3b7fba2c-ad7c-42f8-a796-374aa3e6b7ce-delete_snapshot" released by "delete_snapshot" :: held 1.864s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:33:58 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c35ba665-c792-492f-bb24-758f7fc1e5c3 tempest-TestStampPattern-702523091 None] Acquiring lock "cinder-0a43636c-c09b-4e28-9677-4809934aaa98-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:33:58 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c35ba665-c792-492f-bb24-758f7fc1e5c3 tempest-TestStampPattern-702523091 None] Lock "cinder-0a43636c-c09b-4e28-9677-4809934aaa98-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:33:58 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c35ba665-c792-492f-bb24-758f7fc1e5c3 tempest-TestStampPattern-702523091 None] Acquiring lock "cinder-quobyte-0a43636c-c09b-4e28-9677-4809934aaa98" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:33:58 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c35ba665-c792-492f-bb24-758f7fc1e5c3 tempest-TestStampPattern-702523091 None] Lock "cinder-quobyte-0a43636c-c09b-4e28-9677-4809934aaa98" acquired by "delete_volume" :: waited 0.033s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:33:58 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[7745bbac-67ee-4e23-b118-bc97bc9383e2]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:33:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c35ba665-c792-492f-bb24-758f7fc1e5c3 tempest-TestStampPattern-702523091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:58 devstack sudo[104889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98 Nov 03 20:33:58 devstack sudo[104889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:58 devstack sudo[104889]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c35ba665-c792-492f-bb24-758f7fc1e5c3 tempest-TestStampPattern-702523091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98" returned: 0 in 0.385s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c35ba665-c792-492f-bb24-758f7fc1e5c3 tempest-TestStampPattern-702523091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:59 devstack sudo[104894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98 Nov 03 20:33:59 devstack sudo[104894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:59 devstack sudo[104894]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c35ba665-c792-492f-bb24-758f7fc1e5c3 tempest-TestStampPattern-702523091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0a43636c-c09b-4e28-9677-4809934aaa98" returned: 0 in 0.263s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:59 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c35ba665-c792-492f-bb24-758f7fc1e5c3 tempest-TestStampPattern-702523091 None] Lock "cinder-quobyte-0a43636c-c09b-4e28-9677-4809934aaa98" released by "delete_volume" :: held 0.730s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:33:59 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-c35ba665-c792-492f-bb24-758f7fc1e5c3 tempest-TestStampPattern-702523091 None] Created reservations ['6bd7d0af-ad15-4283-853c-acaf4fc6b3a9', '57f7abe6-0304-4eba-a5f4-1d68618888b6', '12875831-9ce6-4e73-bbf0-94ec364b4e57', '1e5dda1a-511c-4ddc-9455-c7043e1da173'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:33:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c35ba665-c792-492f-bb24-758f7fc1e5c3 tempest-TestStampPattern-702523091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:33:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c35ba665-c792-492f-bb24-758f7fc1e5c3 tempest-TestStampPattern-702523091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:33:59 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c35ba665-c792-492f-bb24-758f7fc1e5c3 tempest-TestStampPattern-702523091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:33:59 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c35ba665-c792-492f-bb24-758f7fc1e5c3 tempest-TestStampPattern-702523091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:33:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c35ba665-c792-492f-bb24-758f7fc1e5c3 tempest-TestStampPattern-702523091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:33:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c35ba665-c792-492f-bb24-758f7fc1e5c3 tempest-TestStampPattern-702523091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:33:59 devstack sudo[104897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:33:59 devstack sudo[104897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:33:59 devstack sudo[104897]: pam_unix(sudo:session): session closed for user root Nov 03 20:33:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c35ba665-c792-492f-bb24-758f7fc1e5c3 tempest-TestStampPattern-702523091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.281s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:33:59 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-c35ba665-c792-492f-bb24-758f7fc1e5c3 tempest-TestStampPattern-702523091 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:33:59 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-c35ba665-c792-492f-bb24-758f7fc1e5c3 tempest-TestStampPattern-702523091 None] Deleted volume successfully. Nov 03 20:33:59 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c35ba665-c792-492f-bb24-758f7fc1e5c3 tempest-TestStampPattern-702523091 None] Lock "cinder-0a43636c-c09b-4e28-9677-4809934aaa98-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:34:09 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:SELECT=31,cinder:INSERT=9,cinder:UPDATE=28 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:34:09 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:UPDATE=34,cinder:SELECT=25,cinder:INSERT=7,cinder:DELETE=3 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:34:20 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:34:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Flow 'volume_create_manager' (78a257ef-53cb-4a3d-a495-460b24a652f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:34:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a63ce32-bed2-46f1-8684-2eedb01a0d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:34:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a63ce32-bed2-46f1-8684-2eedb01a0d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:34:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee89d7ff-dccf-4c7a-a981-c77bdd4a0671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b87b9a303744630a920bdb1c1d0c8c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:34:20Z,use_quota=True,user_id='587de97ca51a45dd8fe775762ec4eaa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8649045b-c38c-4ab3-b93c-bf8337e91bd6),volume_type_id=8649045b-c38c-4ab3-b93c-bf8337e91bd6)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:34:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0753d87-6903-4ef4-a273-5e6534c47b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:34:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0753d87-6903-4ef4-a273-5e6534c47b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:34:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92451ee0-12cb-4567-9129-4678f0358454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:34:20 devstack cinder-volume[87248]: DEBUG cinder.image.glance [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Creating Keystone auth plugin from conf {{(pid=87248) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 20:34:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92451ee0-12cb-4567-9129-4678f0358454) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ee89d7ff-dccf-4c7a-a981-c77bdd4a0671', 'volume_name': 'volume-ee89d7ff-dccf-4c7a-a981-c77bdd4a0671', 'volume_size': 1, 'image_id': '367761e9-1697-4105-8c69-d567bce264fc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/367761e9-1697-4105-8c69-d567bce264fc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '21fd9bdfe48c178790102928be3d25f5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2b87b9a303744630a920bdb1c1d0c8c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0e8b148d9bc085b0fffd14380f16dada941d5534b010d56c2da96cf715f5f9887dcbd4beabfb7708c6e4c630369dac50bb0649495f35767aba1484f62ae154df', 'id': '367761e9-1697-4105-8c69-d567bce264fc', 'created_at': datetime.datetime(2026, 11, 3, 19, 34, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 34, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/367761e9-1697-4105-8c69-d567bce264fc/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:34:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (200fee38-f5ce-4c14-9e5b-5b8c29eb293d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:34:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (200fee38-f5ce-4c14-9e5b-5b8c29eb293d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:34:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e45546ad-708d-48ae-ae71-ee63fa211221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:34:20 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Volume ee89d7ff-dccf-4c7a-a981-c77bdd4a0671: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ee89d7ff-dccf-4c7a-a981-c77bdd4a0671', 'volume_size': 1, 'image_id': '367761e9-1697-4105-8c69-d567bce264fc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/367761e9-1697-4105-8c69-d567bce264fc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '21fd9bdfe48c178790102928be3d25f5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2b87b9a303744630a920bdb1c1d0c8c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0e8b148d9bc085b0fffd14380f16dada941d5534b010d56c2da96cf715f5f9887dcbd4beabfb7708c6e4c630369dac50bb0649495f35767aba1484f62ae154df', 'id': '367761e9-1697-4105-8c69-d567bce264fc', 'created_at': datetime.datetime(2026, 11, 3, 19, 34, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 34, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/367761e9-1697-4105-8c69-d567bce264fc/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 03 20:34:20 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Trying to clone ee89d7ff-dccf-4c7a-a981-c77bdd4a0671 from image 367761e9-1697-4105-8c69-d567bce264fc at location (None, [{'url': 'file:///opt/stack/data/glance/images/367761e9-1697-4105-8c69-d567bce264fc', 'metadata': {}}]). {{(pid=87248) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 20:34:20 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_367761e9-1697-4105-8c69-d567bce264fc_1rzdcxzbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87248) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 20:34:20 devstack cinder-volume[87248]: INFO cinder.image.image_utils [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Image download 0.00 MB at 0.00 MB/s Nov 03 20:34:20 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a20667-1a8f-41d1-a040-b73e8148304e]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:34:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_367761e9-1697-4105-8c69-d567bce264fc_1rzdcxzbdevstack@QuobyteHD {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:21 devstack sudo[105042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_367761e9-1697-4105-8c69-d567bce264fc_1rzdcxzbdevstack@QuobyteHD Nov 03 20:34:21 devstack sudo[105042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:21 devstack sudo[105042]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_367761e9-1697-4105-8c69-d567bce264fc_1rzdcxzbdevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_367761e9-1697-4105-8c69-d567bce264fc_1rzdcxzbdevstack@QuobyteHD {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:21 devstack sudo[105046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_367761e9-1697-4105-8c69-d567bce264fc_1rzdcxzbdevstack@QuobyteHD Nov 03 20:34:21 devstack sudo[105046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:21 devstack sudo[105046]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_367761e9-1697-4105-8c69-d567bce264fc_1rzdcxzbdevstack@QuobyteHD" returned: 1 in 0.339s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_367761e9-1697-4105-8c69-d567bce264fc_1rzdcxzbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 20:34:21 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Temporary image 367761e9-1697-4105-8c69-d567bce264fc is fetched for user 587de97ca51a45dd8fe775762ec4eaa2. {{(pid=87248) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 20:34:21 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[712ed69f-1872-4659-9cdb-54a96cd2d9ab]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:34:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_367761e9-1697-4105-8c69-d567bce264fc_1rzdcxzbdevstack@QuobyteHD {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:21 devstack sudo[105051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_367761e9-1697-4105-8c69-d567bce264fc_1rzdcxzbdevstack@QuobyteHD Nov 03 20:34:21 devstack sudo[105051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:21 devstack sudo[105051]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_367761e9-1697-4105-8c69-d567bce264fc_1rzdcxzbdevstack@QuobyteHD" returned: 0 in 0.324s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_367761e9-1697-4105-8c69-d567bce264fc_1rzdcxzbdevstack@QuobyteHD {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:22 devstack sudo[105055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_367761e9-1697-4105-8c69-d567bce264fc_1rzdcxzbdevstack@QuobyteHD Nov 03 20:34:22 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:22 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_367761e9-1697-4105-8c69-d567bce264fc_1rzdcxzbdevstack@QuobyteHD" returned: 1 in 0.360s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_367761e9-1697-4105-8c69-d567bce264fc_1rzdcxzbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 20:34:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:34:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:34:22 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:34:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee89d7ff-dccf-4c7a-a981-c77bdd4a0671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b87b9a303744630a920bdb1c1d0c8c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:34:20Z,use_quota=True,user_id='587de97ca51a45dd8fe775762ec4eaa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8649045b-c38c-4ab3-b93c-bf8337e91bd6),volume_type_id=8649045b-c38c-4ab3-b93c-bf8337e91bd6)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:34:22 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Creating volume ee89d7ff-dccf-4c7a-a981-c77bdd4a0671 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:34:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:34:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:34:22 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:34:22 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:34:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:34:22 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:34:22 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:34:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ee89d7ff-dccf-4c7a-a981-c77bdd4a0671 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:22 devstack sudo[105061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ee89d7ff-dccf-4c7a-a981-c77bdd4a0671 1073741824 Nov 03 20:34:22 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:22 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ee89d7ff-dccf-4c7a-a981-c77bdd4a0671 1073741824" returned: 0 in 0.436s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ee89d7ff-dccf-4c7a-a981-c77bdd4a0671 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:22 devstack sudo[105067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ee89d7ff-dccf-4c7a-a981-c77bdd4a0671 Nov 03 20:34:22 devstack sudo[105067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:23 devstack sudo[105067]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ee89d7ff-dccf-4c7a-a981-c77bdd4a0671" returned: 0 in 0.245s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:23 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:34:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:34:23 devstack cinder-volume[87248]: DEBUG cinder.volume.volume_utils [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Attempting download of 367761e9-1697-4105-8c69-d567bce264fc ((None, [{'url': 'file:///opt/stack/data/glance/images/367761e9-1697-4105-8c69-d567bce264fc', 'metadata': {}}])) to volume ee89d7ff-dccf-4c7a-a981-c77bdd4a0671. {{(pid=87248) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 20:34:23 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[288725ba-874a-4366-8f1e-ab8e7bb11dc5]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:34:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_367761e9-1697-4105-8c69-d567bce264fc_8udtgm04 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:23 devstack sudo[105070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_367761e9-1697-4105-8c69-d567bce264fc_8udtgm04 Nov 03 20:34:23 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:23 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_367761e9-1697-4105-8c69-d567bce264fc_8udtgm04" returned: 0 in 0.333s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_367761e9-1697-4105-8c69-d567bce264fc_8udtgm04 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:23 devstack sudo[105074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_367761e9-1697-4105-8c69-d567bce264fc_8udtgm04 Nov 03 20:34:23 devstack sudo[105074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:23 devstack sudo[105074]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_367761e9-1697-4105-8c69-d567bce264fc_8udtgm04" returned: 1 in 0.344s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_367761e9-1697-4105-8c69-d567bce264fc_8udtgm04' failed. Not Retrying. {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 20:34:23 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3e6b82-a1af-40a8-a7db-f8744ee44e4a]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:34:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_367761e9-1697-4105-8c69-d567bce264fc_1rzdcxzbdevstack@QuobyteHD {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:23 devstack sudo[105078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_367761e9-1697-4105-8c69-d567bce264fc_1rzdcxzbdevstack@QuobyteHD Nov 03 20:34:23 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:24 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_367761e9-1697-4105-8c69-d567bce264fc_1rzdcxzbdevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_367761e9-1697-4105-8c69-d567bce264fc_1rzdcxzbdevstack@QuobyteHD {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:24 devstack sudo[105082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_367761e9-1697-4105-8c69-d567bce264fc_1rzdcxzbdevstack@QuobyteHD Nov 03 20:34:24 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:24 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_367761e9-1697-4105-8c69-d567bce264fc_1rzdcxzbdevstack@QuobyteHD" returned: 1 in 0.334s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_367761e9-1697-4105-8c69-d567bce264fc_1rzdcxzbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 20:34:24 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] 367761e9-1697-4105-8c69-d567bce264fc was raw, converting to qcow2 {{(pid=87248) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 20:34:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_367761e9-1697-4105-8c69-d567bce264fc_1rzdcxzbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ee89d7ff-dccf-4c7a-a981-c77bdd4a0671 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:24 devstack sudo[105087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_367761e9-1697-4105-8c69-d567bce264fc_1rzdcxzbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ee89d7ff-dccf-4c7a-a981-c77bdd4a0671 Nov 03 20:34:24 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:24 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_367761e9-1697-4105-8c69-d567bce264fc_1rzdcxzbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ee89d7ff-dccf-4c7a-a981-c77bdd4a0671" returned: 0 in 0.446s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:24 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_367761e9-1697-4105-8c69-d567bce264fc_1rzdcxzbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ee89d7ff-dccf-4c7a-a981-c77bdd4a0671 {{(pid=87248) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:34:24 devstack cinder-volume[87248]: INFO cinder.image.image_utils [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 20:34:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ee89d7ff-dccf-4c7a-a981-c77bdd4a0671 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:24 devstack sudo[105092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ee89d7ff-dccf-4c7a-a981-c77bdd4a0671 1G Nov 03 20:34:24 devstack sudo[105092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:25 devstack sudo[105092]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ee89d7ff-dccf-4c7a-a981-c77bdd4a0671 1G" returned: 0 in 0.312s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:25 devstack cinder-volume[87248]: DEBUG cinder.volume.volume_utils [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Downloaded image 367761e9-1697-4105-8c69-d567bce264fc ((None, [{'url': 'file:///opt/stack/data/glance/images/367761e9-1697-4105-8c69-d567bce264fc', 'metadata': {}}])) to volume ee89d7ff-dccf-4c7a-a981-c77bdd4a0671 successfully. {{(pid=87248) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 20:34:25 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Temporary image 367761e9-1697-4105-8c69-d567bce264fc for user 587de97ca51a45dd8fe775762ec4eaa2 is deleted. {{(pid=87248) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 20:34:25 devstack cinder-volume[87248]: DEBUG cinder.volume.volume_utils [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Marking volume ee89d7ff-dccf-4c7a-a981-c77bdd4a0671 as bootable. {{(pid=87248) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 20:34:25 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Copying metadata from image 367761e9-1697-4105-8c69-d567bce264fc to ee89d7ff-dccf-4c7a-a981-c77bdd4a0671. {{(pid=87248) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 20:34:25 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Creating volume glance metadata for volume ee89d7ff-dccf-4c7a-a981-c77bdd4a0671 backed by image 367761e9-1697-4105-8c69-d567bce264fc with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '367761e9-1697-4105-8c69-d567bce264fc', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '21fd9bdfe48c178790102928be3d25f5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87248) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 20:34:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e45546ad-708d-48ae-ae71-ee63fa211221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee89d7ff-dccf-4c7a-a981-c77bdd4a0671', 'volume_size': 1, 'image_id': '367761e9-1697-4105-8c69-d567bce264fc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/367761e9-1697-4105-8c69-d567bce264fc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '21fd9bdfe48c178790102928be3d25f5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2b87b9a303744630a920bdb1c1d0c8c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0e8b148d9bc085b0fffd14380f16dada941d5534b010d56c2da96cf715f5f9887dcbd4beabfb7708c6e4c630369dac50bb0649495f35767aba1484f62ae154df', 'id': '367761e9-1697-4105-8c69-d567bce264fc', 'created_at': datetime.datetime(2026, 11, 3, 19, 34, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 34, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/367761e9-1697-4105-8c69-d567bce264fc/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:34:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9242832b-ee2b-4639-bfdf-19407120a353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:34:25 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Volume volume-ee89d7ff-dccf-4c7a-a981-c77bdd4a0671 (ee89d7ff-dccf-4c7a-a981-c77bdd4a0671): created successfully Nov 03 20:34:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9242832b-ee2b-4639-bfdf-19407120a353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:34:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Flow 'volume_create_manager' (78a257ef-53cb-4a3d-a495-460b24a652f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:34:25 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-42a19e09-cfe5-4b5d-bc17-6164057039a4 tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Created volume successfully. Nov 03 20:34:25 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-cddd1cf3-7f3e-4c31-b9ee-d39cf658529c tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Acquiring lock "cinder-ee89d7ff-dccf-4c7a-a981-c77bdd4a0671-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:34:25 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-cddd1cf3-7f3e-4c31-b9ee-d39cf658529c tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Lock "cinder-ee89d7ff-dccf-4c7a-a981-c77bdd4a0671-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:34:25 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-cddd1cf3-7f3e-4c31-b9ee-d39cf658529c tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Acquiring lock "cinder-quobyte-ee89d7ff-dccf-4c7a-a981-c77bdd4a0671" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:34:25 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-cddd1cf3-7f3e-4c31-b9ee-d39cf658529c tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Lock "cinder-quobyte-ee89d7ff-dccf-4c7a-a981-c77bdd4a0671" acquired by "delete_volume" :: waited 0.018s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:34:25 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89ed457-ced0-4dc9-b081-fe99db9a59e8]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:34:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cddd1cf3-7f3e-4c31-b9ee-d39cf658529c tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ee89d7ff-dccf-4c7a-a981-c77bdd4a0671 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:25 devstack sudo[105097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ee89d7ff-dccf-4c7a-a981-c77bdd4a0671 Nov 03 20:34:25 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:26 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cddd1cf3-7f3e-4c31-b9ee-d39cf658529c tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ee89d7ff-dccf-4c7a-a981-c77bdd4a0671" returned: 0 in 0.394s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cddd1cf3-7f3e-4c31-b9ee-d39cf658529c tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ee89d7ff-dccf-4c7a-a981-c77bdd4a0671 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:26 devstack sudo[105102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ee89d7ff-dccf-4c7a-a981-c77bdd4a0671 Nov 03 20:34:26 devstack sudo[105102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:26 devstack sudo[105102]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cddd1cf3-7f3e-4c31-b9ee-d39cf658529c tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ee89d7ff-dccf-4c7a-a981-c77bdd4a0671" returned: 0 in 0.257s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:26 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-cddd1cf3-7f3e-4c31-b9ee-d39cf658529c tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Lock "cinder-quobyte-ee89d7ff-dccf-4c7a-a981-c77bdd4a0671" released by "delete_volume" :: held 0.698s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:34:26 devstack cinder-volume[87248]: WARNING cinder.quota [None req-cddd1cf3-7f3e-4c31-b9ee-d39cf658529c tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:34:26 devstack cinder-volume[87248]: WARNING cinder.quota [None req-cddd1cf3-7f3e-4c31-b9ee-d39cf658529c tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 03 20:34:26 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-cddd1cf3-7f3e-4c31-b9ee-d39cf658529c tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Created reservations ['b1f1c8f8-00a1-4d33-aa53-bac67b773eb7', '48c9fe55-d320-446e-904d-3c9ed05140a3', '57cd2b29-aeca-4b4d-8323-c8ca6fc8ce62', 'd65bb362-5106-4d92-91bd-e5f1c696d4ff'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:34:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-cddd1cf3-7f3e-4c31-b9ee-d39cf658529c tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:34:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-cddd1cf3-7f3e-4c31-b9ee-d39cf658529c tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:34:26 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-cddd1cf3-7f3e-4c31-b9ee-d39cf658529c tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:34:26 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-cddd1cf3-7f3e-4c31-b9ee-d39cf658529c tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:34:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-cddd1cf3-7f3e-4c31-b9ee-d39cf658529c tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:34:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cddd1cf3-7f3e-4c31-b9ee-d39cf658529c tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:26 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:34:26 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:26 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cddd1cf3-7f3e-4c31-b9ee-d39cf658529c tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.263s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:26 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-cddd1cf3-7f3e-4c31-b9ee-d39cf658529c tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:34:26 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-cddd1cf3-7f3e-4c31-b9ee-d39cf658529c tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Deleted volume successfully. Nov 03 20:34:26 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-cddd1cf3-7f3e-4c31-b9ee-d39cf658529c tempest-VolumeAndVolumeTypeFromImageTest-1984779949 None] Lock "cinder-ee89d7ff-dccf-4c7a-a981-c77bdd4a0671-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:34:28 devstack cinder-volume[87248]: DEBUG oslo_service.periodic_task [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:34:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:34:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:34:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:34:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:34:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:34:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:28 devstack sudo[105121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:34:28 devstack sudo[105121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:29 devstack sudo[105121]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.279s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:29 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:34:29 devstack cinder-volume[87248]: DEBUG oslo_service.periodic_task [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running periodic task VolumeManager._thread_info {{(pid=87248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:34:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] thread count: 28 {{(pid=87248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:34:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] thread info: [<_MainThread(MainThread, started 124862067372160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:34:31 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-40fa302a-56b9-4b9d-9616-e46885c526f9 tempest-VolumeDependencyTests-2111193639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:34:31 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-40fa302a-56b9-4b9d-9616-e46885c526f9 tempest-VolumeDependencyTests-2111193639 None] Flow 'volume_create_manager' (99017a38-811c-4690-b1ed-72ddd0d492e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:34:31 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-40fa302a-56b9-4b9d-9616-e46885c526f9 tempest-VolumeDependencyTests-2111193639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ca17a1e-18d4-4872-bcd9-dc38b10abebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:34:31 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-40fa302a-56b9-4b9d-9616-e46885c526f9 tempest-VolumeDependencyTests-2111193639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ca17a1e-18d4-4872-bcd9-dc38b10abebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1946546023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec7321af-d0f5-45a9-8098-d3bfb055fbd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7140a866e8924ec5a7b6ec9d0c9a4ee4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:34:31Z,use_quota=True,user_id='a2237f4c200e449d8e184c3819d76b26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:34:31 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-40fa302a-56b9-4b9d-9616-e46885c526f9 tempest-VolumeDependencyTests-2111193639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3ca0257-1800-46be-a5a4-80264ff3938e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:34:31 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-40fa302a-56b9-4b9d-9616-e46885c526f9 tempest-VolumeDependencyTests-2111193639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3ca0257-1800-46be-a5a4-80264ff3938e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:34:31 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-40fa302a-56b9-4b9d-9616-e46885c526f9 tempest-VolumeDependencyTests-2111193639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea417b9a-dbe6-46ca-be67-dbf90b691b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:34:31 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-40fa302a-56b9-4b9d-9616-e46885c526f9 tempest-VolumeDependencyTests-2111193639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea417b9a-dbe6-46ca-be67-dbf90b691b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec7321af-d0f5-45a9-8098-d3bfb055fbd2', 'volume_name': 'volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:34:31 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-40fa302a-56b9-4b9d-9616-e46885c526f9 tempest-VolumeDependencyTests-2111193639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ef330b2-45ba-491b-8d81-61df672e3e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:34:31 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-40fa302a-56b9-4b9d-9616-e46885c526f9 tempest-VolumeDependencyTests-2111193639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ef330b2-45ba-491b-8d81-61df672e3e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:34:31 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-40fa302a-56b9-4b9d-9616-e46885c526f9 tempest-VolumeDependencyTests-2111193639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (748fa7d8-caf9-40c7-ad21-9a7d2a41e5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:34:31 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-40fa302a-56b9-4b9d-9616-e46885c526f9 tempest-VolumeDependencyTests-2111193639 None] Volume ec7321af-d0f5-45a9-8098-d3bfb055fbd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2', 'volume_size': 1} Nov 03 20:34:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-40fa302a-56b9-4b9d-9616-e46885c526f9 tempest-VolumeDependencyTests-2111193639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:34:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-40fa302a-56b9-4b9d-9616-e46885c526f9 tempest-VolumeDependencyTests-2111193639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:34:31 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-40fa302a-56b9-4b9d-9616-e46885c526f9 tempest-VolumeDependencyTests-2111193639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1946546023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec7321af-d0f5-45a9-8098-d3bfb055fbd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7140a866e8924ec5a7b6ec9d0c9a4ee4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:34:31Z,use_quota=True,user_id='a2237f4c200e449d8e184c3819d76b26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:34:31 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-40fa302a-56b9-4b9d-9616-e46885c526f9 tempest-VolumeDependencyTests-2111193639 None] Creating volume ec7321af-d0f5-45a9-8098-d3bfb055fbd2 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:34:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-40fa302a-56b9-4b9d-9616-e46885c526f9 tempest-VolumeDependencyTests-2111193639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:34:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-40fa302a-56b9-4b9d-9616-e46885c526f9 tempest-VolumeDependencyTests-2111193639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:34:31 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-40fa302a-56b9-4b9d-9616-e46885c526f9 tempest-VolumeDependencyTests-2111193639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:34:31 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-40fa302a-56b9-4b9d-9616-e46885c526f9 tempest-VolumeDependencyTests-2111193639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:34:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-40fa302a-56b9-4b9d-9616-e46885c526f9 tempest-VolumeDependencyTests-2111193639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:34:31 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-40fa302a-56b9-4b9d-9616-e46885c526f9 tempest-VolumeDependencyTests-2111193639 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:34:31 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-40fa302a-56b9-4b9d-9616-e46885c526f9 tempest-VolumeDependencyTests-2111193639 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:34:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-40fa302a-56b9-4b9d-9616-e46885c526f9 tempest-VolumeDependencyTests-2111193639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:31 devstack sudo[105132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2 1073741824 Nov 03 20:34:31 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:31 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-40fa302a-56b9-4b9d-9616-e46885c526f9 tempest-VolumeDependencyTests-2111193639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2 1073741824" returned: 0 in 0.408s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-40fa302a-56b9-4b9d-9616-e46885c526f9 tempest-VolumeDependencyTests-2111193639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:31 devstack sudo[105138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2 Nov 03 20:34:31 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:31 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-40fa302a-56b9-4b9d-9616-e46885c526f9 tempest-VolumeDependencyTests-2111193639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2" returned: 0 in 0.243s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:31 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-40fa302a-56b9-4b9d-9616-e46885c526f9 tempest-VolumeDependencyTests-2111193639 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:34:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-40fa302a-56b9-4b9d-9616-e46885c526f9 tempest-VolumeDependencyTests-2111193639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:34:31 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-40fa302a-56b9-4b9d-9616-e46885c526f9 tempest-VolumeDependencyTests-2111193639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (748fa7d8-caf9-40c7-ad21-9a7d2a41e5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:34:31 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-40fa302a-56b9-4b9d-9616-e46885c526f9 tempest-VolumeDependencyTests-2111193639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed8eb62d-8024-4082-8759-d8709bb83cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:34:31 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-40fa302a-56b9-4b9d-9616-e46885c526f9 tempest-VolumeDependencyTests-2111193639 None] Volume volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2 (ec7321af-d0f5-45a9-8098-d3bfb055fbd2): created successfully Nov 03 20:34:31 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-40fa302a-56b9-4b9d-9616-e46885c526f9 tempest-VolumeDependencyTests-2111193639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed8eb62d-8024-4082-8759-d8709bb83cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:34:31 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-40fa302a-56b9-4b9d-9616-e46885c526f9 tempest-VolumeDependencyTests-2111193639 None] Flow 'volume_create_manager' (99017a38-811c-4690-b1ed-72ddd0d492e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:34:31 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-40fa302a-56b9-4b9d-9616-e46885c526f9 tempest-VolumeDependencyTests-2111193639 None] Created volume successfully. Nov 03 20:34:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7aaa9454-ca9d-4976-b922-84072a8e2f38 tempest-VolumeDependencyTests-2111193639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:34:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7aaa9454-ca9d-4976-b922-84072a8e2f38 tempest-VolumeDependencyTests-2111193639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:34:32 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-7aaa9454-ca9d-4976-b922-84072a8e2f38 tempest-VolumeDependencyTests-2111193639 None] Creating offline snapshot 79139ef0-aeb6-4b87-8db6-9d32f03a02ee of volume ec7321af-d0f5-45a9-8098-d3bfb055fbd2 {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:34:32 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ba778b-f9ce-44d6-9d44-4b09b8805e85]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:34:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7aaa9454-ca9d-4976-b922-84072a8e2f38 tempest-VolumeDependencyTests-2111193639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:32 devstack sudo[105142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2 Nov 03 20:34:32 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:32 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7aaa9454-ca9d-4976-b922-84072a8e2f38 tempest-VolumeDependencyTests-2111193639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2" returned: 0 in 0.369s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7aaa9454-ca9d-4976-b922-84072a8e2f38 tempest-VolumeDependencyTests-2111193639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2.79139ef0-aeb6-4b87-8db6-9d32f03a02ee 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:32 devstack sudo[105147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2.79139ef0-aeb6-4b87-8db6-9d32f03a02ee 1G Nov 03 20:34:32 devstack sudo[105147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:33 devstack sudo[105147]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7aaa9454-ca9d-4976-b922-84072a8e2f38 tempest-VolumeDependencyTests-2111193639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2.79139ef0-aeb6-4b87-8db6-9d32f03a02ee 1G" returned: 0 in 0.446s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7aaa9454-ca9d-4976-b922-84072a8e2f38 tempest-VolumeDependencyTests-2111193639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2.79139ef0-aeb6-4b87-8db6-9d32f03a02ee {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:33 devstack sudo[105153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2.79139ef0-aeb6-4b87-8db6-9d32f03a02ee Nov 03 20:34:33 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:33 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7aaa9454-ca9d-4976-b922-84072a8e2f38 tempest-VolumeDependencyTests-2111193639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2.79139ef0-aeb6-4b87-8db6-9d32f03a02ee" returned: 0 in 0.307s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:33 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-7aaa9454-ca9d-4976-b922-84072a8e2f38 tempest-VolumeDependencyTests-2111193639 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2.79139ef0-aeb6-4b87-8db6-9d32f03a02ee is being set with open permissions: ugo+rw Nov 03 20:34:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7aaa9454-ca9d-4976-b922-84072a8e2f38 tempest-VolumeDependencyTests-2111193639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2.79139ef0-aeb6-4b87-8db6-9d32f03a02ee {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:33 devstack sudo[105158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2.79139ef0-aeb6-4b87-8db6-9d32f03a02ee Nov 03 20:34:33 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:33 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7aaa9454-ca9d-4976-b922-84072a8e2f38 tempest-VolumeDependencyTests-2111193639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2.79139ef0-aeb6-4b87-8db6-9d32f03a02ee" returned: 0 in 0.265s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7aaa9454-ca9d-4976-b922-84072a8e2f38 tempest-VolumeDependencyTests-2111193639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:33 devstack sudo[105161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2.info Nov 03 20:34:33 devstack sudo[105161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:33 devstack sudo[105161]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7aaa9454-ca9d-4976-b922-84072a8e2f38 tempest-VolumeDependencyTests-2111193639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2.info" returned: 0 in 0.264s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:33 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-7aaa9454-ca9d-4976-b922-84072a8e2f38 tempest-VolumeDependencyTests-2111193639 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2.info is being set with open permissions: ugo+rw Nov 03 20:34:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7aaa9454-ca9d-4976-b922-84072a8e2f38 tempest-VolumeDependencyTests-2111193639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:34 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2.info Nov 03 20:34:34 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:34 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7aaa9454-ca9d-4976-b922-84072a8e2f38 tempest-VolumeDependencyTests-2111193639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2.info" returned: 0 in 0.278s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7aaa9454-ca9d-4976-b922-84072a8e2f38 tempest-VolumeDependencyTests-2111193639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.028s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:34:34 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-7aaa9454-ca9d-4976-b922-84072a8e2f38 tempest-VolumeDependencyTests-2111193639 None] Create snapshot completed successfully Nov 03 20:34:35 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:34:35 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] Flow 'volume_create_manager' (9960f042-2c6d-469d-a8fe-91b001ef1562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:34:35 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c63b42c-c66a-480b-8696-36fb9aed9861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:34:35 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c63b42c-c66a-480b-8696-36fb9aed9861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1486860581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=296b9315-8779-470c-8e6d-9f6e2b85243e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7140a866e8924ec5a7b6ec9d0c9a4ee4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:34:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=79139ef0-aeb6-4b87-8db6-9d32f03a02ee,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:34:36Z,use_quota=True,user_id='a2237f4c200e449d8e184c3819d76b26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:34:35 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (297d90e7-2f22-4ce0-8242-babd28ef2f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:34:35 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (297d90e7-2f22-4ce0-8242-babd28ef2f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:34:35 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7f74778-314f-476d-8533-3324ce63c8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:34:35 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7f74778-314f-476d-8533-3324ce63c8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '296b9315-8779-470c-8e6d-9f6e2b85243e', 'volume_name': 'volume-296b9315-8779-470c-8e6d-9f6e2b85243e', 'volume_size': 1, 'snapshot_id': '79139ef0-aeb6-4b87-8db6-9d32f03a02ee'}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:34:35 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e428215-bda8-46ec-aeaf-52b305b2bafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:34:35 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e428215-bda8-46ec-aeaf-52b305b2bafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:34:35 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81bf37b7-9542-4f31-a564-4bef18045f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:34:35 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] Volume 296b9315-8779-470c-8e6d-9f6e2b85243e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-296b9315-8779-470c-8e6d-9f6e2b85243e', 'volume_size': 1, 'snapshot_id': '79139ef0-aeb6-4b87-8db6-9d32f03a02ee'} Nov 03 20:34:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:34:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:34:35 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] Acquiring lock "cinder-quobyte-79139ef0-aeb6-4b87-8db6-9d32f03a02ee-296b9315-8779-470c-8e6d-9f6e2b85243e" by "_create_volume_from_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:34:35 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] Lock "cinder-quobyte-79139ef0-aeb6-4b87-8db6-9d32f03a02ee-296b9315-8779-470c-8e6d-9f6e2b85243e" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:34:35 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] Creating volume 296b9315-8779-470c-8e6d-9f6e2b85243e from snapshot 79139ef0-aeb6-4b87-8db6-9d32f03a02ee {{(pid=87248) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 20:34:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:34:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:34:36 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:34:36 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:34:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:34:36 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:34:36 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] Acquiring lock "cinder-quobyte-296b9315-8779-470c-8e6d-9f6e2b85243e" by "_copy_volume_from_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:34:36 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] Lock "cinder-quobyte-296b9315-8779-470c-8e6d-9f6e2b85243e" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:34:36 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] snapshot: 79139ef0-aeb6-4b87-8db6-9d32f03a02ee, volume: 296b9315-8779-470c-8e6d-9f6e2b85243e, {{(pid=87248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 20:34:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:34:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:34:36 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:34:36 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:34:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:34:36 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[488fe663-6928-4e28-b843-35b0c5bab62c]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:34:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2.79139ef0-aeb6-4b87-8db6-9d32f03a02ee {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:36 devstack sudo[105169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2.79139ef0-aeb6-4b87-8db6-9d32f03a02ee Nov 03 20:34:36 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:36 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2.79139ef0-aeb6-4b87-8db6-9d32f03a02ee" returned: 0 in 0.372s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:36 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:34:36 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b18875-306e-464f-b9b0-a46614ebd279]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:34:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:36 devstack sudo[105174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2 Nov 03 20:34:36 devstack sudo[105174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:36 devstack sudo[105174]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2" returned: 0 in 0.395s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:36 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2 {{(pid=87248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 20:34:36 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] Creating direct copy from snapshot {{(pid=87248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 20:34:36 devstack cinder-volume[87248]: DEBUG cinder.utils [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] Path /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-296b9315-8779-470c-8e6d-9f6e2b85243e not found in is_blk_device check {{(pid=87248) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 20:34:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-296b9315-8779-470c-8e6d-9f6e2b85243e {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:36 devstack sudo[105179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-296b9315-8779-470c-8e6d-9f6e2b85243e Nov 03 20:34:36 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:36 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-6430bdf1-d912-4bf4-8b70-b93d9b84f3eb tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:34:36 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6430bdf1-d912-4bf4-8b70-b93d9b84f3eb tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Flow 'volume_create_manager' (9e3e6ac1-002f-4ff7-9496-3a678888abb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:34:36 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6430bdf1-d912-4bf4-8b70-b93d9b84f3eb tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee3ebe69-ff90-4d93-acdf-43090f59f7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:34:36 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6430bdf1-d912-4bf4-8b70-b93d9b84f3eb tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee3ebe69-ff90-4d93-acdf-43090f59f7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1862099984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce89f792-53bf-426a-b197-e8fed32b2a59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5b36e53c0d647c7a747c8a572f2b3dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:34:37Z,use_quota=True,user_id='0b1f43025d2e41c095f87f2d3907fc64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:34:36 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6430bdf1-d912-4bf4-8b70-b93d9b84f3eb tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f37fa1a8-4479-46e0-a1a1-b40183d51ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:34:36 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6430bdf1-d912-4bf4-8b70-b93d9b84f3eb tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f37fa1a8-4479-46e0-a1a1-b40183d51ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:34:36 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6430bdf1-d912-4bf4-8b70-b93d9b84f3eb tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01671b1c-0dc5-427b-9f2f-31b664052b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:34:36 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6430bdf1-d912-4bf4-8b70-b93d9b84f3eb tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01671b1c-0dc5-427b-9f2f-31b664052b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce89f792-53bf-426a-b197-e8fed32b2a59', 'volume_name': 'volume-ce89f792-53bf-426a-b197-e8fed32b2a59', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:34:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6430bdf1-d912-4bf4-8b70-b93d9b84f3eb tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5faf651d-d825-4b20-922a-f7adca1587d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:34:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6430bdf1-d912-4bf4-8b70-b93d9b84f3eb tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5faf651d-d825-4b20-922a-f7adca1587d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:34:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6430bdf1-d912-4bf4-8b70-b93d9b84f3eb tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f87e725-274d-479a-bf64-4aec4a9fb190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:34:37 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-6430bdf1-d912-4bf4-8b70-b93d9b84f3eb tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Volume ce89f792-53bf-426a-b197-e8fed32b2a59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce89f792-53bf-426a-b197-e8fed32b2a59', 'volume_size': 1} Nov 03 20:34:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6430bdf1-d912-4bf4-8b70-b93d9b84f3eb tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:34:42 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-296b9315-8779-470c-8e6d-9f6e2b85243e" returned: 0 in 6.043s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:42 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] Image conversion details: src /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2, size 1024.00 MB, duration 6.04 sec, destination /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-296b9315-8779-470c-8e6d-9f6e2b85243e {{(pid=87248) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:34:42 devstack cinder-volume[87248]: INFO cinder.image.image_utils [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] Converted 1024.00 MB image at 169.44 MB/s Nov 03 20:34:42 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-296b9315-8779-470c-8e6d-9f6e2b85243e is being set with open permissions: ugo+rw Nov 03 20:34:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-296b9315-8779-470c-8e6d-9f6e2b85243e {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:42 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-296b9315-8779-470c-8e6d-9f6e2b85243e Nov 03 20:34:42 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:43 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-296b9315-8779-470c-8e6d-9f6e2b85243e" returned: 0 in 0.236s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:43 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] Lock "cinder-quobyte-296b9315-8779-470c-8e6d-9f6e2b85243e" released by "_copy_volume_from_snapshot" :: held 7.143s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:34:43 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] Lock "cinder-quobyte-79139ef0-aeb6-4b87-8db6-9d32f03a02ee-296b9315-8779-470c-8e6d-9f6e2b85243e" released by "_create_volume_from_snapshot" :: held 7.216s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:34:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.233s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:34:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6430bdf1-d912-4bf4-8b70-b93d9b84f3eb tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.207s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:34:43 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-6430bdf1-d912-4bf4-8b70-b93d9b84f3eb tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1862099984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce89f792-53bf-426a-b197-e8fed32b2a59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5b36e53c0d647c7a747c8a572f2b3dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:34:37Z,use_quota=True,user_id='0b1f43025d2e41c095f87f2d3907fc64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:34:43 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-6430bdf1-d912-4bf4-8b70-b93d9b84f3eb tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Creating volume ce89f792-53bf-426a-b197-e8fed32b2a59 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:34:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6430bdf1-d912-4bf4-8b70-b93d9b84f3eb tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:34:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6430bdf1-d912-4bf4-8b70-b93d9b84f3eb tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:34:43 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-6430bdf1-d912-4bf4-8b70-b93d9b84f3eb tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:34:43 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-6430bdf1-d912-4bf4-8b70-b93d9b84f3eb tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:34:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6430bdf1-d912-4bf4-8b70-b93d9b84f3eb tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:34:43 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-6430bdf1-d912-4bf4-8b70-b93d9b84f3eb tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:34:43 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-6430bdf1-d912-4bf4-8b70-b93d9b84f3eb tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:34:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6430bdf1-d912-4bf4-8b70-b93d9b84f3eb tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ce89f792-53bf-426a-b197-e8fed32b2a59 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:43 devstack sudo[105197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ce89f792-53bf-426a-b197-e8fed32b2a59 1073741824 Nov 03 20:34:43 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:43 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81bf37b7-9542-4f31-a564-4bef18045f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-296b9315-8779-470c-8e6d-9f6e2b85243e', 'volume_size': 1, 'snapshot_id': '79139ef0-aeb6-4b87-8db6-9d32f03a02ee'}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:34:43 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4435f8f4-399f-4d1a-a069-1fc5e5e0a7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:34:43 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] Volume volume-296b9315-8779-470c-8e6d-9f6e2b85243e (296b9315-8779-470c-8e6d-9f6e2b85243e): created successfully Nov 03 20:34:43 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4435f8f4-399f-4d1a-a069-1fc5e5e0a7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:34:43 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] Flow 'volume_create_manager' (9960f042-2c6d-469d-a8fe-91b001ef1562) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:34:43 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-c85c337a-9d13-429e-96f7-5b9bfff9edc2 tempest-VolumeDependencyTests-2111193639 None] Created volume successfully. Nov 03 20:34:43 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-59062ef1-7f4a-45fe-8851-14bbf4eb3519 tempest-VolumeDependencyTests-2111193639 None] Acquiring lock "cinder-79139ef0-aeb6-4b87-8db6-9d32f03a02ee-delete_snapshot" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:34:43 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-59062ef1-7f4a-45fe-8851-14bbf4eb3519 tempest-VolumeDependencyTests-2111193639 None] Lock "cinder-79139ef0-aeb6-4b87-8db6-9d32f03a02ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:34:43 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-59062ef1-7f4a-45fe-8851-14bbf4eb3519 tempest-VolumeDependencyTests-2111193639 None] Acquiring lock "cinder-quobyte-ec7321af-d0f5-45a9-8098-d3bfb055fbd2" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:34:43 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-59062ef1-7f4a-45fe-8851-14bbf4eb3519 tempest-VolumeDependencyTests-2111193639 None] Lock "cinder-quobyte-ec7321af-d0f5-45a9-8098-d3bfb055fbd2" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:34:43 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-59062ef1-7f4a-45fe-8851-14bbf4eb3519 tempest-VolumeDependencyTests-2111193639 None] Acquiring lock "cinder-quobyte-79139ef0-aeb6-4b87-8db6-9d32f03a02ee" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:34:43 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-59062ef1-7f4a-45fe-8851-14bbf4eb3519 tempest-VolumeDependencyTests-2111193639 None] Lock "cinder-quobyte-79139ef0-aeb6-4b87-8db6-9d32f03a02ee" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:34:43 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-59062ef1-7f4a-45fe-8851-14bbf4eb3519 tempest-VolumeDependencyTests-2111193639 None] Deleting offline snapshot 79139ef0-aeb6-4b87-8db6-9d32f03a02ee of volume ec7321af-d0f5-45a9-8098-d3bfb055fbd2 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:34:43 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-59062ef1-7f4a-45fe-8851-14bbf4eb3519 tempest-VolumeDependencyTests-2111193639 None] snapshot_file for this snap is: volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2.79139ef0-aeb6-4b87-8db6-9d32f03a02ee {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:34:43 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49559c4-ffcc-4cfb-bec1-7d844f8a0606]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:34:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-59062ef1-7f4a-45fe-8851-14bbf4eb3519 tempest-VolumeDependencyTests-2111193639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2.79139ef0-aeb6-4b87-8db6-9d32f03a02ee {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:43 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2.79139ef0-aeb6-4b87-8db6-9d32f03a02ee Nov 03 20:34:43 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:43 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6430bdf1-d912-4bf4-8b70-b93d9b84f3eb tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ce89f792-53bf-426a-b197-e8fed32b2a59 1073741824" returned: 0 in 0.450s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6430bdf1-d912-4bf4-8b70-b93d9b84f3eb tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ce89f792-53bf-426a-b197-e8fed32b2a59 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:43 devstack sudo[105205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ce89f792-53bf-426a-b197-e8fed32b2a59 Nov 03 20:34:43 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:43 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-59062ef1-7f4a-45fe-8851-14bbf4eb3519 tempest-VolumeDependencyTests-2111193639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2.79139ef0-aeb6-4b87-8db6-9d32f03a02ee" returned: 0 in 0.358s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:43 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-59062ef1-7f4a-45fe-8851-14bbf4eb3519 tempest-VolumeDependencyTests-2111193639 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:34:43 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed140a39-fd77-4dfd-acc2-9ab6a368955e]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:34:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-59062ef1-7f4a-45fe-8851-14bbf4eb3519 tempest-VolumeDependencyTests-2111193639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:43 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6430bdf1-d912-4bf4-8b70-b93d9b84f3eb tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ce89f792-53bf-426a-b197-e8fed32b2a59" returned: 0 in 0.250s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:43 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-6430bdf1-d912-4bf4-8b70-b93d9b84f3eb tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:34:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6430bdf1-d912-4bf4-8b70-b93d9b84f3eb tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:34:43 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6430bdf1-d912-4bf4-8b70-b93d9b84f3eb tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f87e725-274d-479a-bf64-4aec4a9fb190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce89f792-53bf-426a-b197-e8fed32b2a59', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:34:43 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6430bdf1-d912-4bf4-8b70-b93d9b84f3eb tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5610538e-611a-4abd-a607-14b04aa2e114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:34:44 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-6430bdf1-d912-4bf4-8b70-b93d9b84f3eb tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Volume volume-ce89f792-53bf-426a-b197-e8fed32b2a59 (ce89f792-53bf-426a-b197-e8fed32b2a59): created successfully Nov 03 20:34:44 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6430bdf1-d912-4bf4-8b70-b93d9b84f3eb tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5610538e-611a-4abd-a607-14b04aa2e114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:34:44 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-6430bdf1-d912-4bf4-8b70-b93d9b84f3eb tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Flow 'volume_create_manager' (9e3e6ac1-002f-4ff7-9496-3a678888abb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:34:44 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-6430bdf1-d912-4bf4-8b70-b93d9b84f3eb tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Created volume successfully. Nov 03 20:34:44 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2 Nov 03 20:34:44 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:44 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-59062ef1-7f4a-45fe-8851-14bbf4eb3519 tempest-VolumeDependencyTests-2111193639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2" returned: 0 in 0.543s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-59062ef1-7f4a-45fe-8851-14bbf4eb3519 tempest-VolumeDependencyTests-2111193639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2.79139ef0-aeb6-4b87-8db6-9d32f03a02ee {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:44 devstack sudo[105217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2.79139ef0-aeb6-4b87-8db6-9d32f03a02ee Nov 03 20:34:44 devstack sudo[105217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:44 devstack sudo[105217]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-59062ef1-7f4a-45fe-8851-14bbf4eb3519 tempest-VolumeDependencyTests-2111193639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2.79139ef0-aeb6-4b87-8db6-9d32f03a02ee" returned: 0 in 0.358s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-59062ef1-7f4a-45fe-8851-14bbf4eb3519 tempest-VolumeDependencyTests-2111193639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2.79139ef0-aeb6-4b87-8db6-9d32f03a02ee {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:44 devstack sudo[105225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2.79139ef0-aeb6-4b87-8db6-9d32f03a02ee Nov 03 20:34:44 devstack sudo[105225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:45 devstack sudo[105225]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-59062ef1-7f4a-45fe-8851-14bbf4eb3519 tempest-VolumeDependencyTests-2111193639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2.79139ef0-aeb6-4b87-8db6-9d32f03a02ee" returned: 0 in 0.272s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:45 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-59062ef1-7f4a-45fe-8851-14bbf4eb3519 tempest-VolumeDependencyTests-2111193639 None] Lock "cinder-quobyte-79139ef0-aeb6-4b87-8db6-9d32f03a02ee" released by "_delete_snapshot" :: held 1.643s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:34:45 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-59062ef1-7f4a-45fe-8851-14bbf4eb3519 tempest-VolumeDependencyTests-2111193639 None] Lock "cinder-quobyte-ec7321af-d0f5-45a9-8098-d3bfb055fbd2" released by "delete_snapshot" :: held 1.671s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:34:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-4bb357ed-b1d6-49f8-a2ae-7c2ef92c2c8b req-c19f6f45-478d-4d53-9cc2-47ff697e5008 tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:34:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-4bb357ed-b1d6-49f8-a2ae-7c2ef92c2c8b req-c19f6f45-478d-4d53-9cc2-47ff697e5008 tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:34:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [req-4bb357ed-b1d6-49f8-a2ae-7c2ef92c2c8b req-c19f6f45-478d-4d53-9cc2-47ff697e5008 tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:34:45 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-4bb357ed-b1d6-49f8-a2ae-7c2ef92c2c8b req-c19f6f45-478d-4d53-9cc2-47ff697e5008 tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8', 'name': 'volume-ce89f792-53bf-426a-b197-e8fed32b2a59', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '98891f78-3776-4fb5-a18a-d0024b1fb9eb', 'enforce_multipath': True} {{(pid=87248) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 20:34:45 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-59062ef1-7f4a-45fe-8851-14bbf4eb3519 tempest-VolumeDependencyTests-2111193639 None] Created reservations ['f57057da-62d8-498b-bf64-892d40af5da7', '7c77ccd9-768f-474f-91a1-2df12ff9bd32', 'c5b0475c-08d2-4c97-9ba2-f6446d5c8476', '633ff6ac-cb34-444d-9d2f-129dab3f6e4c'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:34:45 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-4bb357ed-b1d6-49f8-a2ae-7c2ef92c2c8b req-c19f6f45-478d-4d53-9cc2-47ff697e5008 tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] attachment_update completed successfully. Nov 03 20:34:45 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-59062ef1-7f4a-45fe-8851-14bbf4eb3519 tempest-VolumeDependencyTests-2111193639 None] Delete snapshot completed successfully. Nov 03 20:34:45 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-59062ef1-7f4a-45fe-8851-14bbf4eb3519 tempest-VolumeDependencyTests-2111193639 None] Lock "cinder-79139ef0-aeb6-4b87-8db6-9d32f03a02ee-delete_snapshot" released by "delete_snapshot" :: held 1.859s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:34:45 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1d30b8b5-e38a-4f8f-9e42-344776e7bdcf tempest-VolumeDependencyTests-2111193639 None] Acquiring lock "cinder-ec7321af-d0f5-45a9-8098-d3bfb055fbd2-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:34:45 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1d30b8b5-e38a-4f8f-9e42-344776e7bdcf tempest-VolumeDependencyTests-2111193639 None] Lock "cinder-ec7321af-d0f5-45a9-8098-d3bfb055fbd2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:34:45 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1d30b8b5-e38a-4f8f-9e42-344776e7bdcf tempest-VolumeDependencyTests-2111193639 None] Acquiring lock "cinder-quobyte-ec7321af-d0f5-45a9-8098-d3bfb055fbd2" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:34:45 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1d30b8b5-e38a-4f8f-9e42-344776e7bdcf tempest-VolumeDependencyTests-2111193639 None] Lock "cinder-quobyte-ec7321af-d0f5-45a9-8098-d3bfb055fbd2" acquired by "delete_volume" :: waited 0.019s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:34:45 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f8017c-e328-4a4c-9cdd-bb5f1e12bf7f]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:34:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1d30b8b5-e38a-4f8f-9e42-344776e7bdcf tempest-VolumeDependencyTests-2111193639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:45 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2 Nov 03 20:34:45 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:46 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1d30b8b5-e38a-4f8f-9e42-344776e7bdcf tempest-VolumeDependencyTests-2111193639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2" returned: 0 in 0.405s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1d30b8b5-e38a-4f8f-9e42-344776e7bdcf tempest-VolumeDependencyTests-2111193639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:46 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2 Nov 03 20:34:46 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:46 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1d30b8b5-e38a-4f8f-9e42-344776e7bdcf tempest-VolumeDependencyTests-2111193639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ec7321af-d0f5-45a9-8098-d3bfb055fbd2" returned: 0 in 0.244s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:46 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1d30b8b5-e38a-4f8f-9e42-344776e7bdcf tempest-VolumeDependencyTests-2111193639 None] Lock "cinder-quobyte-ec7321af-d0f5-45a9-8098-d3bfb055fbd2" released by "delete_volume" :: held 0.715s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:34:46 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-1d30b8b5-e38a-4f8f-9e42-344776e7bdcf tempest-VolumeDependencyTests-2111193639 None] Created reservations ['6fa260c1-ca6d-4050-8139-3409ab74d819', 'cb258558-ceab-4f77-b772-968e6bdd62f3', '7e28b14d-21ae-4671-9fa3-b26407aef271', '6d490a78-a71a-4908-bcc3-beea7f83b0f9'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:34:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1d30b8b5-e38a-4f8f-9e42-344776e7bdcf tempest-VolumeDependencyTests-2111193639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:34:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1d30b8b5-e38a-4f8f-9e42-344776e7bdcf tempest-VolumeDependencyTests-2111193639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:34:46 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-1d30b8b5-e38a-4f8f-9e42-344776e7bdcf tempest-VolumeDependencyTests-2111193639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:34:46 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-1d30b8b5-e38a-4f8f-9e42-344776e7bdcf tempest-VolumeDependencyTests-2111193639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:34:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1d30b8b5-e38a-4f8f-9e42-344776e7bdcf tempest-VolumeDependencyTests-2111193639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:34:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1d30b8b5-e38a-4f8f-9e42-344776e7bdcf tempest-VolumeDependencyTests-2111193639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:46 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:34:46 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:46 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1d30b8b5-e38a-4f8f-9e42-344776e7bdcf tempest-VolumeDependencyTests-2111193639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.248s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:46 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-1d30b8b5-e38a-4f8f-9e42-344776e7bdcf tempest-VolumeDependencyTests-2111193639 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:34:46 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-1d30b8b5-e38a-4f8f-9e42-344776e7bdcf tempest-VolumeDependencyTests-2111193639 None] Deleted volume successfully. Nov 03 20:34:46 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7fc73d93-1c74-435e-9b32-13085af0b287 tempest-VolumeDependencyTests-2111193639 None] Acquiring lock "cinder-296b9315-8779-470c-8e6d-9f6e2b85243e-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:34:46 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7fc73d93-1c74-435e-9b32-13085af0b287 tempest-VolumeDependencyTests-2111193639 None] Lock "cinder-296b9315-8779-470c-8e6d-9f6e2b85243e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:34:46 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1d30b8b5-e38a-4f8f-9e42-344776e7bdcf tempest-VolumeDependencyTests-2111193639 None] Lock "cinder-ec7321af-d0f5-45a9-8098-d3bfb055fbd2-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:34:46 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7fc73d93-1c74-435e-9b32-13085af0b287 tempest-VolumeDependencyTests-2111193639 None] Acquiring lock "cinder-quobyte-296b9315-8779-470c-8e6d-9f6e2b85243e" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:34:46 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7fc73d93-1c74-435e-9b32-13085af0b287 tempest-VolumeDependencyTests-2111193639 None] Lock "cinder-quobyte-296b9315-8779-470c-8e6d-9f6e2b85243e" acquired by "delete_volume" :: waited 0.018s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:34:46 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdddf58e-c914-4e0d-8489-f2b871c8ff1d]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:34:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7fc73d93-1c74-435e-9b32-13085af0b287 tempest-VolumeDependencyTests-2111193639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-296b9315-8779-470c-8e6d-9f6e2b85243e {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:46 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-296b9315-8779-470c-8e6d-9f6e2b85243e Nov 03 20:34:46 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:47 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7fc73d93-1c74-435e-9b32-13085af0b287 tempest-VolumeDependencyTests-2111193639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-296b9315-8779-470c-8e6d-9f6e2b85243e" returned: 0 in 0.380s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7fc73d93-1c74-435e-9b32-13085af0b287 tempest-VolumeDependencyTests-2111193639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-296b9315-8779-470c-8e6d-9f6e2b85243e {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:47 devstack sudo[105667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-296b9315-8779-470c-8e6d-9f6e2b85243e Nov 03 20:34:47 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:47 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7fc73d93-1c74-435e-9b32-13085af0b287 tempest-VolumeDependencyTests-2111193639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-296b9315-8779-470c-8e6d-9f6e2b85243e" returned: 0 in 0.268s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:47 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7fc73d93-1c74-435e-9b32-13085af0b287 tempest-VolumeDependencyTests-2111193639 None] Lock "cinder-quobyte-296b9315-8779-470c-8e6d-9f6e2b85243e" released by "delete_volume" :: held 0.696s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:34:47 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-7fc73d93-1c74-435e-9b32-13085af0b287 tempest-VolumeDependencyTests-2111193639 None] Created reservations ['60efc9b7-e326-4430-81b1-930091445dfe', 'af218da0-457a-4568-8c43-6f814287d1aa', '33f54c4b-8742-4be9-af93-f605b898c9ba', '2ed6d65c-739a-4dd9-8688-d37918f1aead'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:34:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7fc73d93-1c74-435e-9b32-13085af0b287 tempest-VolumeDependencyTests-2111193639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:34:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7fc73d93-1c74-435e-9b32-13085af0b287 tempest-VolumeDependencyTests-2111193639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:34:47 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-7fc73d93-1c74-435e-9b32-13085af0b287 tempest-VolumeDependencyTests-2111193639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:34:47 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-7fc73d93-1c74-435e-9b32-13085af0b287 tempest-VolumeDependencyTests-2111193639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:34:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7fc73d93-1c74-435e-9b32-13085af0b287 tempest-VolumeDependencyTests-2111193639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:34:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7fc73d93-1c74-435e-9b32-13085af0b287 tempest-VolumeDependencyTests-2111193639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:47 devstack sudo[105670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:34:47 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:47 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7fc73d93-1c74-435e-9b32-13085af0b287 tempest-VolumeDependencyTests-2111193639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.266s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:47 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-7fc73d93-1c74-435e-9b32-13085af0b287 tempest-VolumeDependencyTests-2111193639 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:34:47 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-7fc73d93-1c74-435e-9b32-13085af0b287 tempest-VolumeDependencyTests-2111193639 None] Deleted volume successfully. Nov 03 20:34:48 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7fc73d93-1c74-435e-9b32-13085af0b287 tempest-VolumeDependencyTests-2111193639 None] Lock "cinder-296b9315-8779-470c-8e6d-9f6e2b85243e-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:34:48 devstack cinder-volume[87248]: INFO cinder.volume.manager [req-48c9e140-4df2-4deb-9b30-b9e6fd7b728a req-524f9c38-861c-4351-aea6-8df0eef9a058 tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Terminate volume connection completed successfully. Nov 03 20:34:48 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [req-48c9e140-4df2-4deb-9b30-b9e6fd7b728a req-524f9c38-861c-4351-aea6-8df0eef9a058 tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Deleting attachment 98891f78-3776-4fb5-a18a-d0024b1fb9eb. {{(pid=87248) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 20:34:49 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6a1ff8b7-4a30-4fa1-b83c-d7c730268a2e tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Acquiring lock "cinder-ce89f792-53bf-426a-b197-e8fed32b2a59-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:34:49 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6a1ff8b7-4a30-4fa1-b83c-d7c730268a2e tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Lock "cinder-ce89f792-53bf-426a-b197-e8fed32b2a59-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:34:49 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6a1ff8b7-4a30-4fa1-b83c-d7c730268a2e tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Acquiring lock "cinder-quobyte-ce89f792-53bf-426a-b197-e8fed32b2a59" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:34:49 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6a1ff8b7-4a30-4fa1-b83c-d7c730268a2e tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Lock "cinder-quobyte-ce89f792-53bf-426a-b197-e8fed32b2a59" acquired by "delete_volume" :: waited 0.018s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:34:49 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[10eff3e2-b7ee-494c-9567-9e79dc1591d2]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:34:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6a1ff8b7-4a30-4fa1-b83c-d7c730268a2e tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ce89f792-53bf-426a-b197-e8fed32b2a59 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:49 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ce89f792-53bf-426a-b197-e8fed32b2a59 Nov 03 20:34:49 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:49 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6a1ff8b7-4a30-4fa1-b83c-d7c730268a2e tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ce89f792-53bf-426a-b197-e8fed32b2a59" returned: 0 in 0.412s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6a1ff8b7-4a30-4fa1-b83c-d7c730268a2e tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ce89f792-53bf-426a-b197-e8fed32b2a59 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:49 devstack sudo[105706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ce89f792-53bf-426a-b197-e8fed32b2a59 Nov 03 20:34:49 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:50 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6a1ff8b7-4a30-4fa1-b83c-d7c730268a2e tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ce89f792-53bf-426a-b197-e8fed32b2a59" returned: 0 in 0.248s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:50 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6a1ff8b7-4a30-4fa1-b83c-d7c730268a2e tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Lock "cinder-quobyte-ce89f792-53bf-426a-b197-e8fed32b2a59" released by "delete_volume" :: held 0.709s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:34:50 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-6a1ff8b7-4a30-4fa1-b83c-d7c730268a2e tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Created reservations ['0810b64d-ac39-4d37-8c35-ed4be71c59fa', 'b599d44f-fa89-41a0-b8da-803f32ec50ac', 'cc99ee2a-7a99-4cfd-bf45-a72ab64d62ed', 'fc4716b2-55e5-4244-b9a2-1f4ef333d61b'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:34:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6a1ff8b7-4a30-4fa1-b83c-d7c730268a2e tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:34:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6a1ff8b7-4a30-4fa1-b83c-d7c730268a2e tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:34:50 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-6a1ff8b7-4a30-4fa1-b83c-d7c730268a2e tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:34:50 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-6a1ff8b7-4a30-4fa1-b83c-d7c730268a2e tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:34:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6a1ff8b7-4a30-4fa1-b83c-d7c730268a2e tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:34:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6a1ff8b7-4a30-4fa1-b83c-d7c730268a2e tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:50 devstack sudo[105709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:34:50 devstack sudo[105709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:50 devstack sudo[105709]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6a1ff8b7-4a30-4fa1-b83c-d7c730268a2e tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.260s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:50 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-6a1ff8b7-4a30-4fa1-b83c-d7c730268a2e tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:34:50 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-6a1ff8b7-4a30-4fa1-b83c-d7c730268a2e tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Deleted volume successfully. Nov 03 20:34:50 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6a1ff8b7-4a30-4fa1-b83c-d7c730268a2e tempest-TestServerVolumeAttachScenarioOldVersion-944007672 None] Lock "cinder-ce89f792-53bf-426a-b197-e8fed32b2a59-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:34:52 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-2170fa67-d8a3-415f-9d8d-375e8ec6361f tempest-ProjectReaderTests-747590484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:34:52 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2170fa67-d8a3-415f-9d8d-375e8ec6361f tempest-ProjectReaderTests-747590484 None] Flow 'volume_create_manager' (657879b1-7ed1-431f-873d-ef9007fed755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:34:52 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2170fa67-d8a3-415f-9d8d-375e8ec6361f tempest-ProjectReaderTests-747590484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7b13ef9-7632-4b70-9769-26903c763c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:34:52 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2170fa67-d8a3-415f-9d8d-375e8ec6361f tempest-ProjectReaderTests-747590484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7b13ef9-7632-4b70-9769-26903c763c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2020367423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c28488f-979a-4d13-84dc-596a91de76e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14be7f87c70c4086b33001ec83a477bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:34:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:34:52Z,use_quota=True,user_id='fae611af8d8c494e97c9a693ffdaa22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:34:52 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2170fa67-d8a3-415f-9d8d-375e8ec6361f tempest-ProjectReaderTests-747590484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a778ff7f-c39c-42df-bcc4-8a0be465b237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:34:52 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2170fa67-d8a3-415f-9d8d-375e8ec6361f tempest-ProjectReaderTests-747590484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a778ff7f-c39c-42df-bcc4-8a0be465b237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:34:52 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2170fa67-d8a3-415f-9d8d-375e8ec6361f tempest-ProjectReaderTests-747590484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (375be770-aa20-4716-8036-3ee1f8b95e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:34:52 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2170fa67-d8a3-415f-9d8d-375e8ec6361f tempest-ProjectReaderTests-747590484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (375be770-aa20-4716-8036-3ee1f8b95e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c28488f-979a-4d13-84dc-596a91de76e7', 'volume_name': 'volume-2c28488f-979a-4d13-84dc-596a91de76e7', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:34:52 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2170fa67-d8a3-415f-9d8d-375e8ec6361f tempest-ProjectReaderTests-747590484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5e13d01-4507-46df-9315-d038fcc3bc21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:34:52 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2170fa67-d8a3-415f-9d8d-375e8ec6361f tempest-ProjectReaderTests-747590484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5e13d01-4507-46df-9315-d038fcc3bc21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:34:52 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2170fa67-d8a3-415f-9d8d-375e8ec6361f tempest-ProjectReaderTests-747590484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17ba47fb-1cde-448f-9f30-ca5807e34c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:34:52 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-2170fa67-d8a3-415f-9d8d-375e8ec6361f tempest-ProjectReaderTests-747590484 None] Volume 2c28488f-979a-4d13-84dc-596a91de76e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c28488f-979a-4d13-84dc-596a91de76e7', 'volume_size': 1} Nov 03 20:34:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2170fa67-d8a3-415f-9d8d-375e8ec6361f tempest-ProjectReaderTests-747590484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:34:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2170fa67-d8a3-415f-9d8d-375e8ec6361f tempest-ProjectReaderTests-747590484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:34:52 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2170fa67-d8a3-415f-9d8d-375e8ec6361f tempest-ProjectReaderTests-747590484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2020367423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c28488f-979a-4d13-84dc-596a91de76e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14be7f87c70c4086b33001ec83a477bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:34:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:34:52Z,use_quota=True,user_id='fae611af8d8c494e97c9a693ffdaa22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:34:52 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-2170fa67-d8a3-415f-9d8d-375e8ec6361f tempest-ProjectReaderTests-747590484 None] Creating volume 2c28488f-979a-4d13-84dc-596a91de76e7 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:34:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2170fa67-d8a3-415f-9d8d-375e8ec6361f tempest-ProjectReaderTests-747590484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:34:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2170fa67-d8a3-415f-9d8d-375e8ec6361f tempest-ProjectReaderTests-747590484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:34:52 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2170fa67-d8a3-415f-9d8d-375e8ec6361f tempest-ProjectReaderTests-747590484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:34:52 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2170fa67-d8a3-415f-9d8d-375e8ec6361f tempest-ProjectReaderTests-747590484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:34:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2170fa67-d8a3-415f-9d8d-375e8ec6361f tempest-ProjectReaderTests-747590484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:34:52 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2170fa67-d8a3-415f-9d8d-375e8ec6361f tempest-ProjectReaderTests-747590484 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:34:52 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-2170fa67-d8a3-415f-9d8d-375e8ec6361f tempest-ProjectReaderTests-747590484 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:34:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2170fa67-d8a3-415f-9d8d-375e8ec6361f tempest-ProjectReaderTests-747590484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2c28488f-979a-4d13-84dc-596a91de76e7 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:52 devstack sudo[105736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2c28488f-979a-4d13-84dc-596a91de76e7 1073741824 Nov 03 20:34:52 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:52 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2170fa67-d8a3-415f-9d8d-375e8ec6361f tempest-ProjectReaderTests-747590484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2c28488f-979a-4d13-84dc-596a91de76e7 1073741824" returned: 0 in 0.484s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2170fa67-d8a3-415f-9d8d-375e8ec6361f tempest-ProjectReaderTests-747590484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2c28488f-979a-4d13-84dc-596a91de76e7 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:52 devstack sudo[105743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2c28488f-979a-4d13-84dc-596a91de76e7 Nov 03 20:34:52 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:52 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2170fa67-d8a3-415f-9d8d-375e8ec6361f tempest-ProjectReaderTests-747590484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2c28488f-979a-4d13-84dc-596a91de76e7" returned: 0 in 0.275s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:53 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2170fa67-d8a3-415f-9d8d-375e8ec6361f tempest-ProjectReaderTests-747590484 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:34:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2170fa67-d8a3-415f-9d8d-375e8ec6361f tempest-ProjectReaderTests-747590484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:34:53 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2170fa67-d8a3-415f-9d8d-375e8ec6361f tempest-ProjectReaderTests-747590484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17ba47fb-1cde-448f-9f30-ca5807e34c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c28488f-979a-4d13-84dc-596a91de76e7', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:34:53 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2170fa67-d8a3-415f-9d8d-375e8ec6361f tempest-ProjectReaderTests-747590484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2b99001-a28c-424d-80d6-d2803ad0c970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:34:53 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-2170fa67-d8a3-415f-9d8d-375e8ec6361f tempest-ProjectReaderTests-747590484 None] Volume volume-2c28488f-979a-4d13-84dc-596a91de76e7 (2c28488f-979a-4d13-84dc-596a91de76e7): created successfully Nov 03 20:34:53 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2170fa67-d8a3-415f-9d8d-375e8ec6361f tempest-ProjectReaderTests-747590484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2b99001-a28c-424d-80d6-d2803ad0c970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:34:53 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2170fa67-d8a3-415f-9d8d-375e8ec6361f tempest-ProjectReaderTests-747590484 None] Flow 'volume_create_manager' (657879b1-7ed1-431f-873d-ef9007fed755) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:34:53 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-2170fa67-d8a3-415f-9d8d-375e8ec6361f tempest-ProjectReaderTests-747590484 None] Created volume successfully. Nov 03 20:34:54 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-89f4f45b-943e-41b9-94d7-06e365116838 tempest-ProjectReaderTests-747590484 None] Acquiring lock "cinder-2c28488f-979a-4d13-84dc-596a91de76e7-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:34:54 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-89f4f45b-943e-41b9-94d7-06e365116838 tempest-ProjectReaderTests-747590484 None] Lock "cinder-2c28488f-979a-4d13-84dc-596a91de76e7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:34:54 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-89f4f45b-943e-41b9-94d7-06e365116838 tempest-ProjectReaderTests-747590484 None] Acquiring lock "cinder-quobyte-2c28488f-979a-4d13-84dc-596a91de76e7" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:34:54 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-89f4f45b-943e-41b9-94d7-06e365116838 tempest-ProjectReaderTests-747590484 None] Lock "cinder-quobyte-2c28488f-979a-4d13-84dc-596a91de76e7" acquired by "delete_volume" :: waited 0.017s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:34:54 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[036e3d11-60fa-4362-9dc3-38f132346394]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:34:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-89f4f45b-943e-41b9-94d7-06e365116838 tempest-ProjectReaderTests-747590484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2c28488f-979a-4d13-84dc-596a91de76e7 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:54 devstack sudo[105746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2c28488f-979a-4d13-84dc-596a91de76e7 Nov 03 20:34:54 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:54 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-89f4f45b-943e-41b9-94d7-06e365116838 tempest-ProjectReaderTests-747590484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2c28488f-979a-4d13-84dc-596a91de76e7" returned: 0 in 0.403s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-89f4f45b-943e-41b9-94d7-06e365116838 tempest-ProjectReaderTests-747590484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2c28488f-979a-4d13-84dc-596a91de76e7 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:54 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2c28488f-979a-4d13-84dc-596a91de76e7 Nov 03 20:34:54 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:55 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-89f4f45b-943e-41b9-94d7-06e365116838 tempest-ProjectReaderTests-747590484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2c28488f-979a-4d13-84dc-596a91de76e7" returned: 0 in 0.269s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:55 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-89f4f45b-943e-41b9-94d7-06e365116838 tempest-ProjectReaderTests-747590484 None] Lock "cinder-quobyte-2c28488f-979a-4d13-84dc-596a91de76e7" released by "delete_volume" :: held 0.722s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:34:55 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-89f4f45b-943e-41b9-94d7-06e365116838 tempest-ProjectReaderTests-747590484 None] Created reservations ['93daaf25-87f6-4ad3-b88f-a8e5526250db', '6d95a288-1f9e-4f9e-8587-536c21ab7a8b', 'e112f317-faab-47b5-a6e5-e2a19b2ae888', '0dca4584-69fa-4177-92e6-ac7f5d45b288'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:34:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-89f4f45b-943e-41b9-94d7-06e365116838 tempest-ProjectReaderTests-747590484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:34:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-89f4f45b-943e-41b9-94d7-06e365116838 tempest-ProjectReaderTests-747590484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:34:55 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-89f4f45b-943e-41b9-94d7-06e365116838 tempest-ProjectReaderTests-747590484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:34:55 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-89f4f45b-943e-41b9-94d7-06e365116838 tempest-ProjectReaderTests-747590484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:34:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-89f4f45b-943e-41b9-94d7-06e365116838 tempest-ProjectReaderTests-747590484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:34:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-89f4f45b-943e-41b9-94d7-06e365116838 tempest-ProjectReaderTests-747590484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:55 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:34:55 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:55 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-89f4f45b-943e-41b9-94d7-06e365116838 tempest-ProjectReaderTests-747590484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.291s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:55 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-89f4f45b-943e-41b9-94d7-06e365116838 tempest-ProjectReaderTests-747590484 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:34:55 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-89f4f45b-943e-41b9-94d7-06e365116838 tempest-ProjectReaderTests-747590484 None] Deleted volume successfully. Nov 03 20:34:55 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-89f4f45b-943e-41b9-94d7-06e365116838 tempest-ProjectReaderTests-747590484 None] Lock "cinder-2c28488f-979a-4d13-84dc-596a91de76e7-delete_volume" released by "delete_volume" :: held 1.239s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:34:55 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-e62ddf70-cd43-46ab-bb1d-1e1ec9b7dc1b tempest-ProjectReaderTests-747590484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:34:55 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e62ddf70-cd43-46ab-bb1d-1e1ec9b7dc1b tempest-ProjectReaderTests-747590484 None] Flow 'volume_create_manager' (906418fa-09f6-459e-85e9-2d2375e7861c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:34:55 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e62ddf70-cd43-46ab-bb1d-1e1ec9b7dc1b tempest-ProjectReaderTests-747590484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9088ff3-6bf5-4b40-a8db-a02486c191f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:34:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e62ddf70-cd43-46ab-bb1d-1e1ec9b7dc1b tempest-ProjectReaderTests-747590484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9088ff3-6bf5-4b40-a8db-a02486c191f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1326536392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8e7caa0-61a8-40ca-a748-25c9f8b54a91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14be7f87c70c4086b33001ec83a477bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:34:56Z,use_quota=True,user_id='fae611af8d8c494e97c9a693ffdaa22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:34:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e62ddf70-cd43-46ab-bb1d-1e1ec9b7dc1b tempest-ProjectReaderTests-747590484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (920e3ee2-c2d5-44ff-b356-140409d05326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:34:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e62ddf70-cd43-46ab-bb1d-1e1ec9b7dc1b tempest-ProjectReaderTests-747590484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (920e3ee2-c2d5-44ff-b356-140409d05326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:34:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e62ddf70-cd43-46ab-bb1d-1e1ec9b7dc1b tempest-ProjectReaderTests-747590484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce1c6fb3-75e8-4377-8dc3-d3c7fb29eb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:34:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e62ddf70-cd43-46ab-bb1d-1e1ec9b7dc1b tempest-ProjectReaderTests-747590484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce1c6fb3-75e8-4377-8dc3-d3c7fb29eb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8e7caa0-61a8-40ca-a748-25c9f8b54a91', 'volume_name': 'volume-f8e7caa0-61a8-40ca-a748-25c9f8b54a91', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:34:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e62ddf70-cd43-46ab-bb1d-1e1ec9b7dc1b tempest-ProjectReaderTests-747590484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbbee4b9-3b71-4a54-bb26-065442e128ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:34:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e62ddf70-cd43-46ab-bb1d-1e1ec9b7dc1b tempest-ProjectReaderTests-747590484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbbee4b9-3b71-4a54-bb26-065442e128ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:34:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e62ddf70-cd43-46ab-bb1d-1e1ec9b7dc1b tempest-ProjectReaderTests-747590484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9407892-bdc7-48a4-b8ca-b48297029d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:34:56 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-e62ddf70-cd43-46ab-bb1d-1e1ec9b7dc1b tempest-ProjectReaderTests-747590484 None] Volume f8e7caa0-61a8-40ca-a748-25c9f8b54a91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8e7caa0-61a8-40ca-a748-25c9f8b54a91', 'volume_size': 1} Nov 03 20:34:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e62ddf70-cd43-46ab-bb1d-1e1ec9b7dc1b tempest-ProjectReaderTests-747590484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:34:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e62ddf70-cd43-46ab-bb1d-1e1ec9b7dc1b tempest-ProjectReaderTests-747590484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:34:56 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e62ddf70-cd43-46ab-bb1d-1e1ec9b7dc1b tempest-ProjectReaderTests-747590484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1326536392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8e7caa0-61a8-40ca-a748-25c9f8b54a91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14be7f87c70c4086b33001ec83a477bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:34:56Z,use_quota=True,user_id='fae611af8d8c494e97c9a693ffdaa22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:34:56 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-e62ddf70-cd43-46ab-bb1d-1e1ec9b7dc1b tempest-ProjectReaderTests-747590484 None] Creating volume f8e7caa0-61a8-40ca-a748-25c9f8b54a91 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:34:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e62ddf70-cd43-46ab-bb1d-1e1ec9b7dc1b tempest-ProjectReaderTests-747590484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:34:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e62ddf70-cd43-46ab-bb1d-1e1ec9b7dc1b tempest-ProjectReaderTests-747590484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:34:56 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e62ddf70-cd43-46ab-bb1d-1e1ec9b7dc1b tempest-ProjectReaderTests-747590484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:34:56 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e62ddf70-cd43-46ab-bb1d-1e1ec9b7dc1b tempest-ProjectReaderTests-747590484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:34:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e62ddf70-cd43-46ab-bb1d-1e1ec9b7dc1b tempest-ProjectReaderTests-747590484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:34:56 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e62ddf70-cd43-46ab-bb1d-1e1ec9b7dc1b tempest-ProjectReaderTests-747590484 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:34:56 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-e62ddf70-cd43-46ab-bb1d-1e1ec9b7dc1b tempest-ProjectReaderTests-747590484 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:34:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e62ddf70-cd43-46ab-bb1d-1e1ec9b7dc1b tempest-ProjectReaderTests-747590484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f8e7caa0-61a8-40ca-a748-25c9f8b54a91 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:56 devstack sudo[105758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f8e7caa0-61a8-40ca-a748-25c9f8b54a91 1073741824 Nov 03 20:34:56 devstack sudo[105758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:56 devstack sudo[105758]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e62ddf70-cd43-46ab-bb1d-1e1ec9b7dc1b tempest-ProjectReaderTests-747590484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f8e7caa0-61a8-40ca-a748-25c9f8b54a91 1073741824" returned: 0 in 0.455s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e62ddf70-cd43-46ab-bb1d-1e1ec9b7dc1b tempest-ProjectReaderTests-747590484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f8e7caa0-61a8-40ca-a748-25c9f8b54a91 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:56 devstack sudo[105764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f8e7caa0-61a8-40ca-a748-25c9f8b54a91 Nov 03 20:34:56 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:56 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e62ddf70-cd43-46ab-bb1d-1e1ec9b7dc1b tempest-ProjectReaderTests-747590484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f8e7caa0-61a8-40ca-a748-25c9f8b54a91" returned: 0 in 0.245s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:56 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e62ddf70-cd43-46ab-bb1d-1e1ec9b7dc1b tempest-ProjectReaderTests-747590484 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:34:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e62ddf70-cd43-46ab-bb1d-1e1ec9b7dc1b tempest-ProjectReaderTests-747590484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:34:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e62ddf70-cd43-46ab-bb1d-1e1ec9b7dc1b tempest-ProjectReaderTests-747590484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9407892-bdc7-48a4-b8ca-b48297029d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8e7caa0-61a8-40ca-a748-25c9f8b54a91', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:34:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e62ddf70-cd43-46ab-bb1d-1e1ec9b7dc1b tempest-ProjectReaderTests-747590484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0b6e27b-31f4-4f4a-81bb-2f5fb6526a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:34:56 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-e62ddf70-cd43-46ab-bb1d-1e1ec9b7dc1b tempest-ProjectReaderTests-747590484 None] Volume volume-f8e7caa0-61a8-40ca-a748-25c9f8b54a91 (f8e7caa0-61a8-40ca-a748-25c9f8b54a91): created successfully Nov 03 20:34:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e62ddf70-cd43-46ab-bb1d-1e1ec9b7dc1b tempest-ProjectReaderTests-747590484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0b6e27b-31f4-4f4a-81bb-2f5fb6526a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:34:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-e62ddf70-cd43-46ab-bb1d-1e1ec9b7dc1b tempest-ProjectReaderTests-747590484 None] Flow 'volume_create_manager' (906418fa-09f6-459e-85e9-2d2375e7861c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:34:56 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-e62ddf70-cd43-46ab-bb1d-1e1ec9b7dc1b tempest-ProjectReaderTests-747590484 None] Created volume successfully. Nov 03 20:34:57 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-082638e5-6b69-44ae-98bb-5834f57671fe tempest-ProjectReaderTests-747590484 None] Acquiring lock "cinder-f8e7caa0-61a8-40ca-a748-25c9f8b54a91-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:34:57 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-082638e5-6b69-44ae-98bb-5834f57671fe tempest-ProjectReaderTests-747590484 None] Lock "cinder-f8e7caa0-61a8-40ca-a748-25c9f8b54a91-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:34:57 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-082638e5-6b69-44ae-98bb-5834f57671fe tempest-ProjectReaderTests-747590484 None] Acquiring lock "cinder-quobyte-f8e7caa0-61a8-40ca-a748-25c9f8b54a91" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:34:57 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-082638e5-6b69-44ae-98bb-5834f57671fe tempest-ProjectReaderTests-747590484 None] Lock "cinder-quobyte-f8e7caa0-61a8-40ca-a748-25c9f8b54a91" acquired by "delete_volume" :: waited 0.015s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:34:57 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[897676b5-8c7e-4884-b47d-41987eb521ab]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:34:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-082638e5-6b69-44ae-98bb-5834f57671fe tempest-ProjectReaderTests-747590484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f8e7caa0-61a8-40ca-a748-25c9f8b54a91 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:57 devstack sudo[105767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f8e7caa0-61a8-40ca-a748-25c9f8b54a91 Nov 03 20:34:57 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:57 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-082638e5-6b69-44ae-98bb-5834f57671fe tempest-ProjectReaderTests-747590484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f8e7caa0-61a8-40ca-a748-25c9f8b54a91" returned: 0 in 0.379s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-082638e5-6b69-44ae-98bb-5834f57671fe tempest-ProjectReaderTests-747590484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f8e7caa0-61a8-40ca-a748-25c9f8b54a91 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:57 devstack sudo[105772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f8e7caa0-61a8-40ca-a748-25c9f8b54a91 Nov 03 20:34:57 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:57 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-082638e5-6b69-44ae-98bb-5834f57671fe tempest-ProjectReaderTests-747590484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f8e7caa0-61a8-40ca-a748-25c9f8b54a91" returned: 0 in 0.297s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:57 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-082638e5-6b69-44ae-98bb-5834f57671fe tempest-ProjectReaderTests-747590484 None] Lock "cinder-quobyte-f8e7caa0-61a8-40ca-a748-25c9f8b54a91" released by "delete_volume" :: held 0.723s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:34:57 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-082638e5-6b69-44ae-98bb-5834f57671fe tempest-ProjectReaderTests-747590484 None] Created reservations ['0473c4fc-c933-45e6-82db-a3f3a0a96cb1', 'fa37b0de-570f-473a-a35f-f39d7974efbb', 'b2636652-6200-4aca-9df9-8a506875994d', 'a8d77426-8e3a-4d4d-904e-65a0c6cfb02e'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:34:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-082638e5-6b69-44ae-98bb-5834f57671fe tempest-ProjectReaderTests-747590484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:34:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-082638e5-6b69-44ae-98bb-5834f57671fe tempest-ProjectReaderTests-747590484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:34:57 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-082638e5-6b69-44ae-98bb-5834f57671fe tempest-ProjectReaderTests-747590484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:34:57 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-082638e5-6b69-44ae-98bb-5834f57671fe tempest-ProjectReaderTests-747590484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:34:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-082638e5-6b69-44ae-98bb-5834f57671fe tempest-ProjectReaderTests-747590484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:34:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-082638e5-6b69-44ae-98bb-5834f57671fe tempest-ProjectReaderTests-747590484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:34:58 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:34:58 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:34:58 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Nov 03 20:34:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-082638e5-6b69-44ae-98bb-5834f57671fe tempest-ProjectReaderTests-747590484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.305s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:34:58 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-082638e5-6b69-44ae-98bb-5834f57671fe tempest-ProjectReaderTests-747590484 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:34:58 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-082638e5-6b69-44ae-98bb-5834f57671fe tempest-ProjectReaderTests-747590484 None] Deleted volume successfully. Nov 03 20:34:58 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-082638e5-6b69-44ae-98bb-5834f57671fe tempest-ProjectReaderTests-747590484 None] Lock "cinder-f8e7caa0-61a8-40ca-a748-25c9f8b54a91-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:35:07 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:UPDATE=77,cinder:SELECT=70,cinder:INSERT=23,cinder:DELETE=4 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:35:08 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:SELECT=63,cinder:INSERT=22,cinder:UPDATE=76,cinder:DELETE=9 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:35:22 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-861866a9-4ae3-4a40-a594-57169e964e6e tempest-TestImageHashVerification-423455099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:35:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-861866a9-4ae3-4a40-a594-57169e964e6e tempest-TestImageHashVerification-423455099 None] Flow 'volume_create_manager' (6af5a22d-a7e3-4734-be24-b0d98ef9dd7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:35:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-861866a9-4ae3-4a40-a594-57169e964e6e tempest-TestImageHashVerification-423455099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d0d6aca-8ce8-4f55-9f33-9874e0ad7ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:35:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-861866a9-4ae3-4a40-a594-57169e964e6e tempest-TestImageHashVerification-423455099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d0d6aca-8ce8-4f55-9f33-9874e0ad7ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-170664189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c665db4-8b7b-4675-b717-7112b6922e7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f98715305d848e0a961bd80fb720c3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:35:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:35:23Z,use_quota=True,user_id='005d24e912f14a548f440b1141d5d94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:35:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-861866a9-4ae3-4a40-a594-57169e964e6e tempest-TestImageHashVerification-423455099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99f28a76-2238-4563-9a8f-c0e89faae396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:35:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-861866a9-4ae3-4a40-a594-57169e964e6e tempest-TestImageHashVerification-423455099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99f28a76-2238-4563-9a8f-c0e89faae396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:35:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-861866a9-4ae3-4a40-a594-57169e964e6e tempest-TestImageHashVerification-423455099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01cb59bc-8ab9-4c19-a913-6755af5ab213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:35:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-861866a9-4ae3-4a40-a594-57169e964e6e tempest-TestImageHashVerification-423455099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01cb59bc-8ab9-4c19-a913-6755af5ab213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c665db4-8b7b-4675-b717-7112b6922e7e', 'volume_name': 'volume-1c665db4-8b7b-4675-b717-7112b6922e7e', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:35:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-861866a9-4ae3-4a40-a594-57169e964e6e tempest-TestImageHashVerification-423455099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fd491b9-af39-4c30-9864-907508c64258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:35:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-861866a9-4ae3-4a40-a594-57169e964e6e tempest-TestImageHashVerification-423455099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fd491b9-af39-4c30-9864-907508c64258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:35:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-861866a9-4ae3-4a40-a594-57169e964e6e tempest-TestImageHashVerification-423455099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (868a02bd-59f3-4bc9-afb1-222c43f2467d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:35:22 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-861866a9-4ae3-4a40-a594-57169e964e6e tempest-TestImageHashVerification-423455099 None] Volume 1c665db4-8b7b-4675-b717-7112b6922e7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c665db4-8b7b-4675-b717-7112b6922e7e', 'volume_size': 1} Nov 03 20:35:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-861866a9-4ae3-4a40-a594-57169e964e6e tempest-TestImageHashVerification-423455099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:35:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-861866a9-4ae3-4a40-a594-57169e964e6e tempest-TestImageHashVerification-423455099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:35:22 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-861866a9-4ae3-4a40-a594-57169e964e6e tempest-TestImageHashVerification-423455099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-170664189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c665db4-8b7b-4675-b717-7112b6922e7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f98715305d848e0a961bd80fb720c3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:35:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:35:23Z,use_quota=True,user_id='005d24e912f14a548f440b1141d5d94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:35:22 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-861866a9-4ae3-4a40-a594-57169e964e6e tempest-TestImageHashVerification-423455099 None] Creating volume 1c665db4-8b7b-4675-b717-7112b6922e7e {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:35:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-861866a9-4ae3-4a40-a594-57169e964e6e tempest-TestImageHashVerification-423455099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:35:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-861866a9-4ae3-4a40-a594-57169e964e6e tempest-TestImageHashVerification-423455099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:35:22 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-861866a9-4ae3-4a40-a594-57169e964e6e tempest-TestImageHashVerification-423455099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:35:22 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-861866a9-4ae3-4a40-a594-57169e964e6e tempest-TestImageHashVerification-423455099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:35:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-861866a9-4ae3-4a40-a594-57169e964e6e tempest-TestImageHashVerification-423455099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:35:22 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-861866a9-4ae3-4a40-a594-57169e964e6e tempest-TestImageHashVerification-423455099 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:35:22 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-861866a9-4ae3-4a40-a594-57169e964e6e tempest-TestImageHashVerification-423455099 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:35:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-861866a9-4ae3-4a40-a594-57169e964e6e tempest-TestImageHashVerification-423455099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c665db4-8b7b-4675-b717-7112b6922e7e 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:35:22 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c665db4-8b7b-4675-b717-7112b6922e7e 1073741824 Nov 03 20:35:22 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:35:23 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Nov 03 20:35:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-861866a9-4ae3-4a40-a594-57169e964e6e tempest-TestImageHashVerification-423455099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c665db4-8b7b-4675-b717-7112b6922e7e 1073741824" returned: 0 in 0.406s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:35:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-861866a9-4ae3-4a40-a594-57169e964e6e tempest-TestImageHashVerification-423455099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c665db4-8b7b-4675-b717-7112b6922e7e {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:35:23 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c665db4-8b7b-4675-b717-7112b6922e7e Nov 03 20:35:23 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:35:23 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Nov 03 20:35:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-861866a9-4ae3-4a40-a594-57169e964e6e tempest-TestImageHashVerification-423455099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c665db4-8b7b-4675-b717-7112b6922e7e" returned: 0 in 0.239s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:35:23 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-861866a9-4ae3-4a40-a594-57169e964e6e tempest-TestImageHashVerification-423455099 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:35:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-861866a9-4ae3-4a40-a594-57169e964e6e tempest-TestImageHashVerification-423455099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:35:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-861866a9-4ae3-4a40-a594-57169e964e6e tempest-TestImageHashVerification-423455099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (868a02bd-59f3-4bc9-afb1-222c43f2467d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c665db4-8b7b-4675-b717-7112b6922e7e', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:35:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-861866a9-4ae3-4a40-a594-57169e964e6e tempest-TestImageHashVerification-423455099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08b1f390-d03f-4960-8376-4687cc8d7416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:35:23 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-861866a9-4ae3-4a40-a594-57169e964e6e tempest-TestImageHashVerification-423455099 None] Volume volume-1c665db4-8b7b-4675-b717-7112b6922e7e (1c665db4-8b7b-4675-b717-7112b6922e7e): created successfully Nov 03 20:35:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-861866a9-4ae3-4a40-a594-57169e964e6e tempest-TestImageHashVerification-423455099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08b1f390-d03f-4960-8376-4687cc8d7416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:35:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-861866a9-4ae3-4a40-a594-57169e964e6e tempest-TestImageHashVerification-423455099 None] Flow 'volume_create_manager' (6af5a22d-a7e3-4734-be24-b0d98ef9dd7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:35:23 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-861866a9-4ae3-4a40-a594-57169e964e6e tempest-TestImageHashVerification-423455099 None] Created volume successfully. Nov 03 20:35:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-76aecf34-f8a3-4530-b836-f1e9c9c59e92 tempest-TestImageHashVerification-423455099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:35:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-76aecf34-f8a3-4530-b836-f1e9c9c59e92 tempest-TestImageHashVerification-423455099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:35:24 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[904aa086-d7b6-447b-973b-620fbd56947b]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:35:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-76aecf34-f8a3-4530-b836-f1e9c9c59e92 tempest-TestImageHashVerification-423455099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c665db4-8b7b-4675-b717-7112b6922e7e {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:35:24 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c665db4-8b7b-4675-b717-7112b6922e7e Nov 03 20:35:24 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:35:24 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Nov 03 20:35:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-76aecf34-f8a3-4530-b836-f1e9c9c59e92 tempest-TestImageHashVerification-423455099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c665db4-8b7b-4675-b717-7112b6922e7e" returned: 0 in 0.354s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:35:24 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b92ee77-d7f9-4c44-b5e7-cb0c66964db1]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:35:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-76aecf34-f8a3-4530-b836-f1e9c9c59e92 tempest-TestImageHashVerification-423455099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c665db4-8b7b-4675-b717-7112b6922e7e {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:35:24 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c665db4-8b7b-4675-b717-7112b6922e7e Nov 03 20:35:24 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:35:25 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Nov 03 20:35:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-76aecf34-f8a3-4530-b836-f1e9c9c59e92 tempest-TestImageHashVerification-423455099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c665db4-8b7b-4675-b717-7112b6922e7e" returned: 0 in 0.353s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:35:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-76aecf34-f8a3-4530-b836-f1e9c9c59e92 tempest-TestImageHashVerification-423455099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c665db4-8b7b-4675-b717-7112b6922e7e /opt/stack/data/cinder/conversion/1c665db4-8b7b-4675-b717-7112b6922e7e.temp_image.b191f014-1b2d-41a9-8d33-d814480f9ee1m8i6q_13.img {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:35:25 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c665db4-8b7b-4675-b717-7112b6922e7e /opt/stack/data/cinder/conversion/1c665db4-8b7b-4675-b717-7112b6922e7e.temp_image.b191f014-1b2d-41a9-8d33-d814480f9ee1m8i6q_13.img Nov 03 20:35:25 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:35:28 devstack cinder-volume[87248]: DEBUG oslo_service.periodic_task [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:35:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:35:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:35:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:35:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:35:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:35:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:35:28 devstack sudo[105864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:35:28 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:35:29 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root Nov 03 20:35:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.332s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:35:29 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:35:29 devstack cinder-volume[87248]: DEBUG oslo_service.periodic_task [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running periodic task VolumeManager._thread_info {{(pid=87248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:35:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] thread count: 28 {{(pid=87248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:35:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] thread info: [<_MainThread(MainThread, started 124862067372160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:35:30 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Nov 03 20:35:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-76aecf34-f8a3-4530-b836-f1e9c9c59e92 tempest-TestImageHashVerification-423455099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c665db4-8b7b-4675-b717-7112b6922e7e /opt/stack/data/cinder/conversion/1c665db4-8b7b-4675-b717-7112b6922e7e.temp_image.b191f014-1b2d-41a9-8d33-d814480f9ee1m8i6q_13.img" returned: 0 in 5.731s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:35:30 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[17dc5ff7-0356-4096-ad10-5151e437683a]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:35:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-76aecf34-f8a3-4530-b836-f1e9c9c59e92 tempest-TestImageHashVerification-423455099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c665db4-8b7b-4675-b717-7112b6922e7e {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:35:31 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c665db4-8b7b-4675-b717-7112b6922e7e Nov 03 20:35:31 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:35:31 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Nov 03 20:35:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-76aecf34-f8a3-4530-b836-f1e9c9c59e92 tempest-TestImageHashVerification-423455099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c665db4-8b7b-4675-b717-7112b6922e7e" returned: 0 in 0.542s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:35:31 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-76aecf34-f8a3-4530-b836-f1e9c9c59e92 tempest-TestImageHashVerification-423455099 None] Image conversion details: src /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c665db4-8b7b-4675-b717-7112b6922e7e, size 1024.00 MB, duration 5.73 sec, destination /opt/stack/data/cinder/conversion/1c665db4-8b7b-4675-b717-7112b6922e7e.temp_image.b191f014-1b2d-41a9-8d33-d814480f9ee1m8i6q_13.img {{(pid=87248) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:35:31 devstack cinder-volume[87248]: INFO cinder.image.image_utils [None req-76aecf34-f8a3-4530-b836-f1e9c9c59e92 tempest-TestImageHashVerification-423455099 None] Converted 1024.00 MB image at 178.66 MB/s Nov 03 20:35:31 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-76aecf34-f8a3-4530-b836-f1e9c9c59e92 tempest-TestImageHashVerification-423455099 None] b191f014-1b2d-41a9-8d33-d814480f9ee1 was raw, no need to convert to raw {{(pid=87248) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 03 20:35:41 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:35:41 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:SELECT=4,cinder:UPDATE=4 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:35:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-76aecf34-f8a3-4530-b836-f1e9c9c59e92 tempest-TestImageHashVerification-423455099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.826s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:35:50 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-76aecf34-f8a3-4530-b836-f1e9c9c59e92 tempest-TestImageHashVerification-423455099 None] Uploaded volume to glance image-id: b191f014-1b2d-41a9-8d33-d814480f9ee1. {{(pid=87248) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 03 20:35:50 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-76aecf34-f8a3-4530-b836-f1e9c9c59e92 tempest-TestImageHashVerification-423455099 None] Copy volume to image completed successfully. Nov 03 20:35:50 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-15a09e38-d534-497b-ad87-f3f78af5574b tempest-TestImageHashVerification-423455099 None] Acquiring lock "cinder-1c665db4-8b7b-4675-b717-7112b6922e7e-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:35:50 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-15a09e38-d534-497b-ad87-f3f78af5574b tempest-TestImageHashVerification-423455099 None] Lock "cinder-1c665db4-8b7b-4675-b717-7112b6922e7e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:35:50 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-15a09e38-d534-497b-ad87-f3f78af5574b tempest-TestImageHashVerification-423455099 None] Acquiring lock "cinder-quobyte-1c665db4-8b7b-4675-b717-7112b6922e7e" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:35:50 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-15a09e38-d534-497b-ad87-f3f78af5574b tempest-TestImageHashVerification-423455099 None] Lock "cinder-quobyte-1c665db4-8b7b-4675-b717-7112b6922e7e" acquired by "delete_volume" :: waited 0.015s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:35:50 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd989b7-00c9-4958-ae3d-482894f1a251]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:35:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-15a09e38-d534-497b-ad87-f3f78af5574b tempest-TestImageHashVerification-423455099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c665db4-8b7b-4675-b717-7112b6922e7e {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:35:51 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c665db4-8b7b-4675-b717-7112b6922e7e Nov 03 20:35:51 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:35:51 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Nov 03 20:35:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-15a09e38-d534-497b-ad87-f3f78af5574b tempest-TestImageHashVerification-423455099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c665db4-8b7b-4675-b717-7112b6922e7e" returned: 0 in 0.355s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:35:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-15a09e38-d534-497b-ad87-f3f78af5574b tempest-TestImageHashVerification-423455099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c665db4-8b7b-4675-b717-7112b6922e7e {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:35:51 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c665db4-8b7b-4675-b717-7112b6922e7e Nov 03 20:35:51 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:35:51 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Nov 03 20:35:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-15a09e38-d534-497b-ad87-f3f78af5574b tempest-TestImageHashVerification-423455099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1c665db4-8b7b-4675-b717-7112b6922e7e" returned: 0 in 0.238s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:35:51 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-15a09e38-d534-497b-ad87-f3f78af5574b tempest-TestImageHashVerification-423455099 None] Lock "cinder-quobyte-1c665db4-8b7b-4675-b717-7112b6922e7e" released by "delete_volume" :: held 0.629s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:35:51 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-15a09e38-d534-497b-ad87-f3f78af5574b tempest-TestImageHashVerification-423455099 None] Created reservations ['379f97fe-c736-495a-b470-ce419a1d5197', '8583fd3b-0a48-4250-ab96-4ae283d2c338', 'b5b2fe32-5630-41e0-bbf5-ea0cb3640fa3', 'c0aca4c8-40a6-4011-a567-624cbd1f4822'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:35:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-15a09e38-d534-497b-ad87-f3f78af5574b tempest-TestImageHashVerification-423455099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:35:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-15a09e38-d534-497b-ad87-f3f78af5574b tempest-TestImageHashVerification-423455099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:35:51 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-15a09e38-d534-497b-ad87-f3f78af5574b tempest-TestImageHashVerification-423455099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:35:51 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-15a09e38-d534-497b-ad87-f3f78af5574b tempest-TestImageHashVerification-423455099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:35:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-15a09e38-d534-497b-ad87-f3f78af5574b tempest-TestImageHashVerification-423455099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:35:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-15a09e38-d534-497b-ad87-f3f78af5574b tempest-TestImageHashVerification-423455099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:35:51 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:35:51 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:35:51 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Nov 03 20:35:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-15a09e38-d534-497b-ad87-f3f78af5574b tempest-TestImageHashVerification-423455099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.239s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:35:51 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-15a09e38-d534-497b-ad87-f3f78af5574b tempest-TestImageHashVerification-423455099 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:35:51 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-15a09e38-d534-497b-ad87-f3f78af5574b tempest-TestImageHashVerification-423455099 None] Deleted volume successfully. Nov 03 20:35:51 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-15a09e38-d534-497b-ad87-f3f78af5574b tempest-TestImageHashVerification-423455099 None] Lock "cinder-1c665db4-8b7b-4675-b717-7112b6922e7e-delete_volume" released by "delete_volume" :: held 1.046s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:36:01 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:36:01 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:SELECT=4,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:36:02 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b1a279f-d978-4608-ba0a-f916ca38dacf tempest-CreateVolumesFromSnapshotTest-2105386654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:36:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2b1a279f-d978-4608-ba0a-f916ca38dacf tempest-CreateVolumesFromSnapshotTest-2105386654 None] Flow 'volume_create_manager' (90552dee-afaf-44ae-aa0f-9d21e6c4005f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:36:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2b1a279f-d978-4608-ba0a-f916ca38dacf tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cf076b9-9914-483b-9c09-f8551d0e8ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2b1a279f-d978-4608-ba0a-f916ca38dacf tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cf076b9-9914-483b-9c09-f8551d0e8ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-664845035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00765bbe-afbd-461d-9777-3e884ea670b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1553e264c27d41a1a9e3105ec7814327',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:36:03Z,use_quota=True,user_id='62930be2914a43a88e455dcbe973410e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2b1a279f-d978-4608-ba0a-f916ca38dacf tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (912a4080-50a3-4f39-a72d-3427470df6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2b1a279f-d978-4608-ba0a-f916ca38dacf tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (912a4080-50a3-4f39-a72d-3427470df6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2b1a279f-d978-4608-ba0a-f916ca38dacf tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42020392-45cf-431e-9c0a-4a25f238a6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2b1a279f-d978-4608-ba0a-f916ca38dacf tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42020392-45cf-431e-9c0a-4a25f238a6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00765bbe-afbd-461d-9777-3e884ea670b8', 'volume_name': 'volume-00765bbe-afbd-461d-9777-3e884ea670b8', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2b1a279f-d978-4608-ba0a-f916ca38dacf tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d20aea74-8a5c-48c1-a10c-b63ac68cbaa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2b1a279f-d978-4608-ba0a-f916ca38dacf tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d20aea74-8a5c-48c1-a10c-b63ac68cbaa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2b1a279f-d978-4608-ba0a-f916ca38dacf tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88e9f790-aff1-441e-8ac9-7047593fb7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:02 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-2b1a279f-d978-4608-ba0a-f916ca38dacf tempest-CreateVolumesFromSnapshotTest-2105386654 None] Volume 00765bbe-afbd-461d-9777-3e884ea670b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00765bbe-afbd-461d-9777-3e884ea670b8', 'volume_size': 1} Nov 03 20:36:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2b1a279f-d978-4608-ba0a-f916ca38dacf tempest-CreateVolumesFromSnapshotTest-2105386654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2b1a279f-d978-4608-ba0a-f916ca38dacf tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:02 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2b1a279f-d978-4608-ba0a-f916ca38dacf tempest-CreateVolumesFromSnapshotTest-2105386654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-664845035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00765bbe-afbd-461d-9777-3e884ea670b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1553e264c27d41a1a9e3105ec7814327',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:36:03Z,use_quota=True,user_id='62930be2914a43a88e455dcbe973410e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:36:02 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-2b1a279f-d978-4608-ba0a-f916ca38dacf tempest-CreateVolumesFromSnapshotTest-2105386654 None] Creating volume 00765bbe-afbd-461d-9777-3e884ea670b8 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:36:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2b1a279f-d978-4608-ba0a-f916ca38dacf tempest-CreateVolumesFromSnapshotTest-2105386654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2b1a279f-d978-4608-ba0a-f916ca38dacf tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:02 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2b1a279f-d978-4608-ba0a-f916ca38dacf tempest-CreateVolumesFromSnapshotTest-2105386654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:36:02 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2b1a279f-d978-4608-ba0a-f916ca38dacf tempest-CreateVolumesFromSnapshotTest-2105386654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:36:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2b1a279f-d978-4608-ba0a-f916ca38dacf tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:02 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2b1a279f-d978-4608-ba0a-f916ca38dacf tempest-CreateVolumesFromSnapshotTest-2105386654 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:36:02 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-2b1a279f-d978-4608-ba0a-f916ca38dacf tempest-CreateVolumesFromSnapshotTest-2105386654 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:36:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2b1a279f-d978-4608-ba0a-f916ca38dacf tempest-CreateVolumesFromSnapshotTest-2105386654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00765bbe-afbd-461d-9777-3e884ea670b8 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:02 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00765bbe-afbd-461d-9777-3e884ea670b8 1073741824 Nov 03 20:36:02 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:03 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2b1a279f-d978-4608-ba0a-f916ca38dacf tempest-CreateVolumesFromSnapshotTest-2105386654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00765bbe-afbd-461d-9777-3e884ea670b8 1073741824" returned: 0 in 0.406s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2b1a279f-d978-4608-ba0a-f916ca38dacf tempest-CreateVolumesFromSnapshotTest-2105386654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00765bbe-afbd-461d-9777-3e884ea670b8 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:03 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00765bbe-afbd-461d-9777-3e884ea670b8 Nov 03 20:36:03 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:03 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2b1a279f-d978-4608-ba0a-f916ca38dacf tempest-CreateVolumesFromSnapshotTest-2105386654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00765bbe-afbd-461d-9777-3e884ea670b8" returned: 0 in 0.237s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:03 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2b1a279f-d978-4608-ba0a-f916ca38dacf tempest-CreateVolumesFromSnapshotTest-2105386654 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:36:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2b1a279f-d978-4608-ba0a-f916ca38dacf tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:03 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2b1a279f-d978-4608-ba0a-f916ca38dacf tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88e9f790-aff1-441e-8ac9-7047593fb7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00765bbe-afbd-461d-9777-3e884ea670b8', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:03 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2b1a279f-d978-4608-ba0a-f916ca38dacf tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f4c4c5e-c89a-4b5a-8bd2-6b35d9276855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:03 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-2b1a279f-d978-4608-ba0a-f916ca38dacf tempest-CreateVolumesFromSnapshotTest-2105386654 None] Volume volume-00765bbe-afbd-461d-9777-3e884ea670b8 (00765bbe-afbd-461d-9777-3e884ea670b8): created successfully Nov 03 20:36:03 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2b1a279f-d978-4608-ba0a-f916ca38dacf tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f4c4c5e-c89a-4b5a-8bd2-6b35d9276855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:03 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2b1a279f-d978-4608-ba0a-f916ca38dacf tempest-CreateVolumesFromSnapshotTest-2105386654 None] Flow 'volume_create_manager' (90552dee-afaf-44ae-aa0f-9d21e6c4005f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:36:03 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-2b1a279f-d978-4608-ba0a-f916ca38dacf tempest-CreateVolumesFromSnapshotTest-2105386654 None] Created volume successfully. Nov 03 20:36:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a5cb5d9c-3ffe-44de-91cc-cd72eacba272 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a5cb5d9c-3ffe-44de-91cc-cd72eacba272 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:03 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-a5cb5d9c-3ffe-44de-91cc-cd72eacba272 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Creating offline snapshot ec4dc3f4-81a4-455b-a6aa-e444126bee71 of volume 00765bbe-afbd-461d-9777-3e884ea670b8 {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:36:03 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc86f32-fc9d-4f25-b8d3-a2c433d78c88]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:36:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a5cb5d9c-3ffe-44de-91cc-cd72eacba272 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00765bbe-afbd-461d-9777-3e884ea670b8 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:04 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00765bbe-afbd-461d-9777-3e884ea670b8 Nov 03 20:36:04 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:04 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a5cb5d9c-3ffe-44de-91cc-cd72eacba272 tempest-CreateVolumesFromSnapshotTest-2105386654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00765bbe-afbd-461d-9777-3e884ea670b8" returned: 0 in 0.352s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a5cb5d9c-3ffe-44de-91cc-cd72eacba272 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00765bbe-afbd-461d-9777-3e884ea670b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00765bbe-afbd-461d-9777-3e884ea670b8.ec4dc3f4-81a4-455b-a6aa-e444126bee71 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:04 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00765bbe-afbd-461d-9777-3e884ea670b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00765bbe-afbd-461d-9777-3e884ea670b8.ec4dc3f4-81a4-455b-a6aa-e444126bee71 1G Nov 03 20:36:04 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:04 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a5cb5d9c-3ffe-44de-91cc-cd72eacba272 tempest-CreateVolumesFromSnapshotTest-2105386654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00765bbe-afbd-461d-9777-3e884ea670b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00765bbe-afbd-461d-9777-3e884ea670b8.ec4dc3f4-81a4-455b-a6aa-e444126bee71 1G" returned: 0 in 0.382s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a5cb5d9c-3ffe-44de-91cc-cd72eacba272 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00765bbe-afbd-461d-9777-3e884ea670b8 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00765bbe-afbd-461d-9777-3e884ea670b8.ec4dc3f4-81a4-455b-a6aa-e444126bee71 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:04 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00765bbe-afbd-461d-9777-3e884ea670b8 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00765bbe-afbd-461d-9777-3e884ea670b8.ec4dc3f4-81a4-455b-a6aa-e444126bee71 Nov 03 20:36:04 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:04 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a5cb5d9c-3ffe-44de-91cc-cd72eacba272 tempest-CreateVolumesFromSnapshotTest-2105386654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00765bbe-afbd-461d-9777-3e884ea670b8 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00765bbe-afbd-461d-9777-3e884ea670b8.ec4dc3f4-81a4-455b-a6aa-e444126bee71" returned: 0 in 0.284s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:04 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-a5cb5d9c-3ffe-44de-91cc-cd72eacba272 tempest-CreateVolumesFromSnapshotTest-2105386654 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00765bbe-afbd-461d-9777-3e884ea670b8.ec4dc3f4-81a4-455b-a6aa-e444126bee71 is being set with open permissions: ugo+rw Nov 03 20:36:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a5cb5d9c-3ffe-44de-91cc-cd72eacba272 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00765bbe-afbd-461d-9777-3e884ea670b8.ec4dc3f4-81a4-455b-a6aa-e444126bee71 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:04 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00765bbe-afbd-461d-9777-3e884ea670b8.ec4dc3f4-81a4-455b-a6aa-e444126bee71 Nov 03 20:36:04 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:05 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a5cb5d9c-3ffe-44de-91cc-cd72eacba272 tempest-CreateVolumesFromSnapshotTest-2105386654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00765bbe-afbd-461d-9777-3e884ea670b8.ec4dc3f4-81a4-455b-a6aa-e444126bee71" returned: 0 in 0.233s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a5cb5d9c-3ffe-44de-91cc-cd72eacba272 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00765bbe-afbd-461d-9777-3e884ea670b8.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:05 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00765bbe-afbd-461d-9777-3e884ea670b8.info Nov 03 20:36:05 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:05 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a5cb5d9c-3ffe-44de-91cc-cd72eacba272 tempest-CreateVolumesFromSnapshotTest-2105386654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00765bbe-afbd-461d-9777-3e884ea670b8.info" returned: 0 in 0.247s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:05 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-a5cb5d9c-3ffe-44de-91cc-cd72eacba272 tempest-CreateVolumesFromSnapshotTest-2105386654 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00765bbe-afbd-461d-9777-3e884ea670b8.info is being set with open permissions: ugo+rw Nov 03 20:36:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a5cb5d9c-3ffe-44de-91cc-cd72eacba272 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00765bbe-afbd-461d-9777-3e884ea670b8.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:05 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00765bbe-afbd-461d-9777-3e884ea670b8.info Nov 03 20:36:05 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:05 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a5cb5d9c-3ffe-44de-91cc-cd72eacba272 tempest-CreateVolumesFromSnapshotTest-2105386654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00765bbe-afbd-461d-9777-3e884ea670b8.info" returned: 0 in 0.234s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a5cb5d9c-3ffe-44de-91cc-cd72eacba272 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.819s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:05 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-a5cb5d9c-3ffe-44de-91cc-cd72eacba272 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Create snapshot completed successfully Nov 03 20:36:06 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-75eb96b2-6330-4c39-93d8-0aea1d09fc6d tempest-CreateVolumesFromSnapshotTest-2105386654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:36:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75eb96b2-6330-4c39-93d8-0aea1d09fc6d tempest-CreateVolumesFromSnapshotTest-2105386654 None] Flow 'volume_create_manager' (f9057ead-eac8-4543-a87c-11ef40ebca48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:36:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75eb96b2-6330-4c39-93d8-0aea1d09fc6d tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41204821-665f-47bb-9f02-2e43554cca5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75eb96b2-6330-4c39-93d8-0aea1d09fc6d tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41204821-665f-47bb-9f02-2e43554cca5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1219417830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9a37a79-94cb-4f48-a2b9-59ddf477ae10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1553e264c27d41a1a9e3105ec7814327',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:36:06Z,use_quota=True,user_id='62930be2914a43a88e455dcbe973410e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75eb96b2-6330-4c39-93d8-0aea1d09fc6d tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f049722c-8ebd-4ad8-91b2-cfede82137b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75eb96b2-6330-4c39-93d8-0aea1d09fc6d tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f049722c-8ebd-4ad8-91b2-cfede82137b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75eb96b2-6330-4c39-93d8-0aea1d09fc6d tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6161a9e-bb8c-46b5-8e48-2cc74fb29b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75eb96b2-6330-4c39-93d8-0aea1d09fc6d tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6161a9e-bb8c-46b5-8e48-2cc74fb29b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9a37a79-94cb-4f48-a2b9-59ddf477ae10', 'volume_name': 'volume-f9a37a79-94cb-4f48-a2b9-59ddf477ae10', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75eb96b2-6330-4c39-93d8-0aea1d09fc6d tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9381edb0-cbca-44dc-80e9-ef740a9017d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75eb96b2-6330-4c39-93d8-0aea1d09fc6d tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9381edb0-cbca-44dc-80e9-ef740a9017d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75eb96b2-6330-4c39-93d8-0aea1d09fc6d tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f40497e0-b5a2-45e8-af72-27ceb345d1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:06 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-75eb96b2-6330-4c39-93d8-0aea1d09fc6d tempest-CreateVolumesFromSnapshotTest-2105386654 None] Volume f9a37a79-94cb-4f48-a2b9-59ddf477ae10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9a37a79-94cb-4f48-a2b9-59ddf477ae10', 'volume_size': 1} Nov 03 20:36:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75eb96b2-6330-4c39-93d8-0aea1d09fc6d tempest-CreateVolumesFromSnapshotTest-2105386654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75eb96b2-6330-4c39-93d8-0aea1d09fc6d tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75eb96b2-6330-4c39-93d8-0aea1d09fc6d tempest-CreateVolumesFromSnapshotTest-2105386654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1219417830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9a37a79-94cb-4f48-a2b9-59ddf477ae10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1553e264c27d41a1a9e3105ec7814327',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:36:06Z,use_quota=True,user_id='62930be2914a43a88e455dcbe973410e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:36:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-75eb96b2-6330-4c39-93d8-0aea1d09fc6d tempest-CreateVolumesFromSnapshotTest-2105386654 None] Creating volume f9a37a79-94cb-4f48-a2b9-59ddf477ae10 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:36:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75eb96b2-6330-4c39-93d8-0aea1d09fc6d tempest-CreateVolumesFromSnapshotTest-2105386654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75eb96b2-6330-4c39-93d8-0aea1d09fc6d tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75eb96b2-6330-4c39-93d8-0aea1d09fc6d tempest-CreateVolumesFromSnapshotTest-2105386654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:36:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75eb96b2-6330-4c39-93d8-0aea1d09fc6d tempest-CreateVolumesFromSnapshotTest-2105386654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:36:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75eb96b2-6330-4c39-93d8-0aea1d09fc6d tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75eb96b2-6330-4c39-93d8-0aea1d09fc6d tempest-CreateVolumesFromSnapshotTest-2105386654 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:36:06 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-75eb96b2-6330-4c39-93d8-0aea1d09fc6d tempest-CreateVolumesFromSnapshotTest-2105386654 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:36:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75eb96b2-6330-4c39-93d8-0aea1d09fc6d tempest-CreateVolumesFromSnapshotTest-2105386654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f9a37a79-94cb-4f48-a2b9-59ddf477ae10 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:06 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f9a37a79-94cb-4f48-a2b9-59ddf477ae10 1073741824 Nov 03 20:36:06 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:06 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce171df9-6cc1-42a2-b1a2-8722276abf63 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:36:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ce171df9-6cc1-42a2-b1a2-8722276abf63 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Flow 'volume_create_manager' (ad730181-2dce-425c-a7ba-72abd8be2a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:36:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ce171df9-6cc1-42a2-b1a2-8722276abf63 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d02a1e57-7508-4355-b610-47c086db4219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ce171df9-6cc1-42a2-b1a2-8722276abf63 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d02a1e57-7508-4355-b610-47c086db4219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1306954647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60c4b76e-d21c-4f7a-876c-64279b0db919,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1553e264c27d41a1a9e3105ec7814327',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:36:07Z,use_quota=True,user_id='62930be2914a43a88e455dcbe973410e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ce171df9-6cc1-42a2-b1a2-8722276abf63 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaea44f2-d610-4ff4-a78d-81d6af7d2fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ce171df9-6cc1-42a2-b1a2-8722276abf63 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaea44f2-d610-4ff4-a78d-81d6af7d2fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ce171df9-6cc1-42a2-b1a2-8722276abf63 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cfed009-d822-44ee-8658-db8039a846bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ce171df9-6cc1-42a2-b1a2-8722276abf63 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cfed009-d822-44ee-8658-db8039a846bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60c4b76e-d21c-4f7a-876c-64279b0db919', 'volume_name': 'volume-60c4b76e-d21c-4f7a-876c-64279b0db919', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ce171df9-6cc1-42a2-b1a2-8722276abf63 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17c97e90-49f5-4f69-9da9-b85a212d72aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ce171df9-6cc1-42a2-b1a2-8722276abf63 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17c97e90-49f5-4f69-9da9-b85a212d72aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ce171df9-6cc1-42a2-b1a2-8722276abf63 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3630afe-5b28-421d-ba29-7fd1f14fe80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:06 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-ce171df9-6cc1-42a2-b1a2-8722276abf63 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Volume 60c4b76e-d21c-4f7a-876c-64279b0db919: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60c4b76e-d21c-4f7a-876c-64279b0db919', 'volume_size': 1} Nov 03 20:36:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ce171df9-6cc1-42a2-b1a2-8722276abf63 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:07 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75eb96b2-6330-4c39-93d8-0aea1d09fc6d tempest-CreateVolumesFromSnapshotTest-2105386654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f9a37a79-94cb-4f48-a2b9-59ddf477ae10 1073741824" returned: 0 in 0.511s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75eb96b2-6330-4c39-93d8-0aea1d09fc6d tempest-CreateVolumesFromSnapshotTest-2105386654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f9a37a79-94cb-4f48-a2b9-59ddf477ae10 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:07 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f9a37a79-94cb-4f48-a2b9-59ddf477ae10 Nov 03 20:36:07 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9476d26-620a-47c3-befb-3ec8603940af tempest-CreateVolumesFromSnapshotTest-2105386654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c9476d26-620a-47c3-befb-3ec8603940af tempest-CreateVolumesFromSnapshotTest-2105386654 None] Flow 'volume_create_manager' (33263f65-530f-4641-8924-da7eda8c545c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c9476d26-620a-47c3-befb-3ec8603940af tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (503901c4-ffcc-4c38-b4d6-2a3d96695a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c9476d26-620a-47c3-befb-3ec8603940af tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (503901c4-ffcc-4c38-b4d6-2a3d96695a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-770779647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c411059-ed9d-4a62-8b1b-deee4b9cffed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1553e264c27d41a1a9e3105ec7814327',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:36:07Z,use_quota=True,user_id='62930be2914a43a88e455dcbe973410e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c9476d26-620a-47c3-befb-3ec8603940af tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3d21566-1b07-47f0-ad80-6360680e463a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c9476d26-620a-47c3-befb-3ec8603940af tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3d21566-1b07-47f0-ad80-6360680e463a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c9476d26-620a-47c3-befb-3ec8603940af tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32a6656e-23a5-4512-b45c-920790efa903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c9476d26-620a-47c3-befb-3ec8603940af tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32a6656e-23a5-4512-b45c-920790efa903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c411059-ed9d-4a62-8b1b-deee4b9cffed', 'volume_name': 'volume-7c411059-ed9d-4a62-8b1b-deee4b9cffed', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c9476d26-620a-47c3-befb-3ec8603940af tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ff3d262-37ff-49fc-b83d-ac9e51bcf4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c9476d26-620a-47c3-befb-3ec8603940af tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ff3d262-37ff-49fc-b83d-ac9e51bcf4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c9476d26-620a-47c3-befb-3ec8603940af tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bb783a6-f3db-4af1-b1ca-695a11655093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:07 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-c9476d26-620a-47c3-befb-3ec8603940af tempest-CreateVolumesFromSnapshotTest-2105386654 None] Volume 7c411059-ed9d-4a62-8b1b-deee4b9cffed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c411059-ed9d-4a62-8b1b-deee4b9cffed', 'volume_size': 1} Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c9476d26-620a-47c3-befb-3ec8603940af tempest-CreateVolumesFromSnapshotTest-2105386654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:07 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75eb96b2-6330-4c39-93d8-0aea1d09fc6d tempest-CreateVolumesFromSnapshotTest-2105386654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f9a37a79-94cb-4f48-a2b9-59ddf477ae10" returned: 0 in 0.271s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75eb96b2-6330-4c39-93d8-0aea1d09fc6d tempest-CreateVolumesFromSnapshotTest-2105386654 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75eb96b2-6330-4c39-93d8-0aea1d09fc6d tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ce171df9-6cc1-42a2-b1a2-8722276abf63 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.460s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-ce171df9-6cc1-42a2-b1a2-8722276abf63 tempest-CreateVolumesFromSnapshotTest-2105386654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1306954647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60c4b76e-d21c-4f7a-876c-64279b0db919,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1553e264c27d41a1a9e3105ec7814327',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:36:07Z,use_quota=True,user_id='62930be2914a43a88e455dcbe973410e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-ce171df9-6cc1-42a2-b1a2-8722276abf63 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Creating volume 60c4b76e-d21c-4f7a-876c-64279b0db919 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ce171df9-6cc1-42a2-b1a2-8722276abf63 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ce171df9-6cc1-42a2-b1a2-8722276abf63 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-ce171df9-6cc1-42a2-b1a2-8722276abf63 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-ce171df9-6cc1-42a2-b1a2-8722276abf63 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ce171df9-6cc1-42a2-b1a2-8722276abf63 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-ce171df9-6cc1-42a2-b1a2-8722276abf63 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:36:07 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-ce171df9-6cc1-42a2-b1a2-8722276abf63 tempest-CreateVolumesFromSnapshotTest-2105386654 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ce171df9-6cc1-42a2-b1a2-8722276abf63 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-60c4b76e-d21c-4f7a-876c-64279b0db919 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75eb96b2-6330-4c39-93d8-0aea1d09fc6d tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f40497e0-b5a2-45e8-af72-27ceb345d1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9a37a79-94cb-4f48-a2b9-59ddf477ae10', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:07 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-60c4b76e-d21c-4f7a-876c-64279b0db919 1073741824 Nov 03 20:36:07 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75eb96b2-6330-4c39-93d8-0aea1d09fc6d tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8855d892-05d0-4753-b299-9b37916f0a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:07 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-75eb96b2-6330-4c39-93d8-0aea1d09fc6d tempest-CreateVolumesFromSnapshotTest-2105386654 None] Volume volume-f9a37a79-94cb-4f48-a2b9-59ddf477ae10 (f9a37a79-94cb-4f48-a2b9-59ddf477ae10): created successfully Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75eb96b2-6330-4c39-93d8-0aea1d09fc6d tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8855d892-05d0-4753-b299-9b37916f0a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75eb96b2-6330-4c39-93d8-0aea1d09fc6d tempest-CreateVolumesFromSnapshotTest-2105386654 None] Flow 'volume_create_manager' (f9057ead-eac8-4543-a87c-11ef40ebca48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:36:07 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-75eb96b2-6330-4c39-93d8-0aea1d09fc6d tempest-CreateVolumesFromSnapshotTest-2105386654 None] Created volume successfully. Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3295736-f4ef-4263-9ce0-92e36073f3c8 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d3295736-f4ef-4263-9ce0-92e36073f3c8 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Flow 'volume_create_manager' (fb226d43-226a-41fd-935c-4624e71e28bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d3295736-f4ef-4263-9ce0-92e36073f3c8 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70899b82-7513-414a-a22f-c22e31120a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d3295736-f4ef-4263-9ce0-92e36073f3c8 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70899b82-7513-414a-a22f-c22e31120a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1952219421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=697f3103-4449-4d9e-b8ea-81278c2c1cab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1553e264c27d41a1a9e3105ec7814327',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:36:07Z,use_quota=True,user_id='62930be2914a43a88e455dcbe973410e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d3295736-f4ef-4263-9ce0-92e36073f3c8 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32d72b0a-bda4-412c-bce2-6b7420b42d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d3295736-f4ef-4263-9ce0-92e36073f3c8 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32d72b0a-bda4-412c-bce2-6b7420b42d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d3295736-f4ef-4263-9ce0-92e36073f3c8 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a743b6d6-60d4-449f-ba0b-98f4d5fd1d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d3295736-f4ef-4263-9ce0-92e36073f3c8 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a743b6d6-60d4-449f-ba0b-98f4d5fd1d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '697f3103-4449-4d9e-b8ea-81278c2c1cab', 'volume_name': 'volume-697f3103-4449-4d9e-b8ea-81278c2c1cab', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d3295736-f4ef-4263-9ce0-92e36073f3c8 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9566e083-8251-483f-904a-a82879b451c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d3295736-f4ef-4263-9ce0-92e36073f3c8 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9566e083-8251-483f-904a-a82879b451c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d3295736-f4ef-4263-9ce0-92e36073f3c8 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (881e0186-f050-4f6f-9c24-89dc0e58e3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:07 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-d3295736-f4ef-4263-9ce0-92e36073f3c8 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Volume 697f3103-4449-4d9e-b8ea-81278c2c1cab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-697f3103-4449-4d9e-b8ea-81278c2c1cab', 'volume_size': 1} Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d3295736-f4ef-4263-9ce0-92e36073f3c8 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:07 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ce171df9-6cc1-42a2-b1a2-8722276abf63 tempest-CreateVolumesFromSnapshotTest-2105386654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-60c4b76e-d21c-4f7a-876c-64279b0db919 1073741824" returned: 0 in 0.481s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ce171df9-6cc1-42a2-b1a2-8722276abf63 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-60c4b76e-d21c-4f7a-876c-64279b0db919 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:07 devstack sudo[105947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-60c4b76e-d21c-4f7a-876c-64279b0db919 Nov 03 20:36:07 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-f476ef9d-76c2-4a87-90ea-53676c93ced2 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f476ef9d-76c2-4a87-90ea-53676c93ced2 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Flow 'volume_create_manager' (e6312692-0495-42df-94aa-30fdf46c6276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f476ef9d-76c2-4a87-90ea-53676c93ced2 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f5c9f03-75e2-4213-a580-403f2dcf66ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f476ef9d-76c2-4a87-90ea-53676c93ced2 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f5c9f03-75e2-4213-a580-403f2dcf66ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-865844318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ba25022-bc35-4caf-9703-5fd383648ebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1553e264c27d41a1a9e3105ec7814327',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:36:08Z,use_quota=True,user_id='62930be2914a43a88e455dcbe973410e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f476ef9d-76c2-4a87-90ea-53676c93ced2 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab2c3d5e-5abe-442d-8e33-834c5b0e9766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f476ef9d-76c2-4a87-90ea-53676c93ced2 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab2c3d5e-5abe-442d-8e33-834c5b0e9766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:07 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f476ef9d-76c2-4a87-90ea-53676c93ced2 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (241ae189-54db-48ad-9f87-8af20451f6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:08 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f476ef9d-76c2-4a87-90ea-53676c93ced2 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (241ae189-54db-48ad-9f87-8af20451f6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ba25022-bc35-4caf-9703-5fd383648ebf', 'volume_name': 'volume-5ba25022-bc35-4caf-9703-5fd383648ebf', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:08 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f476ef9d-76c2-4a87-90ea-53676c93ced2 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d7d9bc5-7052-498e-b59f-ba154e0a79d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:08 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f476ef9d-76c2-4a87-90ea-53676c93ced2 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d7d9bc5-7052-498e-b59f-ba154e0a79d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:08 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f476ef9d-76c2-4a87-90ea-53676c93ced2 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ab61782-0d65-4fef-a803-b3aefd8126d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:08 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-f476ef9d-76c2-4a87-90ea-53676c93ced2 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Volume 5ba25022-bc35-4caf-9703-5fd383648ebf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ba25022-bc35-4caf-9703-5fd383648ebf', 'volume_size': 1} Nov 03 20:36:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f476ef9d-76c2-4a87-90ea-53676c93ced2 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:08 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ce171df9-6cc1-42a2-b1a2-8722276abf63 tempest-CreateVolumesFromSnapshotTest-2105386654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-60c4b76e-d21c-4f7a-876c-64279b0db919" returned: 0 in 0.245s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:08 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-ce171df9-6cc1-42a2-b1a2-8722276abf63 tempest-CreateVolumesFromSnapshotTest-2105386654 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:36:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ce171df9-6cc1-42a2-b1a2-8722276abf63 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c9476d26-620a-47c3-befb-3ec8603940af tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.837s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:08 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c9476d26-620a-47c3-befb-3ec8603940af tempest-CreateVolumesFromSnapshotTest-2105386654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-770779647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c411059-ed9d-4a62-8b1b-deee4b9cffed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1553e264c27d41a1a9e3105ec7814327',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:36:07Z,use_quota=True,user_id='62930be2914a43a88e455dcbe973410e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:36:08 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-c9476d26-620a-47c3-befb-3ec8603940af tempest-CreateVolumesFromSnapshotTest-2105386654 None] Creating volume 7c411059-ed9d-4a62-8b1b-deee4b9cffed {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:36:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c9476d26-620a-47c3-befb-3ec8603940af tempest-CreateVolumesFromSnapshotTest-2105386654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c9476d26-620a-47c3-befb-3ec8603940af tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:08 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c9476d26-620a-47c3-befb-3ec8603940af tempest-CreateVolumesFromSnapshotTest-2105386654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:36:08 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c9476d26-620a-47c3-befb-3ec8603940af tempest-CreateVolumesFromSnapshotTest-2105386654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:36:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c9476d26-620a-47c3-befb-3ec8603940af tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:08 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c9476d26-620a-47c3-befb-3ec8603940af tempest-CreateVolumesFromSnapshotTest-2105386654 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:36:08 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-c9476d26-620a-47c3-befb-3ec8603940af tempest-CreateVolumesFromSnapshotTest-2105386654 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:36:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c9476d26-620a-47c3-befb-3ec8603940af tempest-CreateVolumesFromSnapshotTest-2105386654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c411059-ed9d-4a62-8b1b-deee4b9cffed 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:08 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ce171df9-6cc1-42a2-b1a2-8722276abf63 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3630afe-5b28-421d-ba29-7fd1f14fe80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60c4b76e-d21c-4f7a-876c-64279b0db919', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:08 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c411059-ed9d-4a62-8b1b-deee4b9cffed 1073741824 Nov 03 20:36:08 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:08 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ce171df9-6cc1-42a2-b1a2-8722276abf63 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaed83a2-7e9b-449f-aeb4-bce5b6a32734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:08 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-ce171df9-6cc1-42a2-b1a2-8722276abf63 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Volume volume-60c4b76e-d21c-4f7a-876c-64279b0db919 (60c4b76e-d21c-4f7a-876c-64279b0db919): created successfully Nov 03 20:36:08 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ce171df9-6cc1-42a2-b1a2-8722276abf63 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaed83a2-7e9b-449f-aeb4-bce5b6a32734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:08 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ce171df9-6cc1-42a2-b1a2-8722276abf63 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Flow 'volume_create_manager' (ad730181-2dce-425c-a7ba-72abd8be2a27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:36:08 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-ce171df9-6cc1-42a2-b1a2-8722276abf63 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Created volume successfully. Nov 03 20:36:08 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c9476d26-620a-47c3-befb-3ec8603940af tempest-CreateVolumesFromSnapshotTest-2105386654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c411059-ed9d-4a62-8b1b-deee4b9cffed 1073741824" returned: 0 in 0.401s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c9476d26-620a-47c3-befb-3ec8603940af tempest-CreateVolumesFromSnapshotTest-2105386654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c411059-ed9d-4a62-8b1b-deee4b9cffed {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:08 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c411059-ed9d-4a62-8b1b-deee4b9cffed Nov 03 20:36:08 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:08 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c9476d26-620a-47c3-befb-3ec8603940af tempest-CreateVolumesFromSnapshotTest-2105386654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c411059-ed9d-4a62-8b1b-deee4b9cffed" returned: 0 in 0.238s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:08 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c9476d26-620a-47c3-befb-3ec8603940af tempest-CreateVolumesFromSnapshotTest-2105386654 None] <== create_volume: return (675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:36:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c9476d26-620a-47c3-befb-3ec8603940af tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d3295736-f4ef-4263-9ce0-92e36073f3c8 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.163s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:08 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-d3295736-f4ef-4263-9ce0-92e36073f3c8 tempest-CreateVolumesFromSnapshotTest-2105386654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1952219421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=697f3103-4449-4d9e-b8ea-81278c2c1cab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1553e264c27d41a1a9e3105ec7814327',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:36:07Z,use_quota=True,user_id='62930be2914a43a88e455dcbe973410e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:36:08 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-d3295736-f4ef-4263-9ce0-92e36073f3c8 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Creating volume 697f3103-4449-4d9e-b8ea-81278c2c1cab {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:36:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d3295736-f4ef-4263-9ce0-92e36073f3c8 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d3295736-f4ef-4263-9ce0-92e36073f3c8 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:08 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-d3295736-f4ef-4263-9ce0-92e36073f3c8 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:36:08 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-d3295736-f4ef-4263-9ce0-92e36073f3c8 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:36:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d3295736-f4ef-4263-9ce0-92e36073f3c8 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:08 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-d3295736-f4ef-4263-9ce0-92e36073f3c8 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:36:08 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-d3295736-f4ef-4263-9ce0-92e36073f3c8 tempest-CreateVolumesFromSnapshotTest-2105386654 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:36:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d3295736-f4ef-4263-9ce0-92e36073f3c8 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-697f3103-4449-4d9e-b8ea-81278c2c1cab 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:08 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c9476d26-620a-47c3-befb-3ec8603940af tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bb783a6-f3db-4af1-b1ca-695a11655093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c411059-ed9d-4a62-8b1b-deee4b9cffed', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:08 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c9476d26-620a-47c3-befb-3ec8603940af tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e699569c-5c64-486e-a3be-c401f3d5d93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:08 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-697f3103-4449-4d9e-b8ea-81278c2c1cab 1073741824 Nov 03 20:36:08 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:08 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-c9476d26-620a-47c3-befb-3ec8603940af tempest-CreateVolumesFromSnapshotTest-2105386654 None] Volume volume-7c411059-ed9d-4a62-8b1b-deee4b9cffed (7c411059-ed9d-4a62-8b1b-deee4b9cffed): created successfully Nov 03 20:36:08 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c9476d26-620a-47c3-befb-3ec8603940af tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e699569c-5c64-486e-a3be-c401f3d5d93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:08 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c9476d26-620a-47c3-befb-3ec8603940af tempest-CreateVolumesFromSnapshotTest-2105386654 None] Flow 'volume_create_manager' (33263f65-530f-4641-8924-da7eda8c545c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:36:08 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-c9476d26-620a-47c3-befb-3ec8603940af tempest-CreateVolumesFromSnapshotTest-2105386654 None] Created volume successfully. Nov 03 20:36:09 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d3295736-f4ef-4263-9ce0-92e36073f3c8 tempest-CreateVolumesFromSnapshotTest-2105386654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-697f3103-4449-4d9e-b8ea-81278c2c1cab 1073741824" returned: 0 in 0.404s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d3295736-f4ef-4263-9ce0-92e36073f3c8 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-697f3103-4449-4d9e-b8ea-81278c2c1cab {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:09 devstack sudo[105965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-697f3103-4449-4d9e-b8ea-81278c2c1cab Nov 03 20:36:09 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:09 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d3295736-f4ef-4263-9ce0-92e36073f3c8 tempest-CreateVolumesFromSnapshotTest-2105386654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-697f3103-4449-4d9e-b8ea-81278c2c1cab" returned: 0 in 0.244s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:09 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-d3295736-f4ef-4263-9ce0-92e36073f3c8 tempest-CreateVolumesFromSnapshotTest-2105386654 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:36:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d3295736-f4ef-4263-9ce0-92e36073f3c8 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f476ef9d-76c2-4a87-90ea-53676c93ced2 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.480s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:09 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-f476ef9d-76c2-4a87-90ea-53676c93ced2 tempest-CreateVolumesFromSnapshotTest-2105386654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-865844318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ba25022-bc35-4caf-9703-5fd383648ebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1553e264c27d41a1a9e3105ec7814327',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:36:08Z,use_quota=True,user_id='62930be2914a43a88e455dcbe973410e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:36:09 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-f476ef9d-76c2-4a87-90ea-53676c93ced2 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Creating volume 5ba25022-bc35-4caf-9703-5fd383648ebf {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:36:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f476ef9d-76c2-4a87-90ea-53676c93ced2 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f476ef9d-76c2-4a87-90ea-53676c93ced2 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:09 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-f476ef9d-76c2-4a87-90ea-53676c93ced2 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:36:09 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-f476ef9d-76c2-4a87-90ea-53676c93ced2 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:36:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f476ef9d-76c2-4a87-90ea-53676c93ced2 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:09 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-f476ef9d-76c2-4a87-90ea-53676c93ced2 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:36:09 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-f476ef9d-76c2-4a87-90ea-53676c93ced2 tempest-CreateVolumesFromSnapshotTest-2105386654 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:36:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f476ef9d-76c2-4a87-90ea-53676c93ced2 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5ba25022-bc35-4caf-9703-5fd383648ebf 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:09 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5ba25022-bc35-4caf-9703-5fd383648ebf 1073741824 Nov 03 20:36:09 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:09 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d3295736-f4ef-4263-9ce0-92e36073f3c8 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (881e0186-f050-4f6f-9c24-89dc0e58e3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-697f3103-4449-4d9e-b8ea-81278c2c1cab', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:09 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d3295736-f4ef-4263-9ce0-92e36073f3c8 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e0b1fb2-fad3-4187-a81f-82543ab0642d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:09 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-d3295736-f4ef-4263-9ce0-92e36073f3c8 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Volume volume-697f3103-4449-4d9e-b8ea-81278c2c1cab (697f3103-4449-4d9e-b8ea-81278c2c1cab): created successfully Nov 03 20:36:09 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d3295736-f4ef-4263-9ce0-92e36073f3c8 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e0b1fb2-fad3-4187-a81f-82543ab0642d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:09 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-d3295736-f4ef-4263-9ce0-92e36073f3c8 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Flow 'volume_create_manager' (fb226d43-226a-41fd-935c-4624e71e28bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:36:09 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-d3295736-f4ef-4263-9ce0-92e36073f3c8 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Created volume successfully. Nov 03 20:36:09 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f476ef9d-76c2-4a87-90ea-53676c93ced2 tempest-CreateVolumesFromSnapshotTest-2105386654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5ba25022-bc35-4caf-9703-5fd383648ebf 1073741824" returned: 0 in 0.399s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f476ef9d-76c2-4a87-90ea-53676c93ced2 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5ba25022-bc35-4caf-9703-5fd383648ebf {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:09 devstack sudo[105973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5ba25022-bc35-4caf-9703-5fd383648ebf Nov 03 20:36:09 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:10 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f476ef9d-76c2-4a87-90ea-53676c93ced2 tempest-CreateVolumesFromSnapshotTest-2105386654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5ba25022-bc35-4caf-9703-5fd383648ebf" returned: 0 in 0.238s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:10 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-f476ef9d-76c2-4a87-90ea-53676c93ced2 tempest-CreateVolumesFromSnapshotTest-2105386654 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:36:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f476ef9d-76c2-4a87-90ea-53676c93ced2 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:10 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f476ef9d-76c2-4a87-90ea-53676c93ced2 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ab61782-0d65-4fef-a803-b3aefd8126d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ba25022-bc35-4caf-9703-5fd383648ebf', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:10 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f476ef9d-76c2-4a87-90ea-53676c93ced2 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46684fe9-9686-4022-915e-710c50983463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:10 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-f476ef9d-76c2-4a87-90ea-53676c93ced2 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Volume volume-5ba25022-bc35-4caf-9703-5fd383648ebf (5ba25022-bc35-4caf-9703-5fd383648ebf): created successfully Nov 03 20:36:10 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f476ef9d-76c2-4a87-90ea-53676c93ced2 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46684fe9-9686-4022-915e-710c50983463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:10 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f476ef9d-76c2-4a87-90ea-53676c93ced2 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Flow 'volume_create_manager' (e6312692-0495-42df-94aa-30fdf46c6276) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:36:10 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-f476ef9d-76c2-4a87-90ea-53676c93ced2 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Created volume successfully. Nov 03 20:36:11 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-37243288-0969-418d-aba0-f9f8cf96708b tempest-CreateVolumesFromSnapshotTest-2105386654 None] Acquiring lock "cinder-5ba25022-bc35-4caf-9703-5fd383648ebf-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:36:11 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-37243288-0969-418d-aba0-f9f8cf96708b tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "cinder-5ba25022-bc35-4caf-9703-5fd383648ebf-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:36:11 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-37243288-0969-418d-aba0-f9f8cf96708b tempest-CreateVolumesFromSnapshotTest-2105386654 None] Acquiring lock "cinder-quobyte-5ba25022-bc35-4caf-9703-5fd383648ebf" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:36:11 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-37243288-0969-418d-aba0-f9f8cf96708b tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "cinder-quobyte-5ba25022-bc35-4caf-9703-5fd383648ebf" acquired by "delete_volume" :: waited 0.014s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:36:11 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[000b7b5d-8529-411e-b2b9-fbbebefeb9a6]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:36:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-37243288-0969-418d-aba0-f9f8cf96708b tempest-CreateVolumesFromSnapshotTest-2105386654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5ba25022-bc35-4caf-9703-5fd383648ebf {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:11 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5ba25022-bc35-4caf-9703-5fd383648ebf Nov 03 20:36:11 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:11 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-37243288-0969-418d-aba0-f9f8cf96708b tempest-CreateVolumesFromSnapshotTest-2105386654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5ba25022-bc35-4caf-9703-5fd383648ebf" returned: 0 in 0.346s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-37243288-0969-418d-aba0-f9f8cf96708b tempest-CreateVolumesFromSnapshotTest-2105386654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5ba25022-bc35-4caf-9703-5fd383648ebf {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:11 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5ba25022-bc35-4caf-9703-5fd383648ebf Nov 03 20:36:11 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:11 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-37243288-0969-418d-aba0-f9f8cf96708b tempest-CreateVolumesFromSnapshotTest-2105386654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5ba25022-bc35-4caf-9703-5fd383648ebf" returned: 0 in 0.234s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:11 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-37243288-0969-418d-aba0-f9f8cf96708b tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "cinder-quobyte-5ba25022-bc35-4caf-9703-5fd383648ebf" released by "delete_volume" :: held 0.621s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:36:12 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-37243288-0969-418d-aba0-f9f8cf96708b tempest-CreateVolumesFromSnapshotTest-2105386654 None] Created reservations ['d0704b23-aeff-438b-af7e-3a7bc429b385', '8e348e5a-5f9f-4908-b32a-b71818f3b9af', '768d71a8-d253-44cf-ac31-7726dc0ea981', '1bb4825f-acad-421c-9e2e-04b30d6ff9dc'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:36:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-37243288-0969-418d-aba0-f9f8cf96708b tempest-CreateVolumesFromSnapshotTest-2105386654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-37243288-0969-418d-aba0-f9f8cf96708b tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:12 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-37243288-0969-418d-aba0-f9f8cf96708b tempest-CreateVolumesFromSnapshotTest-2105386654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:36:12 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-37243288-0969-418d-aba0-f9f8cf96708b tempest-CreateVolumesFromSnapshotTest-2105386654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:36:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-37243288-0969-418d-aba0-f9f8cf96708b tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-37243288-0969-418d-aba0-f9f8cf96708b tempest-CreateVolumesFromSnapshotTest-2105386654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:12 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:36:12 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:12 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-37243288-0969-418d-aba0-f9f8cf96708b tempest-CreateVolumesFromSnapshotTest-2105386654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.241s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:12 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-37243288-0969-418d-aba0-f9f8cf96708b tempest-CreateVolumesFromSnapshotTest-2105386654 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:36:12 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-37243288-0969-418d-aba0-f9f8cf96708b tempest-CreateVolumesFromSnapshotTest-2105386654 None] Deleted volume successfully. Nov 03 20:36:12 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-37243288-0969-418d-aba0-f9f8cf96708b tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "cinder-5ba25022-bc35-4caf-9703-5fd383648ebf-delete_volume" released by "delete_volume" :: held 1.053s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:36:12 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c847ea49-10d2-4b63-b5ff-c201a53d91af tempest-CreateVolumesFromSnapshotTest-2105386654 None] Acquiring lock "cinder-697f3103-4449-4d9e-b8ea-81278c2c1cab-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:36:12 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c847ea49-10d2-4b63-b5ff-c201a53d91af tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "cinder-697f3103-4449-4d9e-b8ea-81278c2c1cab-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:36:12 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c847ea49-10d2-4b63-b5ff-c201a53d91af tempest-CreateVolumesFromSnapshotTest-2105386654 None] Acquiring lock "cinder-quobyte-697f3103-4449-4d9e-b8ea-81278c2c1cab" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:36:12 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c847ea49-10d2-4b63-b5ff-c201a53d91af tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "cinder-quobyte-697f3103-4449-4d9e-b8ea-81278c2c1cab" acquired by "delete_volume" :: waited 0.019s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:36:12 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3ac76d-37d9-47a7-bb12-8d5d0f5ac60a]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:36:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c847ea49-10d2-4b63-b5ff-c201a53d91af tempest-CreateVolumesFromSnapshotTest-2105386654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-697f3103-4449-4d9e-b8ea-81278c2c1cab {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:12 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-697f3103-4449-4d9e-b8ea-81278c2c1cab Nov 03 20:36:12 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:12 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c847ea49-10d2-4b63-b5ff-c201a53d91af tempest-CreateVolumesFromSnapshotTest-2105386654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-697f3103-4449-4d9e-b8ea-81278c2c1cab" returned: 0 in 0.358s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c847ea49-10d2-4b63-b5ff-c201a53d91af tempest-CreateVolumesFromSnapshotTest-2105386654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-697f3103-4449-4d9e-b8ea-81278c2c1cab {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:12 devstack sudo[106030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-697f3103-4449-4d9e-b8ea-81278c2c1cab Nov 03 20:36:12 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:13 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c847ea49-10d2-4b63-b5ff-c201a53d91af tempest-CreateVolumesFromSnapshotTest-2105386654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-697f3103-4449-4d9e-b8ea-81278c2c1cab" returned: 0 in 0.245s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:13 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c847ea49-10d2-4b63-b5ff-c201a53d91af tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "cinder-quobyte-697f3103-4449-4d9e-b8ea-81278c2c1cab" released by "delete_volume" :: held 0.654s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:36:13 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-c847ea49-10d2-4b63-b5ff-c201a53d91af tempest-CreateVolumesFromSnapshotTest-2105386654 None] Created reservations ['050e1b17-d20d-4c9b-b32e-d28cf031b167', '290e9328-2720-45e5-9aac-72e463c7f5c4', '5edf2c87-83dd-43cc-a598-3c02b0c5c574', 'c8ae8c32-3a04-452f-bb45-3cc7b13e79fe'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:36:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c847ea49-10d2-4b63-b5ff-c201a53d91af tempest-CreateVolumesFromSnapshotTest-2105386654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c847ea49-10d2-4b63-b5ff-c201a53d91af tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:13 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c847ea49-10d2-4b63-b5ff-c201a53d91af tempest-CreateVolumesFromSnapshotTest-2105386654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:36:13 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c847ea49-10d2-4b63-b5ff-c201a53d91af tempest-CreateVolumesFromSnapshotTest-2105386654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:36:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c847ea49-10d2-4b63-b5ff-c201a53d91af tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c847ea49-10d2-4b63-b5ff-c201a53d91af tempest-CreateVolumesFromSnapshotTest-2105386654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:13 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:36:13 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:13 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c847ea49-10d2-4b63-b5ff-c201a53d91af tempest-CreateVolumesFromSnapshotTest-2105386654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.245s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:13 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-c847ea49-10d2-4b63-b5ff-c201a53d91af tempest-CreateVolumesFromSnapshotTest-2105386654 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:36:13 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-c847ea49-10d2-4b63-b5ff-c201a53d91af tempest-CreateVolumesFromSnapshotTest-2105386654 None] Deleted volume successfully. Nov 03 20:36:13 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c847ea49-10d2-4b63-b5ff-c201a53d91af tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "cinder-697f3103-4449-4d9e-b8ea-81278c2c1cab-delete_volume" released by "delete_volume" :: held 1.100s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:36:13 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7acfff5b-a6e8-40de-8d15-91383d642e39 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Acquiring lock "cinder-7c411059-ed9d-4a62-8b1b-deee4b9cffed-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:36:13 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7acfff5b-a6e8-40de-8d15-91383d642e39 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "cinder-7c411059-ed9d-4a62-8b1b-deee4b9cffed-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:36:13 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7acfff5b-a6e8-40de-8d15-91383d642e39 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Acquiring lock "cinder-quobyte-7c411059-ed9d-4a62-8b1b-deee4b9cffed" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:36:13 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7acfff5b-a6e8-40de-8d15-91383d642e39 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "cinder-quobyte-7c411059-ed9d-4a62-8b1b-deee4b9cffed" acquired by "delete_volume" :: waited 0.015s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:36:13 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9832a2-e37f-4ee5-acc7-71b0c962ad31]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:36:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7acfff5b-a6e8-40de-8d15-91383d642e39 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c411059-ed9d-4a62-8b1b-deee4b9cffed {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:13 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c411059-ed9d-4a62-8b1b-deee4b9cffed Nov 03 20:36:13 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:14 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7acfff5b-a6e8-40de-8d15-91383d642e39 tempest-CreateVolumesFromSnapshotTest-2105386654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c411059-ed9d-4a62-8b1b-deee4b9cffed" returned: 0 in 0.351s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7acfff5b-a6e8-40de-8d15-91383d642e39 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c411059-ed9d-4a62-8b1b-deee4b9cffed {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:14 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c411059-ed9d-4a62-8b1b-deee4b9cffed Nov 03 20:36:14 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:14 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7acfff5b-a6e8-40de-8d15-91383d642e39 tempest-CreateVolumesFromSnapshotTest-2105386654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c411059-ed9d-4a62-8b1b-deee4b9cffed" returned: 0 in 0.235s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:14 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7acfff5b-a6e8-40de-8d15-91383d642e39 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "cinder-quobyte-7c411059-ed9d-4a62-8b1b-deee4b9cffed" released by "delete_volume" :: held 0.625s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:36:14 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-7acfff5b-a6e8-40de-8d15-91383d642e39 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Created reservations ['4847db2e-fc97-48ce-be40-ddfdd38ba5ae', 'aee4156d-94f3-4e1a-ad97-823c1ea7e700', '519f0eed-3f63-4350-b6de-7e81ca07f7c1', '54368b88-364e-495f-8559-685eb89ff70b'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:36:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7acfff5b-a6e8-40de-8d15-91383d642e39 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7acfff5b-a6e8-40de-8d15-91383d642e39 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:14 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-7acfff5b-a6e8-40de-8d15-91383d642e39 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:36:14 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-7acfff5b-a6e8-40de-8d15-91383d642e39 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:36:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7acfff5b-a6e8-40de-8d15-91383d642e39 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7acfff5b-a6e8-40de-8d15-91383d642e39 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:14 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:36:14 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:14 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7acfff5b-a6e8-40de-8d15-91383d642e39 tempest-CreateVolumesFromSnapshotTest-2105386654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.239s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:14 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-7acfff5b-a6e8-40de-8d15-91383d642e39 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:36:14 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-7acfff5b-a6e8-40de-8d15-91383d642e39 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Deleted volume successfully. Nov 03 20:36:14 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7acfff5b-a6e8-40de-8d15-91383d642e39 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "cinder-7c411059-ed9d-4a62-8b1b-deee4b9cffed-delete_volume" released by "delete_volume" :: held 1.050s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:36:14 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-45235554-e715-44d0-97eb-3dbcf5301b18 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Acquiring lock "cinder-60c4b76e-d21c-4f7a-876c-64279b0db919-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:36:14 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-45235554-e715-44d0-97eb-3dbcf5301b18 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "cinder-60c4b76e-d21c-4f7a-876c-64279b0db919-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:36:14 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-45235554-e715-44d0-97eb-3dbcf5301b18 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Acquiring lock "cinder-quobyte-60c4b76e-d21c-4f7a-876c-64279b0db919" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:36:14 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-45235554-e715-44d0-97eb-3dbcf5301b18 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "cinder-quobyte-60c4b76e-d21c-4f7a-876c-64279b0db919" acquired by "delete_volume" :: waited 0.015s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:36:14 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[462c414a-1702-4765-ae2a-2d41e75ff860]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:36:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-45235554-e715-44d0-97eb-3dbcf5301b18 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-60c4b76e-d21c-4f7a-876c-64279b0db919 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:14 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-60c4b76e-d21c-4f7a-876c-64279b0db919 Nov 03 20:36:14 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:15 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-45235554-e715-44d0-97eb-3dbcf5301b18 tempest-CreateVolumesFromSnapshotTest-2105386654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-60c4b76e-d21c-4f7a-876c-64279b0db919" returned: 0 in 0.358s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-45235554-e715-44d0-97eb-3dbcf5301b18 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-60c4b76e-d21c-4f7a-876c-64279b0db919 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:15 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-60c4b76e-d21c-4f7a-876c-64279b0db919 Nov 03 20:36:15 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:15 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-45235554-e715-44d0-97eb-3dbcf5301b18 tempest-CreateVolumesFromSnapshotTest-2105386654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-60c4b76e-d21c-4f7a-876c-64279b0db919" returned: 0 in 0.238s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:15 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-45235554-e715-44d0-97eb-3dbcf5301b18 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "cinder-quobyte-60c4b76e-d21c-4f7a-876c-64279b0db919" released by "delete_volume" :: held 0.637s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:36:15 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-45235554-e715-44d0-97eb-3dbcf5301b18 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Created reservations ['70937f34-2e9a-4856-9b0c-43651f02a2ba', 'd1e3cabe-c2c5-424c-a619-7008403b0f07', 'f6022bbb-2177-4490-adec-59b8e2a8e33c', '44537fac-6a50-4f52-87e6-8a3376f01274'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:36:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-45235554-e715-44d0-97eb-3dbcf5301b18 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-45235554-e715-44d0-97eb-3dbcf5301b18 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:15 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-45235554-e715-44d0-97eb-3dbcf5301b18 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:36:15 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-45235554-e715-44d0-97eb-3dbcf5301b18 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:36:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-45235554-e715-44d0-97eb-3dbcf5301b18 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-45235554-e715-44d0-97eb-3dbcf5301b18 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:15 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:36:15 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:15 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-45235554-e715-44d0-97eb-3dbcf5301b18 tempest-CreateVolumesFromSnapshotTest-2105386654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.242s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:15 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-45235554-e715-44d0-97eb-3dbcf5301b18 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:36:15 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-45235554-e715-44d0-97eb-3dbcf5301b18 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Deleted volume successfully. Nov 03 20:36:15 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-45235554-e715-44d0-97eb-3dbcf5301b18 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "cinder-60c4b76e-d21c-4f7a-876c-64279b0db919-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:36:15 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6f9ebe18-587b-4a80-9387-83b72fed6aa0 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Acquiring lock "cinder-f9a37a79-94cb-4f48-a2b9-59ddf477ae10-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:36:15 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6f9ebe18-587b-4a80-9387-83b72fed6aa0 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "cinder-f9a37a79-94cb-4f48-a2b9-59ddf477ae10-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:36:15 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6f9ebe18-587b-4a80-9387-83b72fed6aa0 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Acquiring lock "cinder-quobyte-f9a37a79-94cb-4f48-a2b9-59ddf477ae10" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:36:16 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6f9ebe18-587b-4a80-9387-83b72fed6aa0 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "cinder-quobyte-f9a37a79-94cb-4f48-a2b9-59ddf477ae10" acquired by "delete_volume" :: waited 0.015s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:36:16 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae53de1-27f0-4351-b582-9b3d6d7b42f5]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:36:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6f9ebe18-587b-4a80-9387-83b72fed6aa0 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f9a37a79-94cb-4f48-a2b9-59ddf477ae10 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:16 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f9a37a79-94cb-4f48-a2b9-59ddf477ae10 Nov 03 20:36:16 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:16 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6f9ebe18-587b-4a80-9387-83b72fed6aa0 tempest-CreateVolumesFromSnapshotTest-2105386654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f9a37a79-94cb-4f48-a2b9-59ddf477ae10" returned: 0 in 0.361s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6f9ebe18-587b-4a80-9387-83b72fed6aa0 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f9a37a79-94cb-4f48-a2b9-59ddf477ae10 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:16 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f9a37a79-94cb-4f48-a2b9-59ddf477ae10 Nov 03 20:36:16 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:16 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6f9ebe18-587b-4a80-9387-83b72fed6aa0 tempest-CreateVolumesFromSnapshotTest-2105386654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f9a37a79-94cb-4f48-a2b9-59ddf477ae10" returned: 0 in 0.238s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:16 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6f9ebe18-587b-4a80-9387-83b72fed6aa0 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "cinder-quobyte-f9a37a79-94cb-4f48-a2b9-59ddf477ae10" released by "delete_volume" :: held 0.637s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:36:16 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-6f9ebe18-587b-4a80-9387-83b72fed6aa0 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Created reservations ['7f353623-494d-476f-ab6a-e1f5f605b59a', '7bbbd337-50da-4ef6-874c-0b87e0e8cab8', 'c9045a63-b45e-4c81-b1cc-40c66f20d87b', '52acb03b-8afd-4538-9f6e-8ad36317d4ec'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:36:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6f9ebe18-587b-4a80-9387-83b72fed6aa0 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6f9ebe18-587b-4a80-9387-83b72fed6aa0 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:16 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-6f9ebe18-587b-4a80-9387-83b72fed6aa0 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:36:16 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-6f9ebe18-587b-4a80-9387-83b72fed6aa0 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:36:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6f9ebe18-587b-4a80-9387-83b72fed6aa0 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6f9ebe18-587b-4a80-9387-83b72fed6aa0 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:16 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:36:16 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:16 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6f9ebe18-587b-4a80-9387-83b72fed6aa0 tempest-CreateVolumesFromSnapshotTest-2105386654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.236s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:16 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-6f9ebe18-587b-4a80-9387-83b72fed6aa0 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:36:16 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-6f9ebe18-587b-4a80-9387-83b72fed6aa0 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Deleted volume successfully. Nov 03 20:36:17 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6f9ebe18-587b-4a80-9387-83b72fed6aa0 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "cinder-f9a37a79-94cb-4f48-a2b9-59ddf477ae10-delete_volume" released by "delete_volume" :: held 1.053s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:36:17 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-98f377b1-eec9-4f32-b743-8fb00cede050 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Acquiring lock "cinder-ec4dc3f4-81a4-455b-a6aa-e444126bee71-delete_snapshot" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:36:17 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-98f377b1-eec9-4f32-b743-8fb00cede050 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "cinder-ec4dc3f4-81a4-455b-a6aa-e444126bee71-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:36:17 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-98f377b1-eec9-4f32-b743-8fb00cede050 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Acquiring lock "cinder-quobyte-00765bbe-afbd-461d-9777-3e884ea670b8" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:36:17 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-98f377b1-eec9-4f32-b743-8fb00cede050 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "cinder-quobyte-00765bbe-afbd-461d-9777-3e884ea670b8" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:36:17 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-98f377b1-eec9-4f32-b743-8fb00cede050 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Acquiring lock "cinder-quobyte-ec4dc3f4-81a4-455b-a6aa-e444126bee71" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:36:17 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-98f377b1-eec9-4f32-b743-8fb00cede050 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "cinder-quobyte-ec4dc3f4-81a4-455b-a6aa-e444126bee71" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:36:17 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-98f377b1-eec9-4f32-b743-8fb00cede050 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Deleting offline snapshot ec4dc3f4-81a4-455b-a6aa-e444126bee71 of volume 00765bbe-afbd-461d-9777-3e884ea670b8 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:36:17 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-98f377b1-eec9-4f32-b743-8fb00cede050 tempest-CreateVolumesFromSnapshotTest-2105386654 None] snapshot_file for this snap is: volume-00765bbe-afbd-461d-9777-3e884ea670b8.ec4dc3f4-81a4-455b-a6aa-e444126bee71 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:36:17 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1b88e9-397d-4aa9-a8ca-f605a3088caa]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:36:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-98f377b1-eec9-4f32-b743-8fb00cede050 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00765bbe-afbd-461d-9777-3e884ea670b8.ec4dc3f4-81a4-455b-a6aa-e444126bee71 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:17 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00765bbe-afbd-461d-9777-3e884ea670b8.ec4dc3f4-81a4-455b-a6aa-e444126bee71 Nov 03 20:36:17 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:17 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-98f377b1-eec9-4f32-b743-8fb00cede050 tempest-CreateVolumesFromSnapshotTest-2105386654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00765bbe-afbd-461d-9777-3e884ea670b8.ec4dc3f4-81a4-455b-a6aa-e444126bee71" returned: 0 in 0.349s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:17 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-98f377b1-eec9-4f32-b743-8fb00cede050 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00765bbe-afbd-461d-9777-3e884ea670b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:36:17 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e49825-2f68-4d5f-aa7b-9d4ff6e1e157]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:36:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-98f377b1-eec9-4f32-b743-8fb00cede050 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00765bbe-afbd-461d-9777-3e884ea670b8 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:17 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00765bbe-afbd-461d-9777-3e884ea670b8 Nov 03 20:36:17 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:17 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-98f377b1-eec9-4f32-b743-8fb00cede050 tempest-CreateVolumesFromSnapshotTest-2105386654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00765bbe-afbd-461d-9777-3e884ea670b8" returned: 0 in 0.353s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-98f377b1-eec9-4f32-b743-8fb00cede050 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00765bbe-afbd-461d-9777-3e884ea670b8.ec4dc3f4-81a4-455b-a6aa-e444126bee71 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:17 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00765bbe-afbd-461d-9777-3e884ea670b8.ec4dc3f4-81a4-455b-a6aa-e444126bee71 Nov 03 20:36:17 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:18 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-98f377b1-eec9-4f32-b743-8fb00cede050 tempest-CreateVolumesFromSnapshotTest-2105386654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00765bbe-afbd-461d-9777-3e884ea670b8.ec4dc3f4-81a4-455b-a6aa-e444126bee71" returned: 0 in 0.327s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-98f377b1-eec9-4f32-b743-8fb00cede050 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00765bbe-afbd-461d-9777-3e884ea670b8.ec4dc3f4-81a4-455b-a6aa-e444126bee71 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:18 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00765bbe-afbd-461d-9777-3e884ea670b8.ec4dc3f4-81a4-455b-a6aa-e444126bee71 Nov 03 20:36:18 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:18 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-98f377b1-eec9-4f32-b743-8fb00cede050 tempest-CreateVolumesFromSnapshotTest-2105386654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00765bbe-afbd-461d-9777-3e884ea670b8.ec4dc3f4-81a4-455b-a6aa-e444126bee71" returned: 0 in 0.238s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:18 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-98f377b1-eec9-4f32-b743-8fb00cede050 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "cinder-quobyte-ec4dc3f4-81a4-455b-a6aa-e444126bee71" released by "_delete_snapshot" :: held 1.375s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:36:18 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-98f377b1-eec9-4f32-b743-8fb00cede050 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "cinder-quobyte-00765bbe-afbd-461d-9777-3e884ea670b8" released by "delete_snapshot" :: held 1.394s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:36:18 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-98f377b1-eec9-4f32-b743-8fb00cede050 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Created reservations ['31703d0f-39d8-4c58-9f7d-b159198e57ad', '37e452a3-5bd6-45dc-9c7c-33a745cead9a', 'b32d08fc-f948-4c9b-83dc-7d09926246d7', 'a409be4e-a9f7-4138-ab52-42187a9f2be0'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:36:18 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-98f377b1-eec9-4f32-b743-8fb00cede050 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Delete snapshot completed successfully. Nov 03 20:36:18 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-98f377b1-eec9-4f32-b743-8fb00cede050 tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "cinder-ec4dc3f4-81a4-455b-a6aa-e444126bee71-delete_snapshot" released by "delete_snapshot" :: held 1.517s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:36:19 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1240db49-7dcb-48d4-8ccb-ebd48affb9ad tempest-CreateVolumesFromSnapshotTest-2105386654 None] Acquiring lock "cinder-00765bbe-afbd-461d-9777-3e884ea670b8-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:36:19 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1240db49-7dcb-48d4-8ccb-ebd48affb9ad tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "cinder-00765bbe-afbd-461d-9777-3e884ea670b8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:36:19 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1240db49-7dcb-48d4-8ccb-ebd48affb9ad tempest-CreateVolumesFromSnapshotTest-2105386654 None] Acquiring lock "cinder-quobyte-00765bbe-afbd-461d-9777-3e884ea670b8" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:36:19 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1240db49-7dcb-48d4-8ccb-ebd48affb9ad tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "cinder-quobyte-00765bbe-afbd-461d-9777-3e884ea670b8" acquired by "delete_volume" :: waited 0.014s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:36:19 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14796b9-bdff-48e4-a035-1f177ee200ae]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:36:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1240db49-7dcb-48d4-8ccb-ebd48affb9ad tempest-CreateVolumesFromSnapshotTest-2105386654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00765bbe-afbd-461d-9777-3e884ea670b8 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:19 devstack sudo[106090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00765bbe-afbd-461d-9777-3e884ea670b8 Nov 03 20:36:19 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:19 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1240db49-7dcb-48d4-8ccb-ebd48affb9ad tempest-CreateVolumesFromSnapshotTest-2105386654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00765bbe-afbd-461d-9777-3e884ea670b8" returned: 0 in 0.352s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1240db49-7dcb-48d4-8ccb-ebd48affb9ad tempest-CreateVolumesFromSnapshotTest-2105386654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00765bbe-afbd-461d-9777-3e884ea670b8 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:19 devstack sudo[106095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00765bbe-afbd-461d-9777-3e884ea670b8 Nov 03 20:36:19 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:19 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1240db49-7dcb-48d4-8ccb-ebd48affb9ad tempest-CreateVolumesFromSnapshotTest-2105386654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00765bbe-afbd-461d-9777-3e884ea670b8" returned: 0 in 0.239s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:19 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1240db49-7dcb-48d4-8ccb-ebd48affb9ad tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "cinder-quobyte-00765bbe-afbd-461d-9777-3e884ea670b8" released by "delete_volume" :: held 0.651s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:36:20 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-1240db49-7dcb-48d4-8ccb-ebd48affb9ad tempest-CreateVolumesFromSnapshotTest-2105386654 None] Created reservations ['1e65a653-2ef0-41aa-b2db-efd73a59debc', 'ea0d083c-948c-4214-8f7e-66d5e04123fd', 'b117f73e-fb81-43bb-b820-2b989cabd4b7', '63edca35-7393-445f-841a-9917da082ac7'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:36:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1240db49-7dcb-48d4-8ccb-ebd48affb9ad tempest-CreateVolumesFromSnapshotTest-2105386654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1240db49-7dcb-48d4-8ccb-ebd48affb9ad tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:20 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-1240db49-7dcb-48d4-8ccb-ebd48affb9ad tempest-CreateVolumesFromSnapshotTest-2105386654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:36:20 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-1240db49-7dcb-48d4-8ccb-ebd48affb9ad tempest-CreateVolumesFromSnapshotTest-2105386654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:36:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1240db49-7dcb-48d4-8ccb-ebd48affb9ad tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1240db49-7dcb-48d4-8ccb-ebd48affb9ad tempest-CreateVolumesFromSnapshotTest-2105386654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:20 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:36:20 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:20 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1240db49-7dcb-48d4-8ccb-ebd48affb9ad tempest-CreateVolumesFromSnapshotTest-2105386654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.241s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:20 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-1240db49-7dcb-48d4-8ccb-ebd48affb9ad tempest-CreateVolumesFromSnapshotTest-2105386654 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:36:20 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-1240db49-7dcb-48d4-8ccb-ebd48affb9ad tempest-CreateVolumesFromSnapshotTest-2105386654 None] Deleted volume successfully. Nov 03 20:36:20 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1240db49-7dcb-48d4-8ccb-ebd48affb9ad tempest-CreateVolumesFromSnapshotTest-2105386654 None] Lock "cinder-00765bbe-afbd-461d-9777-3e884ea670b8-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:36:28 devstack cinder-volume[87248]: DEBUG oslo_service.periodic_task [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:36:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:36:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:36:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:28 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:36:28 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:29 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.247s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:29 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:36:29 devstack cinder-volume[87248]: DEBUG oslo_service.periodic_task [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running periodic task VolumeManager._thread_info {{(pid=87248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:36:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] thread count: 28 {{(pid=87248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:36:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] thread info: [<_MainThread(MainThread, started 124862067372160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:36:30 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:SELECT=44,cinder:UPDATE=78,cinder:DELETE=7,cinder:INSERT=18 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:36:30 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:UPDATE=69,cinder:SELECT=59,cinder:INSERT=17,cinder:DELETE=6 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-afd18deb-cf21-4f67-81ee-d8eaf55c7c5b tempest-CreateVolumesFromImageTest-76365343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-afd18deb-cf21-4f67-81ee-d8eaf55c7c5b tempest-CreateVolumesFromImageTest-76365343 None] Flow 'volume_create_manager' (2ab090df-9460-4cf8-8ea9-5a8c51279036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-afd18deb-cf21-4f67-81ee-d8eaf55c7c5b tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d138d0d-6cc5-4b82-b266-4d35b1a3f79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-afd18deb-cf21-4f67-81ee-d8eaf55c7c5b tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d138d0d-6cc5-4b82-b266-4d35b1a3f79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:36:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1009800460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5c7f14c-d804-40ce-b852-32abbdd357ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb0632a6d03146b9af91c21c029dbca6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:36:37Z,use_quota=True,user_id='48c92edc4fac4cfe80d2ab2fad4c0af2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-afd18deb-cf21-4f67-81ee-d8eaf55c7c5b tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0dbb015-1ff5-451e-8bbd-45fda7cd5a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-afd18deb-cf21-4f67-81ee-d8eaf55c7c5b tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0dbb015-1ff5-451e-8bbd-45fda7cd5a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-afd18deb-cf21-4f67-81ee-d8eaf55c7c5b tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1836a273-fb41-4287-80a3-468176137af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-afd18deb-cf21-4f67-81ee-d8eaf55c7c5b tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1836a273-fb41-4287-80a3-468176137af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5c7f14c-d804-40ce-b852-32abbdd357ea', 'volume_name': 'volume-a5c7f14c-d804-40ce-b852-32abbdd357ea', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-afd18deb-cf21-4f67-81ee-d8eaf55c7c5b tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a875d076-7f12-46be-a262-13a73207bf3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-afd18deb-cf21-4f67-81ee-d8eaf55c7c5b tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a875d076-7f12-46be-a262-13a73207bf3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-afd18deb-cf21-4f67-81ee-d8eaf55c7c5b tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2218beb9-473b-48b7-b20b-bb1aa065ab2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:37 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-afd18deb-cf21-4f67-81ee-d8eaf55c7c5b tempest-CreateVolumesFromImageTest-76365343 None] Volume a5c7f14c-d804-40ce-b852-32abbdd357ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5c7f14c-d804-40ce-b852-32abbdd357ea', 'volume_size': 1} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-afd18deb-cf21-4f67-81ee-d8eaf55c7c5b tempest-CreateVolumesFromImageTest-76365343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-afd18deb-cf21-4f67-81ee-d8eaf55c7c5b tempest-CreateVolumesFromImageTest-76365343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-afd18deb-cf21-4f67-81ee-d8eaf55c7c5b tempest-CreateVolumesFromImageTest-76365343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:36:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1009800460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5c7f14c-d804-40ce-b852-32abbdd357ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb0632a6d03146b9af91c21c029dbca6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:36:37Z,use_quota=True,user_id='48c92edc4fac4cfe80d2ab2fad4c0af2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-afd18deb-cf21-4f67-81ee-d8eaf55c7c5b tempest-CreateVolumesFromImageTest-76365343 None] Creating volume a5c7f14c-d804-40ce-b852-32abbdd357ea {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-afd18deb-cf21-4f67-81ee-d8eaf55c7c5b tempest-CreateVolumesFromImageTest-76365343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-afd18deb-cf21-4f67-81ee-d8eaf55c7c5b tempest-CreateVolumesFromImageTest-76365343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-afd18deb-cf21-4f67-81ee-d8eaf55c7c5b tempest-CreateVolumesFromImageTest-76365343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-afd18deb-cf21-4f67-81ee-d8eaf55c7c5b tempest-CreateVolumesFromImageTest-76365343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-afd18deb-cf21-4f67-81ee-d8eaf55c7c5b tempest-CreateVolumesFromImageTest-76365343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-afd18deb-cf21-4f67-81ee-d8eaf55c7c5b tempest-CreateVolumesFromImageTest-76365343 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:36:37 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-afd18deb-cf21-4f67-81ee-d8eaf55c7c5b tempest-CreateVolumesFromImageTest-76365343 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-afd18deb-cf21-4f67-81ee-d8eaf55c7c5b tempest-CreateVolumesFromImageTest-76365343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-a5c7f14c-d804-40ce-b852-32abbdd357ea 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:37 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-a5c7f14c-d804-40ce-b852-32abbdd357ea 1073741824 Nov 03 20:36:37 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dae30bc-75ba-40af-a747-cc67f2bf8ede tempest-CreateVolumesFromSnapshotTest-997127146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4dae30bc-75ba-40af-a747-cc67f2bf8ede tempest-CreateVolumesFromSnapshotTest-997127146 None] Flow 'volume_create_manager' (1e8e1a0a-4796-4f9b-8e44-fc3c38c4c2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4dae30bc-75ba-40af-a747-cc67f2bf8ede tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9a5c374-5cfd-4662-a92c-5612ec0a42de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4dae30bc-75ba-40af-a747-cc67f2bf8ede tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9a5c374-5cfd-4662-a92c-5612ec0a42de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:36:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-368607339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2d077ab-47f0-456e-bf92-85ce7e83aa83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ffdf5a5e23f462ca0b62dd2e50cf772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:36:37Z,use_quota=True,user_id='030ae0218a734a249347affed5237da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4dae30bc-75ba-40af-a747-cc67f2bf8ede tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acd2a38a-075d-474a-84f1-046f3da90248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4dae30bc-75ba-40af-a747-cc67f2bf8ede tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acd2a38a-075d-474a-84f1-046f3da90248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4dae30bc-75ba-40af-a747-cc67f2bf8ede tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a976082-76f9-475b-9270-e9d83b0b3806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4dae30bc-75ba-40af-a747-cc67f2bf8ede tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a976082-76f9-475b-9270-e9d83b0b3806) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2d077ab-47f0-456e-bf92-85ce7e83aa83', 'volume_name': 'volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4dae30bc-75ba-40af-a747-cc67f2bf8ede tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d34fd4d0-3b45-4187-9e70-54f2501d0532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4dae30bc-75ba-40af-a747-cc67f2bf8ede tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d34fd4d0-3b45-4187-9e70-54f2501d0532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4dae30bc-75ba-40af-a747-cc67f2bf8ede tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31b611a6-cf6a-4a5d-bc10-1a8c05d330fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:37 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-4dae30bc-75ba-40af-a747-cc67f2bf8ede tempest-CreateVolumesFromSnapshotTest-997127146 None] Volume b2d077ab-47f0-456e-bf92-85ce7e83aa83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83', 'volume_size': 1} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4dae30bc-75ba-40af-a747-cc67f2bf8ede tempest-CreateVolumesFromSnapshotTest-997127146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ddc0223-bb4e-4f45-8703-de1ac0131a1c tempest-CreateVolumesFromImageTest-76365343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4ddc0223-bb4e-4f45-8703-de1ac0131a1c tempest-CreateVolumesFromImageTest-76365343 None] Flow 'volume_create_manager' (46a02faf-9f9a-4da8-8935-cc2acb08d5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4ddc0223-bb4e-4f45-8703-de1ac0131a1c tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f9e313b-9b8e-4244-aefe-6a985a087dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4ddc0223-bb4e-4f45-8703-de1ac0131a1c tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f9e313b-9b8e-4244-aefe-6a985a087dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1096896893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db5c74d3-faf3-41fb-820f-620f8bfae493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb0632a6d03146b9af91c21c029dbca6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:36:37Z,use_quota=True,user_id='48c92edc4fac4cfe80d2ab2fad4c0af2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4ddc0223-bb4e-4f45-8703-de1ac0131a1c tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0a56dc1-d068-48d1-8bdd-8a7fd12257ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4ddc0223-bb4e-4f45-8703-de1ac0131a1c tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0a56dc1-d068-48d1-8bdd-8a7fd12257ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4ddc0223-bb4e-4f45-8703-de1ac0131a1c tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c38929c-1446-4d28-87ab-71804ecfa711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4ddc0223-bb4e-4f45-8703-de1ac0131a1c tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c38929c-1446-4d28-87ab-71804ecfa711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db5c74d3-faf3-41fb-820f-620f8bfae493', 'volume_name': 'volume-db5c74d3-faf3-41fb-820f-620f8bfae493', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4ddc0223-bb4e-4f45-8703-de1ac0131a1c tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51e0396e-d0ce-4cba-9858-527d845ec4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4ddc0223-bb4e-4f45-8703-de1ac0131a1c tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51e0396e-d0ce-4cba-9858-527d845ec4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4ddc0223-bb4e-4f45-8703-de1ac0131a1c tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (006779b9-af19-4653-bbd0-d89ee295dc5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:37 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-4ddc0223-bb4e-4f45-8703-de1ac0131a1c tempest-CreateVolumesFromImageTest-76365343 None] Volume db5c74d3-faf3-41fb-820f-620f8bfae493: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db5c74d3-faf3-41fb-820f-620f8bfae493', 'volume_size': 1} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4ddc0223-bb4e-4f45-8703-de1ac0131a1c tempest-CreateVolumesFromImageTest-76365343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-76f2ebda-a6e0-4642-a79d-f93a60eac138 tempest-CreateVolumesFromImageTest-76365343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-76f2ebda-a6e0-4642-a79d-f93a60eac138 tempest-CreateVolumesFromImageTest-76365343 None] Flow 'volume_create_manager' (c2aca045-15e9-46b0-a371-c0ae807a87c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-76f2ebda-a6e0-4642-a79d-f93a60eac138 tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f7b205-08e6-4319-99bf-5141de35758c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-76f2ebda-a6e0-4642-a79d-f93a60eac138 tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f7b205-08e6-4319-99bf-5141de35758c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-567949960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4340e647-b4cb-4802-bd80-9ea0432dfdfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb0632a6d03146b9af91c21c029dbca6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:36:38Z,use_quota=True,user_id='48c92edc4fac4cfe80d2ab2fad4c0af2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-76f2ebda-a6e0-4642-a79d-f93a60eac138 tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (429ef9e0-c89e-4bb9-9932-d283f1d7a089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-76f2ebda-a6e0-4642-a79d-f93a60eac138 tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (429ef9e0-c89e-4bb9-9932-d283f1d7a089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-76f2ebda-a6e0-4642-a79d-f93a60eac138 tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4db5e199-bcdd-446a-b446-3ef980b85e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-76f2ebda-a6e0-4642-a79d-f93a60eac138 tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4db5e199-bcdd-446a-b446-3ef980b85e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4340e647-b4cb-4802-bd80-9ea0432dfdfb', 'volume_name': 'volume-4340e647-b4cb-4802-bd80-9ea0432dfdfb', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-76f2ebda-a6e0-4642-a79d-f93a60eac138 tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d09cce4-a1d6-4253-95a8-fc5899dd88f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-76f2ebda-a6e0-4642-a79d-f93a60eac138 tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d09cce4-a1d6-4253-95a8-fc5899dd88f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:37 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-76f2ebda-a6e0-4642-a79d-f93a60eac138 tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5047858-42ee-444e-ba1e-350250d35c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:37 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-76f2ebda-a6e0-4642-a79d-f93a60eac138 tempest-CreateVolumesFromImageTest-76365343 None] Volume 4340e647-b4cb-4802-bd80-9ea0432dfdfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4340e647-b4cb-4802-bd80-9ea0432dfdfb', 'volume_size': 1} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-76f2ebda-a6e0-4642-a79d-f93a60eac138 tempest-CreateVolumesFromImageTest-76365343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-afd18deb-cf21-4f67-81ee-d8eaf55c7c5b tempest-CreateVolumesFromImageTest-76365343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-a5c7f14c-d804-40ce-b852-32abbdd357ea 1073741824" returned: 0 in 0.652s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-afd18deb-cf21-4f67-81ee-d8eaf55c7c5b tempest-CreateVolumesFromImageTest-76365343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-a5c7f14c-d804-40ce-b852-32abbdd357ea {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:37 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-a5c7f14c-d804-40ce-b852-32abbdd357ea Nov 03 20:36:37 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:38 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-afd18deb-cf21-4f67-81ee-d8eaf55c7c5b tempest-CreateVolumesFromImageTest-76365343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-a5c7f14c-d804-40ce-b852-32abbdd357ea" returned: 0 in 0.392s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:38 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-afd18deb-cf21-4f67-81ee-d8eaf55c7c5b tempest-CreateVolumesFromImageTest-76365343 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:36:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-afd18deb-cf21-4f67-81ee-d8eaf55c7c5b tempest-CreateVolumesFromImageTest-76365343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4dae30bc-75ba-40af-a747-cc67f2bf8ede tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.843s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:38 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-4dae30bc-75ba-40af-a747-cc67f2bf8ede tempest-CreateVolumesFromSnapshotTest-997127146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:36:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-368607339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2d077ab-47f0-456e-bf92-85ce7e83aa83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ffdf5a5e23f462ca0b62dd2e50cf772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:36:37Z,use_quota=True,user_id='030ae0218a734a249347affed5237da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:36:38 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-4dae30bc-75ba-40af-a747-cc67f2bf8ede tempest-CreateVolumesFromSnapshotTest-997127146 None] Creating volume b2d077ab-47f0-456e-bf92-85ce7e83aa83 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:36:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4dae30bc-75ba-40af-a747-cc67f2bf8ede tempest-CreateVolumesFromSnapshotTest-997127146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4dae30bc-75ba-40af-a747-cc67f2bf8ede tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:38 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-4dae30bc-75ba-40af-a747-cc67f2bf8ede tempest-CreateVolumesFromSnapshotTest-997127146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:36:38 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-4dae30bc-75ba-40af-a747-cc67f2bf8ede tempest-CreateVolumesFromSnapshotTest-997127146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:36:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4dae30bc-75ba-40af-a747-cc67f2bf8ede tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:38 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-4dae30bc-75ba-40af-a747-cc67f2bf8ede tempest-CreateVolumesFromSnapshotTest-997127146 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:36:38 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-4dae30bc-75ba-40af-a747-cc67f2bf8ede tempest-CreateVolumesFromSnapshotTest-997127146 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:36:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4dae30bc-75ba-40af-a747-cc67f2bf8ede tempest-CreateVolumesFromSnapshotTest-997127146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:38 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83 1073741824 Nov 03 20:36:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-afd18deb-cf21-4f67-81ee-d8eaf55c7c5b tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2218beb9-473b-48b7-b20b-bb1aa065ab2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5c7f14c-d804-40ce-b852-32abbdd357ea', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:38 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-afd18deb-cf21-4f67-81ee-d8eaf55c7c5b tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed02e033-dcec-4421-aa95-d4216f2bf5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:38 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-29c98d8e-39ef-4e91-9311-f0f14d83952d tempest-CreateVolumesFromImageTest-76365343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:36:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-29c98d8e-39ef-4e91-9311-f0f14d83952d tempest-CreateVolumesFromImageTest-76365343 None] Flow 'volume_create_manager' (746f5d63-94c1-46c4-901d-aac82e479c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:36:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-29c98d8e-39ef-4e91-9311-f0f14d83952d tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd5e91b1-1acc-431f-a18f-a822a9f3caed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:38 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-afd18deb-cf21-4f67-81ee-d8eaf55c7c5b tempest-CreateVolumesFromImageTest-76365343 None] Volume volume-a5c7f14c-d804-40ce-b852-32abbdd357ea (a5c7f14c-d804-40ce-b852-32abbdd357ea): created successfully Nov 03 20:36:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-afd18deb-cf21-4f67-81ee-d8eaf55c7c5b tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed02e033-dcec-4421-aa95-d4216f2bf5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-afd18deb-cf21-4f67-81ee-d8eaf55c7c5b tempest-CreateVolumesFromImageTest-76365343 None] Flow 'volume_create_manager' (2ab090df-9460-4cf8-8ea9-5a8c51279036) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:36:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-29c98d8e-39ef-4e91-9311-f0f14d83952d tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd5e91b1-1acc-431f-a18f-a822a9f3caed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-600422517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c4832f3-f0d9-4f3a-aef5-66066fb27f26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb0632a6d03146b9af91c21c029dbca6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:36:38Z,use_quota=True,user_id='48c92edc4fac4cfe80d2ab2fad4c0af2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-29c98d8e-39ef-4e91-9311-f0f14d83952d tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51962598-934e-487b-b782-078bbc7cbe1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-29c98d8e-39ef-4e91-9311-f0f14d83952d tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51962598-934e-487b-b782-078bbc7cbe1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-29c98d8e-39ef-4e91-9311-f0f14d83952d tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d8dc7f8-44dc-4e4d-ac0f-bf237cc8ae57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-29c98d8e-39ef-4e91-9311-f0f14d83952d tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d8dc7f8-44dc-4e4d-ac0f-bf237cc8ae57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c4832f3-f0d9-4f3a-aef5-66066fb27f26', 'volume_name': 'volume-7c4832f3-f0d9-4f3a-aef5-66066fb27f26', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-29c98d8e-39ef-4e91-9311-f0f14d83952d tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f400d1c-7ea4-4716-bc5f-b5b0466ee7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-29c98d8e-39ef-4e91-9311-f0f14d83952d tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f400d1c-7ea4-4716-bc5f-b5b0466ee7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-29c98d8e-39ef-4e91-9311-f0f14d83952d tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (215ab124-d942-4865-93c8-ad36fe7e2328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:38 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-29c98d8e-39ef-4e91-9311-f0f14d83952d tempest-CreateVolumesFromImageTest-76365343 None] Volume 7c4832f3-f0d9-4f3a-aef5-66066fb27f26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c4832f3-f0d9-4f3a-aef5-66066fb27f26', 'volume_size': 1} Nov 03 20:36:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-29c98d8e-39ef-4e91-9311-f0f14d83952d tempest-CreateVolumesFromImageTest-76365343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:38 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-afd18deb-cf21-4f67-81ee-d8eaf55c7c5b tempest-CreateVolumesFromImageTest-76365343 None] Created volume successfully. Nov 03 20:36:38 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-70f96ac3-6052-424c-85bb-e005c1507004 tempest-CreateVolumesFromImageTest-76365343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:36:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-70f96ac3-6052-424c-85bb-e005c1507004 tempest-CreateVolumesFromImageTest-76365343 None] Flow 'volume_create_manager' (8b6b69d5-cb40-4cac-a8df-e7e3ed2d862c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:36:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-70f96ac3-6052-424c-85bb-e005c1507004 tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (675dfd43-ecab-4f22-9002-52b1712c6efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-70f96ac3-6052-424c-85bb-e005c1507004 tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (675dfd43-ecab-4f22-9002-52b1712c6efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1956910245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00f2a259-f415-4d82-bc00-94277189f276,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb0632a6d03146b9af91c21c029dbca6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:36:39Z,use_quota=True,user_id='48c92edc4fac4cfe80d2ab2fad4c0af2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-70f96ac3-6052-424c-85bb-e005c1507004 tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8987476f-8975-4b03-b522-6ef04189b182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-70f96ac3-6052-424c-85bb-e005c1507004 tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8987476f-8975-4b03-b522-6ef04189b182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-70f96ac3-6052-424c-85bb-e005c1507004 tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a3b88cf-ac76-42f2-9960-41ae4f92c80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-70f96ac3-6052-424c-85bb-e005c1507004 tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a3b88cf-ac76-42f2-9960-41ae4f92c80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00f2a259-f415-4d82-bc00-94277189f276', 'volume_name': 'volume-00f2a259-f415-4d82-bc00-94277189f276', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-70f96ac3-6052-424c-85bb-e005c1507004 tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d088cd33-e01a-40c0-a1d9-97b70e9cc296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-70f96ac3-6052-424c-85bb-e005c1507004 tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d088cd33-e01a-40c0-a1d9-97b70e9cc296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-70f96ac3-6052-424c-85bb-e005c1507004 tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd1ad6c5-5ab4-40ef-88f8-871285c1df88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:38 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-70f96ac3-6052-424c-85bb-e005c1507004 tempest-CreateVolumesFromImageTest-76365343 None] Volume 00f2a259-f415-4d82-bc00-94277189f276: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00f2a259-f415-4d82-bc00-94277189f276', 'volume_size': 1} Nov 03 20:36:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-70f96ac3-6052-424c-85bb-e005c1507004 tempest-CreateVolumesFromImageTest-76365343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:38 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4dae30bc-75ba-40af-a747-cc67f2bf8ede tempest-CreateVolumesFromSnapshotTest-997127146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83 1073741824" returned: 0 in 0.611s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4dae30bc-75ba-40af-a747-cc67f2bf8ede tempest-CreateVolumesFromSnapshotTest-997127146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:39 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83 Nov 03 20:36:39 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:39 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4dae30bc-75ba-40af-a747-cc67f2bf8ede tempest-CreateVolumesFromSnapshotTest-997127146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83" returned: 0 in 0.279s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:39 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-4dae30bc-75ba-40af-a747-cc67f2bf8ede tempest-CreateVolumesFromSnapshotTest-997127146 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:36:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4dae30bc-75ba-40af-a747-cc67f2bf8ede tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4ddc0223-bb4e-4f45-8703-de1ac0131a1c tempest-CreateVolumesFromImageTest-76365343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.565s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:39 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-4ddc0223-bb4e-4f45-8703-de1ac0131a1c tempest-CreateVolumesFromImageTest-76365343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1096896893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db5c74d3-faf3-41fb-820f-620f8bfae493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb0632a6d03146b9af91c21c029dbca6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:36:37Z,use_quota=True,user_id='48c92edc4fac4cfe80d2ab2fad4c0af2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:36:39 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-4ddc0223-bb4e-4f45-8703-de1ac0131a1c tempest-CreateVolumesFromImageTest-76365343 None] Creating volume db5c74d3-faf3-41fb-820f-620f8bfae493 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:36:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4ddc0223-bb4e-4f45-8703-de1ac0131a1c tempest-CreateVolumesFromImageTest-76365343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4ddc0223-bb4e-4f45-8703-de1ac0131a1c tempest-CreateVolumesFromImageTest-76365343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:39 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-4ddc0223-bb4e-4f45-8703-de1ac0131a1c tempest-CreateVolumesFromImageTest-76365343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:36:39 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-4ddc0223-bb4e-4f45-8703-de1ac0131a1c tempest-CreateVolumesFromImageTest-76365343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:36:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4ddc0223-bb4e-4f45-8703-de1ac0131a1c tempest-CreateVolumesFromImageTest-76365343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:39 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-4ddc0223-bb4e-4f45-8703-de1ac0131a1c tempest-CreateVolumesFromImageTest-76365343 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:36:39 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-4ddc0223-bb4e-4f45-8703-de1ac0131a1c tempest-CreateVolumesFromImageTest-76365343 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:36:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4ddc0223-bb4e-4f45-8703-de1ac0131a1c tempest-CreateVolumesFromImageTest-76365343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-db5c74d3-faf3-41fb-820f-620f8bfae493 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:39 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4dae30bc-75ba-40af-a747-cc67f2bf8ede tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31b611a6-cf6a-4a5d-bc10-1a8c05d330fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:39 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4dae30bc-75ba-40af-a747-cc67f2bf8ede tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87d73fc7-a3dc-4721-bd72-d8ac349ac96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:39 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-db5c74d3-faf3-41fb-820f-620f8bfae493 1073741824 Nov 03 20:36:39 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:39 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-4dae30bc-75ba-40af-a747-cc67f2bf8ede tempest-CreateVolumesFromSnapshotTest-997127146 None] Volume volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83 (b2d077ab-47f0-456e-bf92-85ce7e83aa83): created successfully Nov 03 20:36:39 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4dae30bc-75ba-40af-a747-cc67f2bf8ede tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87d73fc7-a3dc-4721-bd72-d8ac349ac96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:39 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4dae30bc-75ba-40af-a747-cc67f2bf8ede tempest-CreateVolumesFromSnapshotTest-997127146 None] Flow 'volume_create_manager' (1e8e1a0a-4796-4f9b-8e44-fc3c38c4c2e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:36:39 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-4dae30bc-75ba-40af-a747-cc67f2bf8ede tempest-CreateVolumesFromSnapshotTest-997127146 None] Created volume successfully. Nov 03 20:36:39 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4ddc0223-bb4e-4f45-8703-de1ac0131a1c tempest-CreateVolumesFromImageTest-76365343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-db5c74d3-faf3-41fb-820f-620f8bfae493 1073741824" returned: 0 in 0.564s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4ddc0223-bb4e-4f45-8703-de1ac0131a1c tempest-CreateVolumesFromImageTest-76365343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-db5c74d3-faf3-41fb-820f-620f8bfae493 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:39 devstack sudo[106170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-db5c74d3-faf3-41fb-820f-620f8bfae493 Nov 03 20:36:39 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:40 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4ddc0223-bb4e-4f45-8703-de1ac0131a1c tempest-CreateVolumesFromImageTest-76365343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-db5c74d3-faf3-41fb-820f-620f8bfae493" returned: 0 in 0.285s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:40 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-4ddc0223-bb4e-4f45-8703-de1ac0131a1c tempest-CreateVolumesFromImageTest-76365343 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:36:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4ddc0223-bb4e-4f45-8703-de1ac0131a1c tempest-CreateVolumesFromImageTest-76365343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-76f2ebda-a6e0-4642-a79d-f93a60eac138 tempest-CreateVolumesFromImageTest-76365343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.327s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:40 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-76f2ebda-a6e0-4642-a79d-f93a60eac138 tempest-CreateVolumesFromImageTest-76365343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-567949960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4340e647-b4cb-4802-bd80-9ea0432dfdfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb0632a6d03146b9af91c21c029dbca6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:36:38Z,use_quota=True,user_id='48c92edc4fac4cfe80d2ab2fad4c0af2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:36:40 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-76f2ebda-a6e0-4642-a79d-f93a60eac138 tempest-CreateVolumesFromImageTest-76365343 None] Creating volume 4340e647-b4cb-4802-bd80-9ea0432dfdfb {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:36:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-76f2ebda-a6e0-4642-a79d-f93a60eac138 tempest-CreateVolumesFromImageTest-76365343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-76f2ebda-a6e0-4642-a79d-f93a60eac138 tempest-CreateVolumesFromImageTest-76365343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:40 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-76f2ebda-a6e0-4642-a79d-f93a60eac138 tempest-CreateVolumesFromImageTest-76365343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:36:40 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-76f2ebda-a6e0-4642-a79d-f93a60eac138 tempest-CreateVolumesFromImageTest-76365343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:36:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-76f2ebda-a6e0-4642-a79d-f93a60eac138 tempest-CreateVolumesFromImageTest-76365343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:40 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-76f2ebda-a6e0-4642-a79d-f93a60eac138 tempest-CreateVolumesFromImageTest-76365343 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:36:40 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-76f2ebda-a6e0-4642-a79d-f93a60eac138 tempest-CreateVolumesFromImageTest-76365343 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:36:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-76f2ebda-a6e0-4642-a79d-f93a60eac138 tempest-CreateVolumesFromImageTest-76365343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4340e647-b4cb-4802-bd80-9ea0432dfdfb 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:40 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4ddc0223-bb4e-4f45-8703-de1ac0131a1c tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (006779b9-af19-4653-bbd0-d89ee295dc5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db5c74d3-faf3-41fb-820f-620f8bfae493', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:40 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4ddc0223-bb4e-4f45-8703-de1ac0131a1c tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98927bc6-27d9-49c1-b10d-a94a01c15cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:40 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4340e647-b4cb-4802-bd80-9ea0432dfdfb 1073741824 Nov 03 20:36:40 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:40 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-4ddc0223-bb4e-4f45-8703-de1ac0131a1c tempest-CreateVolumesFromImageTest-76365343 None] Volume volume-db5c74d3-faf3-41fb-820f-620f8bfae493 (db5c74d3-faf3-41fb-820f-620f8bfae493): created successfully Nov 03 20:36:40 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4ddc0223-bb4e-4f45-8703-de1ac0131a1c tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98927bc6-27d9-49c1-b10d-a94a01c15cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:40 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4ddc0223-bb4e-4f45-8703-de1ac0131a1c tempest-CreateVolumesFromImageTest-76365343 None] Flow 'volume_create_manager' (46a02faf-9f9a-4da8-8935-cc2acb08d5d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:36:40 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-4ddc0223-bb4e-4f45-8703-de1ac0131a1c tempest-CreateVolumesFromImageTest-76365343 None] Created volume successfully. Nov 03 20:36:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-49664a5d-c2d8-48ae-943c-9a6e25bdfbdc tempest-CreateVolumesFromSnapshotTest-997127146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:40 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-76f2ebda-a6e0-4642-a79d-f93a60eac138 tempest-CreateVolumesFromImageTest-76365343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4340e647-b4cb-4802-bd80-9ea0432dfdfb 1073741824" returned: 0 in 0.690s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-76f2ebda-a6e0-4642-a79d-f93a60eac138 tempest-CreateVolumesFromImageTest-76365343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4340e647-b4cb-4802-bd80-9ea0432dfdfb {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:40 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4340e647-b4cb-4802-bd80-9ea0432dfdfb Nov 03 20:36:40 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:41 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-76f2ebda-a6e0-4642-a79d-f93a60eac138 tempest-CreateVolumesFromImageTest-76365343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4340e647-b4cb-4802-bd80-9ea0432dfdfb" returned: 0 in 0.267s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:41 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-76f2ebda-a6e0-4642-a79d-f93a60eac138 tempest-CreateVolumesFromImageTest-76365343 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:36:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-76f2ebda-a6e0-4642-a79d-f93a60eac138 tempest-CreateVolumesFromImageTest-76365343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-29c98d8e-39ef-4e91-9311-f0f14d83952d tempest-CreateVolumesFromImageTest-76365343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.522s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:41 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-29c98d8e-39ef-4e91-9311-f0f14d83952d tempest-CreateVolumesFromImageTest-76365343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-600422517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c4832f3-f0d9-4f3a-aef5-66066fb27f26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb0632a6d03146b9af91c21c029dbca6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:36:38Z,use_quota=True,user_id='48c92edc4fac4cfe80d2ab2fad4c0af2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:36:41 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-29c98d8e-39ef-4e91-9311-f0f14d83952d tempest-CreateVolumesFromImageTest-76365343 None] Creating volume 7c4832f3-f0d9-4f3a-aef5-66066fb27f26 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:36:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-29c98d8e-39ef-4e91-9311-f0f14d83952d tempest-CreateVolumesFromImageTest-76365343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-29c98d8e-39ef-4e91-9311-f0f14d83952d tempest-CreateVolumesFromImageTest-76365343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:41 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-29c98d8e-39ef-4e91-9311-f0f14d83952d tempest-CreateVolumesFromImageTest-76365343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:36:41 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-29c98d8e-39ef-4e91-9311-f0f14d83952d tempest-CreateVolumesFromImageTest-76365343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:36:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-29c98d8e-39ef-4e91-9311-f0f14d83952d tempest-CreateVolumesFromImageTest-76365343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:41 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-29c98d8e-39ef-4e91-9311-f0f14d83952d tempest-CreateVolumesFromImageTest-76365343 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:36:41 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-29c98d8e-39ef-4e91-9311-f0f14d83952d tempest-CreateVolumesFromImageTest-76365343 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:36:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-29c98d8e-39ef-4e91-9311-f0f14d83952d tempest-CreateVolumesFromImageTest-76365343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c4832f3-f0d9-4f3a-aef5-66066fb27f26 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:41 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c4832f3-f0d9-4f3a-aef5-66066fb27f26 1073741824 Nov 03 20:36:41 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-76f2ebda-a6e0-4642-a79d-f93a60eac138 tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5047858-42ee-444e-ba1e-350250d35c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4340e647-b4cb-4802-bd80-9ea0432dfdfb', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:41 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:41 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-76f2ebda-a6e0-4642-a79d-f93a60eac138 tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f04f35a4-6171-43f8-bdf6-1159d41a5921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:41 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-76f2ebda-a6e0-4642-a79d-f93a60eac138 tempest-CreateVolumesFromImageTest-76365343 None] Volume volume-4340e647-b4cb-4802-bd80-9ea0432dfdfb (4340e647-b4cb-4802-bd80-9ea0432dfdfb): created successfully Nov 03 20:36:41 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-76f2ebda-a6e0-4642-a79d-f93a60eac138 tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f04f35a4-6171-43f8-bdf6-1159d41a5921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:41 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-76f2ebda-a6e0-4642-a79d-f93a60eac138 tempest-CreateVolumesFromImageTest-76365343 None] Flow 'volume_create_manager' (c2aca045-15e9-46b0-a371-c0ae807a87c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:36:41 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-76f2ebda-a6e0-4642-a79d-f93a60eac138 tempest-CreateVolumesFromImageTest-76365343 None] Created volume successfully. Nov 03 20:36:41 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-29c98d8e-39ef-4e91-9311-f0f14d83952d tempest-CreateVolumesFromImageTest-76365343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c4832f3-f0d9-4f3a-aef5-66066fb27f26 1073741824" returned: 0 in 0.613s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:41 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:36:41 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Flow 'volume_create_manager' (cbc0d7d1-f391-47f1-8291-7f41f2e1cb74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:36:41 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64adcc2a-ae58-4176-ba7f-b74fe870efbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-29c98d8e-39ef-4e91-9311-f0f14d83952d tempest-CreateVolumesFromImageTest-76365343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c4832f3-f0d9-4f3a-aef5-66066fb27f26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:41 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64adcc2a-ae58-4176-ba7f-b74fe870efbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66722147-1a87-4ea3-8a00-ad6a4eabb698,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f848346580a54df58c4a8c3cf68ac3a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:36:42Z,use_quota=True,user_id='1aeb88b50a9e4479854e632344cfe13b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0b341fd-8b7e-41bd-9d3f-610c9cb3d35e),volume_type_id=a0b341fd-8b7e-41bd-9d3f-610c9cb3d35e)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:41 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0646c505-d7a0-4ac7-95b7-f514bc68200c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:41 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c4832f3-f0d9-4f3a-aef5-66066fb27f26 Nov 03 20:36:41 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:41 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0646c505-d7a0-4ac7-95b7-f514bc68200c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:41 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15f107de-a540-4a4f-b96b-33352cfaa8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:41 devstack cinder-volume[87248]: DEBUG cinder.image.glance [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Creating Keystone auth plugin from conf {{(pid=87248) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 20:36:42 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-29c98d8e-39ef-4e91-9311-f0f14d83952d tempest-CreateVolumesFromImageTest-76365343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c4832f3-f0d9-4f3a-aef5-66066fb27f26" returned: 0 in 0.286s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:42 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-29c98d8e-39ef-4e91-9311-f0f14d83952d tempest-CreateVolumesFromImageTest-76365343 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:36:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-29c98d8e-39ef-4e91-9311-f0f14d83952d tempest-CreateVolumesFromImageTest-76365343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-70f96ac3-6052-424c-85bb-e005c1507004 tempest-CreateVolumesFromImageTest-76365343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.331s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:42 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-70f96ac3-6052-424c-85bb-e005c1507004 tempest-CreateVolumesFromImageTest-76365343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1956910245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00f2a259-f415-4d82-bc00-94277189f276,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb0632a6d03146b9af91c21c029dbca6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:36:39Z,use_quota=True,user_id='48c92edc4fac4cfe80d2ab2fad4c0af2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:36:42 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-70f96ac3-6052-424c-85bb-e005c1507004 tempest-CreateVolumesFromImageTest-76365343 None] Creating volume 00f2a259-f415-4d82-bc00-94277189f276 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:36:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-70f96ac3-6052-424c-85bb-e005c1507004 tempest-CreateVolumesFromImageTest-76365343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-70f96ac3-6052-424c-85bb-e005c1507004 tempest-CreateVolumesFromImageTest-76365343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:42 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-70f96ac3-6052-424c-85bb-e005c1507004 tempest-CreateVolumesFromImageTest-76365343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:36:42 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-70f96ac3-6052-424c-85bb-e005c1507004 tempest-CreateVolumesFromImageTest-76365343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:36:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-70f96ac3-6052-424c-85bb-e005c1507004 tempest-CreateVolumesFromImageTest-76365343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:42 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-70f96ac3-6052-424c-85bb-e005c1507004 tempest-CreateVolumesFromImageTest-76365343 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:36:42 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-70f96ac3-6052-424c-85bb-e005c1507004 tempest-CreateVolumesFromImageTest-76365343 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:36:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-70f96ac3-6052-424c-85bb-e005c1507004 tempest-CreateVolumesFromImageTest-76365343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00f2a259-f415-4d82-bc00-94277189f276 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:42 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-29c98d8e-39ef-4e91-9311-f0f14d83952d tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (215ab124-d942-4865-93c8-ad36fe7e2328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c4832f3-f0d9-4f3a-aef5-66066fb27f26', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:42 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-29c98d8e-39ef-4e91-9311-f0f14d83952d tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (595d1a13-d1bd-41c4-85fb-09a019575201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:42 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00f2a259-f415-4d82-bc00-94277189f276 1073741824 Nov 03 20:36:42 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:42 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-29c98d8e-39ef-4e91-9311-f0f14d83952d tempest-CreateVolumesFromImageTest-76365343 None] Volume volume-7c4832f3-f0d9-4f3a-aef5-66066fb27f26 (7c4832f3-f0d9-4f3a-aef5-66066fb27f26): created successfully Nov 03 20:36:42 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-29c98d8e-39ef-4e91-9311-f0f14d83952d tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (595d1a13-d1bd-41c4-85fb-09a019575201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:42 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-29c98d8e-39ef-4e91-9311-f0f14d83952d tempest-CreateVolumesFromImageTest-76365343 None] Flow 'volume_create_manager' (746f5d63-94c1-46c4-901d-aac82e479c8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:36:42 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-29c98d8e-39ef-4e91-9311-f0f14d83952d tempest-CreateVolumesFromImageTest-76365343 None] Created volume successfully. Nov 03 20:36:42 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15f107de-a540-4a4f-b96b-33352cfaa8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '66722147-1a87-4ea3-8a00-ad6a4eabb698', 'volume_name': 'volume-66722147-1a87-4ea3-8a00-ad6a4eabb698', 'volume_size': 1, 'image_id': 'dac53d33-3fc1-4df7-91d0-ec5e4b08e676', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dac53d33-3fc1-4df7-91d0-ec5e4b08e676', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '02a191c9d5b3b6c2fb028cb26d7dda26', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f848346580a54df58c4a8c3cf68ac3a9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '849e612bfcbef8460fe683497d17e70ed177b6debb2952025a66d50f7b203eafdc5ffb7757f3e48b98192285ef6e3e1417258130c30de2261c1efdf42896b22f', 'id': 'dac53d33-3fc1-4df7-91d0-ec5e4b08e676', 'created_at': datetime.datetime(2026, 11, 3, 19, 36, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 36, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dac53d33-3fc1-4df7-91d0-ec5e4b08e676/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:42 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3fee8a3-6a2e-4a8a-b6fe-11279d4e1c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:42 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3fee8a3-6a2e-4a8a-b6fe-11279d4e1c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:42 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f1a7f09-62fd-43e9-b86f-b185b673c83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:42 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Volume 66722147-1a87-4ea3-8a00-ad6a4eabb698: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-66722147-1a87-4ea3-8a00-ad6a4eabb698', 'volume_size': 1, 'image_id': 'dac53d33-3fc1-4df7-91d0-ec5e4b08e676', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dac53d33-3fc1-4df7-91d0-ec5e4b08e676', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '02a191c9d5b3b6c2fb028cb26d7dda26', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f848346580a54df58c4a8c3cf68ac3a9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '849e612bfcbef8460fe683497d17e70ed177b6debb2952025a66d50f7b203eafdc5ffb7757f3e48b98192285ef6e3e1417258130c30de2261c1efdf42896b22f', 'id': 'dac53d33-3fc1-4df7-91d0-ec5e4b08e676', 'created_at': datetime.datetime(2026, 11, 3, 19, 36, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 36, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dac53d33-3fc1-4df7-91d0-ec5e4b08e676/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 03 20:36:42 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Trying to clone 66722147-1a87-4ea3-8a00-ad6a4eabb698 from image dac53d33-3fc1-4df7-91d0-ec5e4b08e676 at location (None, [{'url': 'file:///opt/stack/data/glance/images/dac53d33-3fc1-4df7-91d0-ec5e4b08e676', 'metadata': {}}]). {{(pid=87248) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 20:36:42 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dac53d33-3fc1-4df7-91d0-ec5e4b08e676_uizb12rgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87248) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 20:36:42 devstack cinder-volume[87248]: INFO cinder.image.image_utils [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Image download 0.00 MB at 0.00 MB/s Nov 03 20:36:42 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[646b13b6-2cf0-4447-8eb1-005a8f2a06b3]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:36:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dac53d33-3fc1-4df7-91d0-ec5e4b08e676_uizb12rgdevstack@QuobyteHD {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:42 devstack sudo[106198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dac53d33-3fc1-4df7-91d0-ec5e4b08e676_uizb12rgdevstack@QuobyteHD Nov 03 20:36:42 devstack sudo[106198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:42 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-70f96ac3-6052-424c-85bb-e005c1507004 tempest-CreateVolumesFromImageTest-76365343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00f2a259-f415-4d82-bc00-94277189f276 1073741824" returned: 0 in 0.575s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-70f96ac3-6052-424c-85bb-e005c1507004 tempest-CreateVolumesFromImageTest-76365343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00f2a259-f415-4d82-bc00-94277189f276 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:42 devstack sudo[106201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00f2a259-f415-4d82-bc00-94277189f276 Nov 03 20:36:42 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:42 devstack sudo[106198]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dac53d33-3fc1-4df7-91d0-ec5e4b08e676_uizb12rgdevstack@QuobyteHD" returned: 0 in 0.356s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dac53d33-3fc1-4df7-91d0-ec5e4b08e676_uizb12rgdevstack@QuobyteHD {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:43 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dac53d33-3fc1-4df7-91d0-ec5e4b08e676_uizb12rgdevstack@QuobyteHD Nov 03 20:36:43 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:43 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-70f96ac3-6052-424c-85bb-e005c1507004 tempest-CreateVolumesFromImageTest-76365343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00f2a259-f415-4d82-bc00-94277189f276" returned: 0 in 0.290s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:43 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-70f96ac3-6052-424c-85bb-e005c1507004 tempest-CreateVolumesFromImageTest-76365343 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:36:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-70f96ac3-6052-424c-85bb-e005c1507004 tempest-CreateVolumesFromImageTest-76365343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-49664a5d-c2d8-48ae-943c-9a6e25bdfbdc tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.693s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:43 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-49664a5d-c2d8-48ae-943c-9a6e25bdfbdc tempest-CreateVolumesFromSnapshotTest-997127146 None] Creating offline snapshot 9ade2251-2e77-4e84-9974-46ba2e655f91 of volume b2d077ab-47f0-456e-bf92-85ce7e83aa83 {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:36:43 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-70f96ac3-6052-424c-85bb-e005c1507004 tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd1ad6c5-5ab4-40ef-88f8-871285c1df88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00f2a259-f415-4d82-bc00-94277189f276', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:43 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-70f96ac3-6052-424c-85bb-e005c1507004 tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7daf1dde-bd14-4cf1-9cb8-54c7351a9181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:43 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-70f96ac3-6052-424c-85bb-e005c1507004 tempest-CreateVolumesFromImageTest-76365343 None] Volume volume-00f2a259-f415-4d82-bc00-94277189f276 (00f2a259-f415-4d82-bc00-94277189f276): created successfully Nov 03 20:36:43 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-70f96ac3-6052-424c-85bb-e005c1507004 tempest-CreateVolumesFromImageTest-76365343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7daf1dde-bd14-4cf1-9cb8-54c7351a9181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:43 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-70f96ac3-6052-424c-85bb-e005c1507004 tempest-CreateVolumesFromImageTest-76365343 None] Flow 'volume_create_manager' (8b6b69d5-cb40-4cac-a8df-e7e3ed2d862c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:36:43 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19d9c6b-0dbb-4267-b723-aa161314668f]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:36:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-49664a5d-c2d8-48ae-943c-9a6e25bdfbdc tempest-CreateVolumesFromSnapshotTest-997127146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:43 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-70f96ac3-6052-424c-85bb-e005c1507004 tempest-CreateVolumesFromImageTest-76365343 None] Created volume successfully. Nov 03 20:36:43 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dac53d33-3fc1-4df7-91d0-ec5e4b08e676_uizb12rgdevstack@QuobyteHD" returned: 1 in 0.419s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dac53d33-3fc1-4df7-91d0-ec5e4b08e676_uizb12rgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 20:36:43 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Temporary image dac53d33-3fc1-4df7-91d0-ec5e4b08e676 is fetched for user 1aeb88b50a9e4479854e632344cfe13b. {{(pid=87248) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 20:36:43 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-017530e8-ac7f-4d95-8701-1214f88487e8 tempest-ProjectMemberTests-196532882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:36:43 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83 Nov 03 20:36:43 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:43 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-017530e8-ac7f-4d95-8701-1214f88487e8 tempest-ProjectMemberTests-196532882 None] Flow 'volume_create_manager' (7e914be0-c1d3-458b-aaf8-281712bc63c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:36:43 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-017530e8-ac7f-4d95-8701-1214f88487e8 tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a60ca5b-70cc-4130-b8a8-c845cbdb616a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:43 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-017530e8-ac7f-4d95-8701-1214f88487e8 tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a60ca5b-70cc-4130-b8a8-c845cbdb616a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-853497396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20c5bcaf-3702-4258-b5ea-9e8a22e2d619,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd20413f6d5649da828c1f0bf51455d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:36:43Z,use_quota=True,user_id='595eaffd7e764ae6b07e6aba8405d447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:43 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-017530e8-ac7f-4d95-8701-1214f88487e8 tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbed2471-e714-40d3-aa5b-d273c62b6ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:43 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-017530e8-ac7f-4d95-8701-1214f88487e8 tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbed2471-e714-40d3-aa5b-d273c62b6ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:43 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-017530e8-ac7f-4d95-8701-1214f88487e8 tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d69a38be-a2f9-40cf-9f72-7d8110a7c487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:43 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-017530e8-ac7f-4d95-8701-1214f88487e8 tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d69a38be-a2f9-40cf-9f72-7d8110a7c487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20c5bcaf-3702-4258-b5ea-9e8a22e2d619', 'volume_name': 'volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:43 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-017530e8-ac7f-4d95-8701-1214f88487e8 tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ed762af-feb4-4e45-8b58-c6b3a72facdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:43 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-017530e8-ac7f-4d95-8701-1214f88487e8 tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ed762af-feb4-4e45-8b58-c6b3a72facdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:43 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-017530e8-ac7f-4d95-8701-1214f88487e8 tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7402124-1170-4b7b-80e2-7e728e561e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:43 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-017530e8-ac7f-4d95-8701-1214f88487e8 tempest-ProjectMemberTests-196532882 None] Volume 20c5bcaf-3702-4258-b5ea-9e8a22e2d619: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619', 'volume_size': 1} Nov 03 20:36:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-017530e8-ac7f-4d95-8701-1214f88487e8 tempest-ProjectMemberTests-196532882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:43 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[29dd53e9-6d2b-47de-a5fd-c4727150b9f9]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:36:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dac53d33-3fc1-4df7-91d0-ec5e4b08e676_uizb12rgdevstack@QuobyteHD {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:43 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dac53d33-3fc1-4df7-91d0-ec5e4b08e676_uizb12rgdevstack@QuobyteHD Nov 03 20:36:43 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:43 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-49664a5d-c2d8-48ae-943c-9a6e25bdfbdc tempest-CreateVolumesFromSnapshotTest-997127146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83" returned: 0 in 0.425s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-49664a5d-c2d8-48ae-943c-9a6e25bdfbdc tempest-CreateVolumesFromSnapshotTest-997127146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83.9ade2251-2e77-4e84-9974-46ba2e655f91 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:43 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83.9ade2251-2e77-4e84-9974-46ba2e655f91 1G Nov 03 20:36:43 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:43 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dac53d33-3fc1-4df7-91d0-ec5e4b08e676_uizb12rgdevstack@QuobyteHD" returned: 0 in 0.347s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dac53d33-3fc1-4df7-91d0-ec5e4b08e676_uizb12rgdevstack@QuobyteHD {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:43 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dac53d33-3fc1-4df7-91d0-ec5e4b08e676_uizb12rgdevstack@QuobyteHD Nov 03 20:36:43 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:44 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-49664a5d-c2d8-48ae-943c-9a6e25bdfbdc tempest-CreateVolumesFromSnapshotTest-997127146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83.9ade2251-2e77-4e84-9974-46ba2e655f91 1G" returned: 0 in 0.410s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-49664a5d-c2d8-48ae-943c-9a6e25bdfbdc tempest-CreateVolumesFromSnapshotTest-997127146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83.9ade2251-2e77-4e84-9974-46ba2e655f91 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:44 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83.9ade2251-2e77-4e84-9974-46ba2e655f91 Nov 03 20:36:44 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:44 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dac53d33-3fc1-4df7-91d0-ec5e4b08e676_uizb12rgdevstack@QuobyteHD" returned: 1 in 0.332s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dac53d33-3fc1-4df7-91d0-ec5e4b08e676_uizb12rgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 20:36:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:44 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-49e07411-99b1-4ee5-8d26-dec2f7e28688 tempest-CreateVolumesFromImageTest-76365343 None] Acquiring lock "cinder-00f2a259-f415-4d82-bc00-94277189f276-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:36:44 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-49664a5d-c2d8-48ae-943c-9a6e25bdfbdc tempest-CreateVolumesFromSnapshotTest-997127146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83.9ade2251-2e77-4e84-9974-46ba2e655f91" returned: 0 in 0.313s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:44 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-49664a5d-c2d8-48ae-943c-9a6e25bdfbdc tempest-CreateVolumesFromSnapshotTest-997127146 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83.9ade2251-2e77-4e84-9974-46ba2e655f91 is being set with open permissions: ugo+rw Nov 03 20:36:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-49664a5d-c2d8-48ae-943c-9a6e25bdfbdc tempest-CreateVolumesFromSnapshotTest-997127146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83.9ade2251-2e77-4e84-9974-46ba2e655f91 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:44 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-49e07411-99b1-4ee5-8d26-dec2f7e28688 tempest-CreateVolumesFromImageTest-76365343 None] Lock "cinder-00f2a259-f415-4d82-bc00-94277189f276-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:36:44 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83.9ade2251-2e77-4e84-9974-46ba2e655f91 Nov 03 20:36:44 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:44 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-49e07411-99b1-4ee5-8d26-dec2f7e28688 tempest-CreateVolumesFromImageTest-76365343 None] Acquiring lock "cinder-quobyte-00f2a259-f415-4d82-bc00-94277189f276" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:36:44 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-49e07411-99b1-4ee5-8d26-dec2f7e28688 tempest-CreateVolumesFromImageTest-76365343 None] Lock "cinder-quobyte-00f2a259-f415-4d82-bc00-94277189f276" acquired by "delete_volume" :: waited 0.016s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:36:44 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[02647c56-54af-49f7-a10e-99a4d9b8b36c]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:36:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-49e07411-99b1-4ee5-8d26-dec2f7e28688 tempest-CreateVolumesFromImageTest-76365343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00f2a259-f415-4d82-bc00-94277189f276 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:44 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00f2a259-f415-4d82-bc00-94277189f276 Nov 03 20:36:44 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:44 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-49664a5d-c2d8-48ae-943c-9a6e25bdfbdc tempest-CreateVolumesFromSnapshotTest-997127146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83.9ade2251-2e77-4e84-9974-46ba2e655f91" returned: 0 in 0.266s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-49664a5d-c2d8-48ae-943c-9a6e25bdfbdc tempest-CreateVolumesFromSnapshotTest-997127146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:44 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83.info Nov 03 20:36:44 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:44 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-49e07411-99b1-4ee5-8d26-dec2f7e28688 tempest-CreateVolumesFromImageTest-76365343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00f2a259-f415-4d82-bc00-94277189f276" returned: 0 in 0.375s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-49e07411-99b1-4ee5-8d26-dec2f7e28688 tempest-CreateVolumesFromImageTest-76365343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00f2a259-f415-4d82-bc00-94277189f276 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:44 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00f2a259-f415-4d82-bc00-94277189f276 Nov 03 20:36:44 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:44 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-49664a5d-c2d8-48ae-943c-9a6e25bdfbdc tempest-CreateVolumesFromSnapshotTest-997127146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83.info" returned: 0 in 0.266s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:44 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-49664a5d-c2d8-48ae-943c-9a6e25bdfbdc tempest-CreateVolumesFromSnapshotTest-997127146 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83.info is being set with open permissions: ugo+rw Nov 03 20:36:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-49664a5d-c2d8-48ae-943c-9a6e25bdfbdc tempest-CreateVolumesFromSnapshotTest-997127146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:44 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83.info Nov 03 20:36:44 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:45 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-49e07411-99b1-4ee5-8d26-dec2f7e28688 tempest-CreateVolumesFromImageTest-76365343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-00f2a259-f415-4d82-bc00-94277189f276" returned: 0 in 0.253s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:45 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-49e07411-99b1-4ee5-8d26-dec2f7e28688 tempest-CreateVolumesFromImageTest-76365343 None] Lock "cinder-quobyte-00f2a259-f415-4d82-bc00-94277189f276" released by "delete_volume" :: held 0.667s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:36:45 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-49e07411-99b1-4ee5-8d26-dec2f7e28688 tempest-CreateVolumesFromImageTest-76365343 None] Created reservations ['dbee094e-fd53-4201-a67e-f917ed56ed11', '14f21212-68c9-4cb8-80b3-e453311f1090', '592a78e8-f4e8-400e-91e3-1a43976306b1', '2cfb16ff-accf-4084-bafe-5cf8da8baf6b'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:36:45 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-49664a5d-c2d8-48ae-943c-9a6e25bdfbdc tempest-CreateVolumesFromSnapshotTest-997127146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83.info" returned: 0 in 0.257s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-49664a5d-c2d8-48ae-943c-9a6e25bdfbdc tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.102s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-017530e8-ac7f-4d95-8701-1214f88487e8 tempest-ProjectMemberTests-196532882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.749s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:45 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-017530e8-ac7f-4d95-8701-1214f88487e8 tempest-ProjectMemberTests-196532882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-853497396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20c5bcaf-3702-4258-b5ea-9e8a22e2d619,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd20413f6d5649da828c1f0bf51455d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:36:43Z,use_quota=True,user_id='595eaffd7e764ae6b07e6aba8405d447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:36:45 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-017530e8-ac7f-4d95-8701-1214f88487e8 tempest-ProjectMemberTests-196532882 None] Creating volume 20c5bcaf-3702-4258-b5ea-9e8a22e2d619 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:36:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-017530e8-ac7f-4d95-8701-1214f88487e8 tempest-ProjectMemberTests-196532882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-017530e8-ac7f-4d95-8701-1214f88487e8 tempest-ProjectMemberTests-196532882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:45 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-017530e8-ac7f-4d95-8701-1214f88487e8 tempest-ProjectMemberTests-196532882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:36:45 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-017530e8-ac7f-4d95-8701-1214f88487e8 tempest-ProjectMemberTests-196532882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:36:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-017530e8-ac7f-4d95-8701-1214f88487e8 tempest-ProjectMemberTests-196532882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:45 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-017530e8-ac7f-4d95-8701-1214f88487e8 tempest-ProjectMemberTests-196532882 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:36:45 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-017530e8-ac7f-4d95-8701-1214f88487e8 tempest-ProjectMemberTests-196532882 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:36:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-017530e8-ac7f-4d95-8701-1214f88487e8 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:45 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619 1073741824 Nov 03 20:36:45 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:45 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-49664a5d-c2d8-48ae-943c-9a6e25bdfbdc tempest-CreateVolumesFromSnapshotTest-997127146 None] Create snapshot completed successfully Nov 03 20:36:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-49e07411-99b1-4ee5-8d26-dec2f7e28688 tempest-CreateVolumesFromImageTest-76365343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-49e07411-99b1-4ee5-8d26-dec2f7e28688 tempest-CreateVolumesFromImageTest-76365343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:45 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-49e07411-99b1-4ee5-8d26-dec2f7e28688 tempest-CreateVolumesFromImageTest-76365343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:36:45 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-49e07411-99b1-4ee5-8d26-dec2f7e28688 tempest-CreateVolumesFromImageTest-76365343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:36:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-49e07411-99b1-4ee5-8d26-dec2f7e28688 tempest-CreateVolumesFromImageTest-76365343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-49e07411-99b1-4ee5-8d26-dec2f7e28688 tempest-CreateVolumesFromImageTest-76365343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:45 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:36:45 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:45 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a52c1160-164a-4623-861d-d0301f14b3eb tempest-CreateVolumesFromImageTest-76365343 None] Acquiring lock "cinder-7c4832f3-f0d9-4f3a-aef5-66066fb27f26-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:36:45 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a52c1160-164a-4623-861d-d0301f14b3eb tempest-CreateVolumesFromImageTest-76365343 None] Lock "cinder-7c4832f3-f0d9-4f3a-aef5-66066fb27f26-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:36:45 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a52c1160-164a-4623-861d-d0301f14b3eb tempest-CreateVolumesFromImageTest-76365343 None] Acquiring lock "cinder-quobyte-7c4832f3-f0d9-4f3a-aef5-66066fb27f26" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:36:45 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a52c1160-164a-4623-861d-d0301f14b3eb tempest-CreateVolumesFromImageTest-76365343 None] Lock "cinder-quobyte-7c4832f3-f0d9-4f3a-aef5-66066fb27f26" acquired by "delete_volume" :: waited 0.024s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:36:45 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-49e07411-99b1-4ee5-8d26-dec2f7e28688 tempest-CreateVolumesFromImageTest-76365343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.341s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:45 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-49e07411-99b1-4ee5-8d26-dec2f7e28688 tempest-CreateVolumesFromImageTest-76365343 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:36:45 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-49e07411-99b1-4ee5-8d26-dec2f7e28688 tempest-CreateVolumesFromImageTest-76365343 None] Deleted volume successfully. Nov 03 20:36:45 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb48fbff-cde0-4dfa-b5c1-11b720e7a7eb]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:36:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a52c1160-164a-4623-861d-d0301f14b3eb tempest-CreateVolumesFromImageTest-76365343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c4832f3-f0d9-4f3a-aef5-66066fb27f26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:45 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-49e07411-99b1-4ee5-8d26-dec2f7e28688 tempest-CreateVolumesFromImageTest-76365343 None] Lock "cinder-00f2a259-f415-4d82-bc00-94277189f276-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:36:45 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:45 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c4832f3-f0d9-4f3a-aef5-66066fb27f26 Nov 03 20:36:45 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-017530e8-ac7f-4d95-8701-1214f88487e8 tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619 1073741824" returned: 0 in 0.565s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-017530e8-ac7f-4d95-8701-1214f88487e8 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:45 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619 Nov 03 20:36:45 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:46 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a52c1160-164a-4623-861d-d0301f14b3eb tempest-CreateVolumesFromImageTest-76365343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c4832f3-f0d9-4f3a-aef5-66066fb27f26" returned: 0 in 0.441s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a52c1160-164a-4623-861d-d0301f14b3eb tempest-CreateVolumesFromImageTest-76365343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c4832f3-f0d9-4f3a-aef5-66066fb27f26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:46 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-017530e8-ac7f-4d95-8701-1214f88487e8 tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619" returned: 0 in 0.301s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-017530e8-ac7f-4d95-8701-1214f88487e8 tempest-ProjectMemberTests-196532882 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:36:46 devstack sudo[106270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c4832f3-f0d9-4f3a-aef5-66066fb27f26 Nov 03 20:36:46 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-017530e8-ac7f-4d95-8701-1214f88487e8 tempest-ProjectMemberTests-196532882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.964s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66722147-1a87-4ea3-8a00-ad6a4eabb698,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f848346580a54df58c4a8c3cf68ac3a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:36:42Z,use_quota=True,user_id='1aeb88b50a9e4479854e632344cfe13b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0b341fd-8b7e-41bd-9d3f-610c9cb3d35e),volume_type_id=a0b341fd-8b7e-41bd-9d3f-610c9cb3d35e)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Creating volume 66722147-1a87-4ea3-8a00-ad6a4eabb698 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:36:46 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-66722147-1a87-4ea3-8a00-ad6a4eabb698 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-017530e8-ac7f-4d95-8701-1214f88487e8 tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7402124-1170-4b7b-80e2-7e728e561e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-017530e8-ac7f-4d95-8701-1214f88487e8 tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80dd886d-e8a8-4c8b-9c66-94911ec72285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:46 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-66722147-1a87-4ea3-8a00-ad6a4eabb698 1073741824 Nov 03 20:36:46 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:46 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-017530e8-ac7f-4d95-8701-1214f88487e8 tempest-ProjectMemberTests-196532882 None] Volume volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619 (20c5bcaf-3702-4258-b5ea-9e8a22e2d619): created successfully Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-017530e8-ac7f-4d95-8701-1214f88487e8 tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80dd886d-e8a8-4c8b-9c66-94911ec72285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-017530e8-ac7f-4d95-8701-1214f88487e8 tempest-ProjectMemberTests-196532882 None] Flow 'volume_create_manager' (7e914be0-c1d3-458b-aaf8-281712bc63c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea4daf12-edb2-4f9d-a5f7-eebc9a913dc1 tempest-CreateVolumesFromSnapshotTest-997127146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ea4daf12-edb2-4f9d-a5f7-eebc9a913dc1 tempest-CreateVolumesFromSnapshotTest-997127146 None] Flow 'volume_create_manager' (12f42b1a-e86e-4761-b73a-d6dbbe7aa207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ea4daf12-edb2-4f9d-a5f7-eebc9a913dc1 tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b245e613-6c29-44f3-bac2-769beaa28857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:46 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-017530e8-ac7f-4d95-8701-1214f88487e8 tempest-ProjectMemberTests-196532882 None] Created volume successfully. Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ea4daf12-edb2-4f9d-a5f7-eebc9a913dc1 tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b245e613-6c29-44f3-bac2-769beaa28857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-482564627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cecc924-9318-449d-9da0-1c3c9d559e4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ffdf5a5e23f462ca0b62dd2e50cf772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:36:46Z,use_quota=True,user_id='030ae0218a734a249347affed5237da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ea4daf12-edb2-4f9d-a5f7-eebc9a913dc1 tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5d272f0-640c-49e9-a9e1-2b9dcb07b72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ea4daf12-edb2-4f9d-a5f7-eebc9a913dc1 tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5d272f0-640c-49e9-a9e1-2b9dcb07b72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ea4daf12-edb2-4f9d-a5f7-eebc9a913dc1 tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (618d0b1f-4bed-402b-aad2-ec733086fc08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ea4daf12-edb2-4f9d-a5f7-eebc9a913dc1 tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (618d0b1f-4bed-402b-aad2-ec733086fc08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cecc924-9318-449d-9da0-1c3c9d559e4d', 'volume_name': 'volume-5cecc924-9318-449d-9da0-1c3c9d559e4d', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ea4daf12-edb2-4f9d-a5f7-eebc9a913dc1 tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e81c226e-65d5-454f-a96b-7115878e1f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ea4daf12-edb2-4f9d-a5f7-eebc9a913dc1 tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e81c226e-65d5-454f-a96b-7115878e1f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ea4daf12-edb2-4f9d-a5f7-eebc9a913dc1 tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (480fa9cb-e41f-4c05-a507-64d700068a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:46 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-ea4daf12-edb2-4f9d-a5f7-eebc9a913dc1 tempest-CreateVolumesFromSnapshotTest-997127146 None] Volume 5cecc924-9318-449d-9da0-1c3c9d559e4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cecc924-9318-449d-9da0-1c3c9d559e4d', 'volume_size': 1} Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ea4daf12-edb2-4f9d-a5f7-eebc9a913dc1 tempest-CreateVolumesFromSnapshotTest-997127146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:46 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a52c1160-164a-4623-861d-d0301f14b3eb tempest-CreateVolumesFromImageTest-76365343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-7c4832f3-f0d9-4f3a-aef5-66066fb27f26" returned: 0 in 0.330s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a52c1160-164a-4623-861d-d0301f14b3eb tempest-CreateVolumesFromImageTest-76365343 None] Lock "cinder-quobyte-7c4832f3-f0d9-4f3a-aef5-66066fb27f26" released by "delete_volume" :: held 0.828s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-a52c1160-164a-4623-861d-d0301f14b3eb tempest-CreateVolumesFromImageTest-76365343 None] Created reservations ['f55e832e-d1b2-41cd-92f8-56b1f0158cb2', 'b5749a11-8e28-47a9-8347-202ba01bef6c', 'e34c18e5-e196-48fe-bc6f-4f7e65f8bdf4', '09439c1b-2040-4e1c-a7f9-880e0ae894a0'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a52c1160-164a-4623-861d-d0301f14b3eb tempest-CreateVolumesFromImageTest-76365343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a52c1160-164a-4623-861d-d0301f14b3eb tempest-CreateVolumesFromImageTest-76365343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a52c1160-164a-4623-861d-d0301f14b3eb tempest-CreateVolumesFromImageTest-76365343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a52c1160-164a-4623-861d-d0301f14b3eb tempest-CreateVolumesFromImageTest-76365343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a52c1160-164a-4623-861d-d0301f14b3eb tempest-CreateVolumesFromImageTest-76365343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a52c1160-164a-4623-861d-d0301f14b3eb tempest-CreateVolumesFromImageTest-76365343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-41cba369-5195-470e-970e-6990cecae69b tempest-CreateVolumesFromSnapshotTest-997127146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:36:46 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:36:46 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-41cba369-5195-470e-970e-6990cecae69b tempest-CreateVolumesFromSnapshotTest-997127146 None] Flow 'volume_create_manager' (ce1b51b4-65e8-411c-91d1-a692e861d061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-41cba369-5195-470e-970e-6990cecae69b tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c2e72be-bd3d-42a8-b822-644dabd14527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-41cba369-5195-470e-970e-6990cecae69b tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c2e72be-bd3d-42a8-b822-644dabd14527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-623635064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9544f357-1dd3-4b2f-ad07-6c0443901e7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ffdf5a5e23f462ca0b62dd2e50cf772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:36:47Z,use_quota=True,user_id='030ae0218a734a249347affed5237da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-41cba369-5195-470e-970e-6990cecae69b tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6104200b-6013-422e-8b9e-9e11d48426a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-41cba369-5195-470e-970e-6990cecae69b tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6104200b-6013-422e-8b9e-9e11d48426a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-41cba369-5195-470e-970e-6990cecae69b tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a393e90-1abd-435a-b583-4fe38c31461d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-41cba369-5195-470e-970e-6990cecae69b tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a393e90-1abd-435a-b583-4fe38c31461d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9544f357-1dd3-4b2f-ad07-6c0443901e7f', 'volume_name': 'volume-9544f357-1dd3-4b2f-ad07-6c0443901e7f', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-41cba369-5195-470e-970e-6990cecae69b tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4257dc9c-d564-481b-bb63-601c7dac780f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-41cba369-5195-470e-970e-6990cecae69b tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4257dc9c-d564-481b-bb63-601c7dac780f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-41cba369-5195-470e-970e-6990cecae69b tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8a031de-714d-47a6-84cf-966a526be01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:46 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-41cba369-5195-470e-970e-6990cecae69b tempest-CreateVolumesFromSnapshotTest-997127146 None] Volume 9544f357-1dd3-4b2f-ad07-6c0443901e7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9544f357-1dd3-4b2f-ad07-6c0443901e7f', 'volume_size': 1} Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-41cba369-5195-470e-970e-6990cecae69b tempest-CreateVolumesFromSnapshotTest-997127146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:46 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-66722147-1a87-4ea3-8a00-ad6a4eabb698 1073741824" returned: 0 in 0.705s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-66722147-1a87-4ea3-8a00-ad6a4eabb698 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:46 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-66722147-1a87-4ea3-8a00-ad6a4eabb698 Nov 03 20:36:46 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:47 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a52c1160-164a-4623-861d-d0301f14b3eb tempest-CreateVolumesFromImageTest-76365343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.386s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:47 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-a52c1160-164a-4623-861d-d0301f14b3eb tempest-CreateVolumesFromImageTest-76365343 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:36:47 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-a52c1160-164a-4623-861d-d0301f14b3eb tempest-CreateVolumesFromImageTest-76365343 None] Deleted volume successfully. Nov 03 20:36:47 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a52c1160-164a-4623-861d-d0301f14b3eb tempest-CreateVolumesFromImageTest-76365343 None] Lock "cinder-7c4832f3-f0d9-4f3a-aef5-66066fb27f26-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:36:47 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-08c95792-cb39-4264-ae9e-e79a1da78ae8 tempest-CreateVolumesFromImageTest-76365343 None] Acquiring lock "cinder-4340e647-b4cb-4802-bd80-9ea0432dfdfb-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:36:47 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-08c95792-cb39-4264-ae9e-e79a1da78ae8 tempest-CreateVolumesFromImageTest-76365343 None] Lock "cinder-4340e647-b4cb-4802-bd80-9ea0432dfdfb-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:36:47 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-66722147-1a87-4ea3-8a00-ad6a4eabb698" returned: 0 in 0.328s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:47 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:36:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ea4daf12-edb2-4f9d-a5f7-eebc9a913dc1 tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.846s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:47 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-ea4daf12-edb2-4f9d-a5f7-eebc9a913dc1 tempest-CreateVolumesFromSnapshotTest-997127146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-482564627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cecc924-9318-449d-9da0-1c3c9d559e4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ffdf5a5e23f462ca0b62dd2e50cf772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:36:46Z,use_quota=True,user_id='030ae0218a734a249347affed5237da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:36:47 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-ea4daf12-edb2-4f9d-a5f7-eebc9a913dc1 tempest-CreateVolumesFromSnapshotTest-997127146 None] Creating volume 5cecc924-9318-449d-9da0-1c3c9d559e4d {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:36:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ea4daf12-edb2-4f9d-a5f7-eebc9a913dc1 tempest-CreateVolumesFromSnapshotTest-997127146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ea4daf12-edb2-4f9d-a5f7-eebc9a913dc1 tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:47 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-ea4daf12-edb2-4f9d-a5f7-eebc9a913dc1 tempest-CreateVolumesFromSnapshotTest-997127146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:36:47 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-ea4daf12-edb2-4f9d-a5f7-eebc9a913dc1 tempest-CreateVolumesFromSnapshotTest-997127146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:36:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ea4daf12-edb2-4f9d-a5f7-eebc9a913dc1 tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:47 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-ea4daf12-edb2-4f9d-a5f7-eebc9a913dc1 tempest-CreateVolumesFromSnapshotTest-997127146 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:36:47 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-ea4daf12-edb2-4f9d-a5f7-eebc9a913dc1 tempest-CreateVolumesFromSnapshotTest-997127146 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:36:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ea4daf12-edb2-4f9d-a5f7-eebc9a913dc1 tempest-CreateVolumesFromSnapshotTest-997127146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5cecc924-9318-449d-9da0-1c3c9d559e4d 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:47 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5cecc924-9318-449d-9da0-1c3c9d559e4d 1073741824 Nov 03 20:36:47 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:47 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-08c95792-cb39-4264-ae9e-e79a1da78ae8 tempest-CreateVolumesFromImageTest-76365343 None] Acquiring lock "cinder-quobyte-4340e647-b4cb-4802-bd80-9ea0432dfdfb" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:36:47 devstack cinder-volume[87248]: DEBUG cinder.volume.volume_utils [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Attempting download of dac53d33-3fc1-4df7-91d0-ec5e4b08e676 ((None, [{'url': 'file:///opt/stack/data/glance/images/dac53d33-3fc1-4df7-91d0-ec5e4b08e676', 'metadata': {}}])) to volume 66722147-1a87-4ea3-8a00-ad6a4eabb698. {{(pid=87248) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 20:36:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b2d590c9-cf57-4c9d-b5f7-e60fed94d913 tempest-ProjectMemberTests-196532882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:47 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-08c95792-cb39-4264-ae9e-e79a1da78ae8 tempest-CreateVolumesFromImageTest-76365343 None] Lock "cinder-quobyte-4340e647-b4cb-4802-bd80-9ea0432dfdfb" acquired by "delete_volume" :: waited 0.038s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:36:47 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b312aba-c90c-440f-8ef1-c4600a01272c tempest-CreateVolumesFromSnapshotTest-997127146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:36:47 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2b312aba-c90c-440f-8ef1-c4600a01272c tempest-CreateVolumesFromSnapshotTest-997127146 None] Flow 'volume_create_manager' (9e2b658e-0825-4110-9a12-b90b536f8bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:36:47 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2b312aba-c90c-440f-8ef1-c4600a01272c tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1abdd63-51ce-4870-90fe-4d9b2601cf1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:47 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0ff4b0-9a52-469b-9377-784bbc4dbc13]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:36:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-08c95792-cb39-4264-ae9e-e79a1da78ae8 tempest-CreateVolumesFromImageTest-76365343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4340e647-b4cb-4802-bd80-9ea0432dfdfb {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:47 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[c001d7f6-6bc7-4128-b02f-607c4faf073f]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:36:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dac53d33-3fc1-4df7-91d0-ec5e4b08e676_xwof20gs {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:47 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2b312aba-c90c-440f-8ef1-c4600a01272c tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1abdd63-51ce-4870-90fe-4d9b2601cf1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1158975145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8cedc44-149a-49a4-aee6-fc4c3db01a69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ffdf5a5e23f462ca0b62dd2e50cf772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:36:47Z,use_quota=True,user_id='030ae0218a734a249347affed5237da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:47 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2b312aba-c90c-440f-8ef1-c4600a01272c tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7545736-6e8c-4b44-8797-afe59ba52a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:47 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2b312aba-c90c-440f-8ef1-c4600a01272c tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7545736-6e8c-4b44-8797-afe59ba52a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:47 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2b312aba-c90c-440f-8ef1-c4600a01272c tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f43d5a1c-e52c-48c6-a30a-32b2b5754f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:47 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2b312aba-c90c-440f-8ef1-c4600a01272c tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f43d5a1c-e52c-48c6-a30a-32b2b5754f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8cedc44-149a-49a4-aee6-fc4c3db01a69', 'volume_name': 'volume-f8cedc44-149a-49a4-aee6-fc4c3db01a69', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:47 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2b312aba-c90c-440f-8ef1-c4600a01272c tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (890f361e-9c22-4e09-a2ca-5a19f81f6874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:47 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2b312aba-c90c-440f-8ef1-c4600a01272c tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (890f361e-9c22-4e09-a2ca-5a19f81f6874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:47 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2b312aba-c90c-440f-8ef1-c4600a01272c tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d55c46a-1b0d-408c-b222-43763329401e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:47 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-2b312aba-c90c-440f-8ef1-c4600a01272c tempest-CreateVolumesFromSnapshotTest-997127146 None] Volume f8cedc44-149a-49a4-aee6-fc4c3db01a69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8cedc44-149a-49a4-aee6-fc4c3db01a69', 'volume_size': 1} Nov 03 20:36:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2b312aba-c90c-440f-8ef1-c4600a01272c tempest-CreateVolumesFromSnapshotTest-997127146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:47 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4340e647-b4cb-4802-bd80-9ea0432dfdfb Nov 03 20:36:47 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:47 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dac53d33-3fc1-4df7-91d0-ec5e4b08e676_xwof20gs Nov 03 20:36:47 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:47 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ea4daf12-edb2-4f9d-a5f7-eebc9a913dc1 tempest-CreateVolumesFromSnapshotTest-997127146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5cecc924-9318-449d-9da0-1c3c9d559e4d 1073741824" returned: 0 in 0.580s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ea4daf12-edb2-4f9d-a5f7-eebc9a913dc1 tempest-CreateVolumesFromSnapshotTest-997127146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5cecc924-9318-449d-9da0-1c3c9d559e4d {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:47 devstack sudo[106297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5cecc924-9318-449d-9da0-1c3c9d559e4d Nov 03 20:36:47 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:47 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dac53d33-3fc1-4df7-91d0-ec5e4b08e676_xwof20gs" returned: 0 in 0.478s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dac53d33-3fc1-4df7-91d0-ec5e4b08e676_xwof20gs {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:48 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-08c95792-cb39-4264-ae9e-e79a1da78ae8 tempest-CreateVolumesFromImageTest-76365343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4340e647-b4cb-4802-bd80-9ea0432dfdfb" returned: 0 in 0.555s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-08c95792-cb39-4264-ae9e-e79a1da78ae8 tempest-CreateVolumesFromImageTest-76365343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4340e647-b4cb-4802-bd80-9ea0432dfdfb {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-35d9bdce-a1b0-4602-9756-6619787b9f31 tempest-CreateVolumesFromSnapshotTest-997127146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:36:48 devstack sudo[106303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4340e647-b4cb-4802-bd80-9ea0432dfdfb Nov 03 20:36:48 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-35d9bdce-a1b0-4602-9756-6619787b9f31 tempest-CreateVolumesFromSnapshotTest-997127146 None] Flow 'volume_create_manager' (a3691881-eb92-4c33-a583-3b82fadfcf37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-35d9bdce-a1b0-4602-9756-6619787b9f31 tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0929a44f-6fdb-4d3e-9a49-6bd39b0dc823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:48 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dac53d33-3fc1-4df7-91d0-ec5e4b08e676_xwof20gs Nov 03 20:36:48 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-35d9bdce-a1b0-4602-9756-6619787b9f31 tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0929a44f-6fdb-4d3e-9a49-6bd39b0dc823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1999111342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e22b4d2-9075-4999-805f-4ff3fca4028e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ffdf5a5e23f462ca0b62dd2e50cf772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:36:48Z,use_quota=True,user_id='030ae0218a734a249347affed5237da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-35d9bdce-a1b0-4602-9756-6619787b9f31 tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a10559d-91c5-4b84-89dd-6644f4e5ccb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-35d9bdce-a1b0-4602-9756-6619787b9f31 tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a10559d-91c5-4b84-89dd-6644f4e5ccb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-35d9bdce-a1b0-4602-9756-6619787b9f31 tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5054821-97ea-45ee-8e90-cd2761596f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-35d9bdce-a1b0-4602-9756-6619787b9f31 tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5054821-97ea-45ee-8e90-cd2761596f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e22b4d2-9075-4999-805f-4ff3fca4028e', 'volume_name': 'volume-3e22b4d2-9075-4999-805f-4ff3fca4028e', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-35d9bdce-a1b0-4602-9756-6619787b9f31 tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ea7ae36-166e-4a5f-bb58-56ac0bfd85a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-35d9bdce-a1b0-4602-9756-6619787b9f31 tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ea7ae36-166e-4a5f-bb58-56ac0bfd85a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-35d9bdce-a1b0-4602-9756-6619787b9f31 tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee0d5184-be6c-435c-a2ab-ec8989c6c4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:48 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-35d9bdce-a1b0-4602-9756-6619787b9f31 tempest-CreateVolumesFromSnapshotTest-997127146 None] Volume 3e22b4d2-9075-4999-805f-4ff3fca4028e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e22b4d2-9075-4999-805f-4ff3fca4028e', 'volume_size': 1} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-35d9bdce-a1b0-4602-9756-6619787b9f31 tempest-CreateVolumesFromSnapshotTest-997127146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:48 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ea4daf12-edb2-4f9d-a5f7-eebc9a913dc1 tempest-CreateVolumesFromSnapshotTest-997127146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5cecc924-9318-449d-9da0-1c3c9d559e4d" returned: 0 in 0.403s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-ea4daf12-edb2-4f9d-a5f7-eebc9a913dc1 tempest-CreateVolumesFromSnapshotTest-997127146 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ea4daf12-edb2-4f9d-a5f7-eebc9a913dc1 tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-41cba369-5195-470e-970e-6990cecae69b tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.482s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-41cba369-5195-470e-970e-6990cecae69b tempest-CreateVolumesFromSnapshotTest-997127146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-623635064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9544f357-1dd3-4b2f-ad07-6c0443901e7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ffdf5a5e23f462ca0b62dd2e50cf772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:36:47Z,use_quota=True,user_id='030ae0218a734a249347affed5237da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-41cba369-5195-470e-970e-6990cecae69b tempest-CreateVolumesFromSnapshotTest-997127146 None] Creating volume 9544f357-1dd3-4b2f-ad07-6c0443901e7f {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-41cba369-5195-470e-970e-6990cecae69b tempest-CreateVolumesFromSnapshotTest-997127146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-41cba369-5195-470e-970e-6990cecae69b tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-41cba369-5195-470e-970e-6990cecae69b tempest-CreateVolumesFromSnapshotTest-997127146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-41cba369-5195-470e-970e-6990cecae69b tempest-CreateVolumesFromSnapshotTest-997127146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-41cba369-5195-470e-970e-6990cecae69b tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-41cba369-5195-470e-970e-6990cecae69b tempest-CreateVolumesFromSnapshotTest-997127146 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:36:48 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-41cba369-5195-470e-970e-6990cecae69b tempest-CreateVolumesFromSnapshotTest-997127146 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-41cba369-5195-470e-970e-6990cecae69b tempest-CreateVolumesFromSnapshotTest-997127146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-9544f357-1dd3-4b2f-ad07-6c0443901e7f 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ea4daf12-edb2-4f9d-a5f7-eebc9a913dc1 tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (480fa9cb-e41f-4c05-a507-64d700068a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cecc924-9318-449d-9da0-1c3c9d559e4d', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:48 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-9544f357-1dd3-4b2f-ad07-6c0443901e7f 1073741824 Nov 03 20:36:48 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ea4daf12-edb2-4f9d-a5f7-eebc9a913dc1 tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5817720e-573f-487d-b1c5-6ec6ffd2857b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:48 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-ea4daf12-edb2-4f9d-a5f7-eebc9a913dc1 tempest-CreateVolumesFromSnapshotTest-997127146 None] Volume volume-5cecc924-9318-449d-9da0-1c3c9d559e4d (5cecc924-9318-449d-9da0-1c3c9d559e4d): created successfully Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ea4daf12-edb2-4f9d-a5f7-eebc9a913dc1 tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5817720e-573f-487d-b1c5-6ec6ffd2857b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ea4daf12-edb2-4f9d-a5f7-eebc9a913dc1 tempest-CreateVolumesFromSnapshotTest-997127146 None] Flow 'volume_create_manager' (12f42b1a-e86e-4761-b73a-d6dbbe7aa207) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:36:48 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:48 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:48 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-ea4daf12-edb2-4f9d-a5f7-eebc9a913dc1 tempest-CreateVolumesFromSnapshotTest-997127146 None] Created volume successfully. Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-08c95792-cb39-4264-ae9e-e79a1da78ae8 tempest-CreateVolumesFromImageTest-76365343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-4340e647-b4cb-4802-bd80-9ea0432dfdfb" returned: 0 in 0.464s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dac53d33-3fc1-4df7-91d0-ec5e4b08e676_xwof20gs" returned: 1 in 0.532s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dac53d33-3fc1-4df7-91d0-ec5e4b08e676_xwof20gs' failed. Not Retrying. {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[749278e0-f8a1-478a-af62-aadfd4b70a43]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dac53d33-3fc1-4df7-91d0-ec5e4b08e676_uizb12rgdevstack@QuobyteHD {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-08c95792-cb39-4264-ae9e-e79a1da78ae8 tempest-CreateVolumesFromImageTest-76365343 None] Lock "cinder-quobyte-4340e647-b4cb-4802-bd80-9ea0432dfdfb" released by "delete_volume" :: held 1.124s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-2648e81c-21a3-4d29-b69c-200249cbd065 tempest-CreateVolumesFromSnapshotTest-997127146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2648e81c-21a3-4d29-b69c-200249cbd065 tempest-CreateVolumesFromSnapshotTest-997127146 None] Flow 'volume_create_manager' (92712326-87fb-4472-9074-18d70d6a1751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2648e81c-21a3-4d29-b69c-200249cbd065 tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41562be7-3c31-4409-97a9-8803058dcb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2648e81c-21a3-4d29-b69c-200249cbd065 tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41562be7-3c31-4409-97a9-8803058dcb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1601259746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=802e1060-f7c2-4efa-880a-1d3a537d9ab9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ffdf5a5e23f462ca0b62dd2e50cf772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:36:48Z,use_quota=True,user_id='030ae0218a734a249347affed5237da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2648e81c-21a3-4d29-b69c-200249cbd065 tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d641ea6f-1e26-4e92-96fc-22b16352fa6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2648e81c-21a3-4d29-b69c-200249cbd065 tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d641ea6f-1e26-4e92-96fc-22b16352fa6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2648e81c-21a3-4d29-b69c-200249cbd065 tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21d3b4f1-a16e-4f59-a327-c398b23b3959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2648e81c-21a3-4d29-b69c-200249cbd065 tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21d3b4f1-a16e-4f59-a327-c398b23b3959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '802e1060-f7c2-4efa-880a-1d3a537d9ab9', 'volume_name': 'volume-802e1060-f7c2-4efa-880a-1d3a537d9ab9', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2648e81c-21a3-4d29-b69c-200249cbd065 tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8585000-22b2-4c7c-8fab-153710d7575c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2648e81c-21a3-4d29-b69c-200249cbd065 tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8585000-22b2-4c7c-8fab-153710d7575c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:48 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dac53d33-3fc1-4df7-91d0-ec5e4b08e676_uizb12rgdevstack@QuobyteHD Nov 03 20:36:48 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2648e81c-21a3-4d29-b69c-200249cbd065 tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70b33c6b-3aa5-4c0e-a6bc-11785f152053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:48 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-2648e81c-21a3-4d29-b69c-200249cbd065 tempest-CreateVolumesFromSnapshotTest-997127146 None] Volume 802e1060-f7c2-4efa-880a-1d3a537d9ab9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-802e1060-f7c2-4efa-880a-1d3a537d9ab9', 'volume_size': 1} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2648e81c-21a3-4d29-b69c-200249cbd065 tempest-CreateVolumesFromSnapshotTest-997127146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-08c95792-cb39-4264-ae9e-e79a1da78ae8 tempest-CreateVolumesFromImageTest-76365343 None] Created reservations ['c6c8cbfd-6374-4a8f-825b-82dfb173448b', 'cc823586-e798-425b-883b-e8f18d2aa539', '5c1113c2-1bda-461e-a1e4-a87a0fc92058', '92ea96a5-389d-4511-9fd6-9b5821c97e13'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-08c95792-cb39-4264-ae9e-e79a1da78ae8 tempest-CreateVolumesFromImageTest-76365343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-08c95792-cb39-4264-ae9e-e79a1da78ae8 tempest-CreateVolumesFromImageTest-76365343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-08c95792-cb39-4264-ae9e-e79a1da78ae8 tempest-CreateVolumesFromImageTest-76365343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-08c95792-cb39-4264-ae9e-e79a1da78ae8 tempest-CreateVolumesFromImageTest-76365343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-08c95792-cb39-4264-ae9e-e79a1da78ae8 tempest-CreateVolumesFromImageTest-76365343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-08c95792-cb39-4264-ae9e-e79a1da78ae8 tempest-CreateVolumesFromImageTest-76365343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:48 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:36:48 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:48 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-41cba369-5195-470e-970e-6990cecae69b tempest-CreateVolumesFromSnapshotTest-997127146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-9544f357-1dd3-4b2f-ad07-6c0443901e7f 1073741824" returned: 0 in 0.522s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:48 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dac53d33-3fc1-4df7-91d0-ec5e4b08e676_uizb12rgdevstack@QuobyteHD" returned: 0 in 0.378s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dac53d33-3fc1-4df7-91d0-ec5e4b08e676_uizb12rgdevstack@QuobyteHD {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-41cba369-5195-470e-970e-6990cecae69b tempest-CreateVolumesFromSnapshotTest-997127146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-9544f357-1dd3-4b2f-ad07-6c0443901e7f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:48 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-9544f357-1dd3-4b2f-ad07-6c0443901e7f Nov 03 20:36:48 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:49 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dac53d33-3fc1-4df7-91d0-ec5e4b08e676_uizb12rgdevstack@QuobyteHD Nov 03 20:36:49 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:49 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-08c95792-cb39-4264-ae9e-e79a1da78ae8 tempest-CreateVolumesFromImageTest-76365343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.266s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:49 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-08c95792-cb39-4264-ae9e-e79a1da78ae8 tempest-CreateVolumesFromImageTest-76365343 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:36:49 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-08c95792-cb39-4264-ae9e-e79a1da78ae8 tempest-CreateVolumesFromImageTest-76365343 None] Deleted volume successfully. Nov 03 20:36:49 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-08c95792-cb39-4264-ae9e-e79a1da78ae8 tempest-CreateVolumesFromImageTest-76365343 None] Lock "cinder-4340e647-b4cb-4802-bd80-9ea0432dfdfb-delete_volume" released by "delete_volume" :: held 1.836s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:36:49 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-41cba369-5195-470e-970e-6990cecae69b tempest-CreateVolumesFromSnapshotTest-997127146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-9544f357-1dd3-4b2f-ad07-6c0443901e7f" returned: 0 in 0.266s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:49 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-41cba369-5195-470e-970e-6990cecae69b tempest-CreateVolumesFromSnapshotTest-997127146 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:36:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-41cba369-5195-470e-970e-6990cecae69b tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b2d590c9-cf57-4c9d-b5f7-e60fed94d913 tempest-ProjectMemberTests-196532882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.812s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:49 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-41cba369-5195-470e-970e-6990cecae69b tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8a031de-714d-47a6-84cf-966a526be01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9544f357-1dd3-4b2f-ad07-6c0443901e7f', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:49 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-41cba369-5195-470e-970e-6990cecae69b tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e37c2fb-1dcb-4ad7-8388-515dd36de0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:49 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dac53d33-3fc1-4df7-91d0-ec5e4b08e676_uizb12rgdevstack@QuobyteHD" returned: 1 in 0.339s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dac53d33-3fc1-4df7-91d0-ec5e4b08e676_uizb12rgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 20:36:49 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] dac53d33-3fc1-4df7-91d0-ec5e4b08e676 was raw, converting to qcow2 {{(pid=87248) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 20:36:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_dac53d33-3fc1-4df7-91d0-ec5e4b08e676_uizb12rgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-66722147-1a87-4ea3-8a00-ad6a4eabb698 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:49 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-b2d590c9-cf57-4c9d-b5f7-e60fed94d913 tempest-ProjectMemberTests-196532882 None] Creating offline snapshot 33d73862-d14e-4104-80b8-bf604e175052 of volume 20c5bcaf-3702-4258-b5ea-9e8a22e2d619 {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:36:49 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_dac53d33-3fc1-4df7-91d0-ec5e4b08e676_uizb12rgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-66722147-1a87-4ea3-8a00-ad6a4eabb698 Nov 03 20:36:49 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:49 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-41cba369-5195-470e-970e-6990cecae69b tempest-CreateVolumesFromSnapshotTest-997127146 None] Volume volume-9544f357-1dd3-4b2f-ad07-6c0443901e7f (9544f357-1dd3-4b2f-ad07-6c0443901e7f): created successfully Nov 03 20:36:49 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-41cba369-5195-470e-970e-6990cecae69b tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e37c2fb-1dcb-4ad7-8388-515dd36de0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:49 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-41cba369-5195-470e-970e-6990cecae69b tempest-CreateVolumesFromSnapshotTest-997127146 None] Flow 'volume_create_manager' (ce1b51b4-65e8-411c-91d1-a692e861d061) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:36:49 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[04651b90-c3e6-4074-9bb6-6ddfb064360a]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:36:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b2d590c9-cf57-4c9d-b5f7-e60fed94d913 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:49 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-41cba369-5195-470e-970e-6990cecae69b tempest-CreateVolumesFromSnapshotTest-997127146 None] Created volume successfully. Nov 03 20:36:49 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619 Nov 03 20:36:49 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:49 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1f555030-8ea2-4086-892d-8c467b254beb tempest-CreateVolumesFromImageTest-76365343 None] Acquiring lock "cinder-db5c74d3-faf3-41fb-820f-620f8bfae493-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:36:49 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1f555030-8ea2-4086-892d-8c467b254beb tempest-CreateVolumesFromImageTest-76365343 None] Lock "cinder-db5c74d3-faf3-41fb-820f-620f8bfae493-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:36:49 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1f555030-8ea2-4086-892d-8c467b254beb tempest-CreateVolumesFromImageTest-76365343 None] Acquiring lock "cinder-quobyte-db5c74d3-faf3-41fb-820f-620f8bfae493" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:36:49 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1f555030-8ea2-4086-892d-8c467b254beb tempest-CreateVolumesFromImageTest-76365343 None] Lock "cinder-quobyte-db5c74d3-faf3-41fb-820f-620f8bfae493" acquired by "delete_volume" :: waited 0.018s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:36:49 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[7917ca49-dde0-4ac6-abdc-d3124131ce4f]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:36:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1f555030-8ea2-4086-892d-8c467b254beb tempest-CreateVolumesFromImageTest-76365343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-db5c74d3-faf3-41fb-820f-620f8bfae493 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:49 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b2d590c9-cf57-4c9d-b5f7-e60fed94d913 tempest-ProjectMemberTests-196532882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619" returned: 0 in 0.467s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b2d590c9-cf57-4c9d-b5f7-e60fed94d913 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619.33d73862-d14e-4104-80b8-bf604e175052 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:49 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619.33d73862-d14e-4104-80b8-bf604e175052 1G Nov 03 20:36:49 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:49 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_dac53d33-3fc1-4df7-91d0-ec5e4b08e676_uizb12rgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-66722147-1a87-4ea3-8a00-ad6a4eabb698" returned: 0 in 0.578s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:49 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dac53d33-3fc1-4df7-91d0-ec5e4b08e676_uizb12rgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-66722147-1a87-4ea3-8a00-ad6a4eabb698 {{(pid=87248) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:36:49 devstack cinder-volume[87248]: INFO cinder.image.image_utils [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 20:36:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-66722147-1a87-4ea3-8a00-ad6a4eabb698 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:49 devstack sudo[106342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-db5c74d3-faf3-41fb-820f-620f8bfae493 Nov 03 20:36:49 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:49 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-66722147-1a87-4ea3-8a00-ad6a4eabb698 1G Nov 03 20:36:49 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:50 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1f555030-8ea2-4086-892d-8c467b254beb tempest-CreateVolumesFromImageTest-76365343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-db5c74d3-faf3-41fb-820f-620f8bfae493" returned: 0 in 0.381s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1f555030-8ea2-4086-892d-8c467b254beb tempest-CreateVolumesFromImageTest-76365343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-db5c74d3-faf3-41fb-820f-620f8bfae493 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:50 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-db5c74d3-faf3-41fb-820f-620f8bfae493 Nov 03 20:36:50 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:50 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-66722147-1a87-4ea3-8a00-ad6a4eabb698 1G" returned: 0 in 0.344s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:50 devstack cinder-volume[87248]: DEBUG cinder.volume.volume_utils [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Downloaded image dac53d33-3fc1-4df7-91d0-ec5e4b08e676 ((None, [{'url': 'file:///opt/stack/data/glance/images/dac53d33-3fc1-4df7-91d0-ec5e4b08e676', 'metadata': {}}])) to volume 66722147-1a87-4ea3-8a00-ad6a4eabb698 successfully. {{(pid=87248) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 20:36:50 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Temporary image dac53d33-3fc1-4df7-91d0-ec5e4b08e676 for user 1aeb88b50a9e4479854e632344cfe13b is deleted. {{(pid=87248) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 20:36:50 devstack cinder-volume[87248]: DEBUG cinder.volume.volume_utils [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Marking volume 66722147-1a87-4ea3-8a00-ad6a4eabb698 as bootable. {{(pid=87248) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 20:36:50 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Copying metadata from image dac53d33-3fc1-4df7-91d0-ec5e4b08e676 to 66722147-1a87-4ea3-8a00-ad6a4eabb698. {{(pid=87248) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 20:36:50 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Creating volume glance metadata for volume 66722147-1a87-4ea3-8a00-ad6a4eabb698 backed by image dac53d33-3fc1-4df7-91d0-ec5e4b08e676 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'dac53d33-3fc1-4df7-91d0-ec5e4b08e676', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '02a191c9d5b3b6c2fb028cb26d7dda26', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87248) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 20:36:50 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b2d590c9-cf57-4c9d-b5f7-e60fed94d913 tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619.33d73862-d14e-4104-80b8-bf604e175052 1G" returned: 0 in 0.447s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b2d590c9-cf57-4c9d-b5f7-e60fed94d913 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619.33d73862-d14e-4104-80b8-bf604e175052 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:50 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619.33d73862-d14e-4104-80b8-bf604e175052 Nov 03 20:36:50 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:50 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f1a7f09-62fd-43e9-b86f-b185b673c83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66722147-1a87-4ea3-8a00-ad6a4eabb698', 'volume_size': 1, 'image_id': 'dac53d33-3fc1-4df7-91d0-ec5e4b08e676', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dac53d33-3fc1-4df7-91d0-ec5e4b08e676', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '02a191c9d5b3b6c2fb028cb26d7dda26', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f848346580a54df58c4a8c3cf68ac3a9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '849e612bfcbef8460fe683497d17e70ed177b6debb2952025a66d50f7b203eafdc5ffb7757f3e48b98192285ef6e3e1417258130c30de2261c1efdf42896b22f', 'id': 'dac53d33-3fc1-4df7-91d0-ec5e4b08e676', 'created_at': datetime.datetime(2026, 11, 3, 19, 36, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 36, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dac53d33-3fc1-4df7-91d0-ec5e4b08e676/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:50 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21eb438a-7591-4902-beca-e2ee309c992b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:50 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Volume volume-66722147-1a87-4ea3-8a00-ad6a4eabb698 (66722147-1a87-4ea3-8a00-ad6a4eabb698): created successfully Nov 03 20:36:50 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21eb438a-7591-4902-beca-e2ee309c992b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:50 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Flow 'volume_create_manager' (cbc0d7d1-f391-47f1-8291-7f41f2e1cb74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:36:50 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-cb00533d-6947-4d08-803f-dc054bef1ffe tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Created volume successfully. Nov 03 20:36:50 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1f555030-8ea2-4086-892d-8c467b254beb tempest-CreateVolumesFromImageTest-76365343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-db5c74d3-faf3-41fb-820f-620f8bfae493" returned: 0 in 0.269s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:50 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1f555030-8ea2-4086-892d-8c467b254beb tempest-CreateVolumesFromImageTest-76365343 None] Lock "cinder-quobyte-db5c74d3-faf3-41fb-820f-620f8bfae493" released by "delete_volume" :: held 0.696s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:36:50 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-1f555030-8ea2-4086-892d-8c467b254beb tempest-CreateVolumesFromImageTest-76365343 None] Created reservations ['88059eab-9c7f-4e37-9eef-8c7b08451998', '29a79129-15b1-4ffb-b02e-0fa8631015cb', 'bff34b6e-7f8e-4d26-a05e-b2197433333f', '343be427-551d-49b2-940c-c0d9c6710566'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:36:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1f555030-8ea2-4086-892d-8c467b254beb tempest-CreateVolumesFromImageTest-76365343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1f555030-8ea2-4086-892d-8c467b254beb tempest-CreateVolumesFromImageTest-76365343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:50 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-1f555030-8ea2-4086-892d-8c467b254beb tempest-CreateVolumesFromImageTest-76365343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:36:50 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-1f555030-8ea2-4086-892d-8c467b254beb tempest-CreateVolumesFromImageTest-76365343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:36:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1f555030-8ea2-4086-892d-8c467b254beb tempest-CreateVolumesFromImageTest-76365343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1f555030-8ea2-4086-892d-8c467b254beb tempest-CreateVolumesFromImageTest-76365343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:50 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b2d590c9-cf57-4c9d-b5f7-e60fed94d913 tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619.33d73862-d14e-4104-80b8-bf604e175052" returned: 0 in 0.351s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:50 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-b2d590c9-cf57-4c9d-b5f7-e60fed94d913 tempest-ProjectMemberTests-196532882 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619.33d73862-d14e-4104-80b8-bf604e175052 is being set with open permissions: ugo+rw Nov 03 20:36:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b2d590c9-cf57-4c9d-b5f7-e60fed94d913 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619.33d73862-d14e-4104-80b8-bf604e175052 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:50 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:36:50 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:50 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619.33d73862-d14e-4104-80b8-bf604e175052 Nov 03 20:36:50 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:50 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b3adf10f-52d6-4e18-9017-780bf17fe253 tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Acquiring lock "cinder-66722147-1a87-4ea3-8a00-ad6a4eabb698-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:36:50 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b3adf10f-52d6-4e18-9017-780bf17fe253 tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Lock "cinder-66722147-1a87-4ea3-8a00-ad6a4eabb698-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:36:50 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b3adf10f-52d6-4e18-9017-780bf17fe253 tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Acquiring lock "cinder-quobyte-66722147-1a87-4ea3-8a00-ad6a4eabb698" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:36:50 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b3adf10f-52d6-4e18-9017-780bf17fe253 tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Lock "cinder-quobyte-66722147-1a87-4ea3-8a00-ad6a4eabb698" acquired by "delete_volume" :: waited 0.034s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:36:50 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9be0057-001e-416f-b320-d44a43eacd28]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:36:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b3adf10f-52d6-4e18-9017-780bf17fe253 tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-66722147-1a87-4ea3-8a00-ad6a4eabb698 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:50 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e71ed19d-7b89-4c4d-a73b-5aaebf955599 tempest-CreateVolumesFromImageTest-76365343 None] Acquiring lock "cinder-a5c7f14c-d804-40ce-b852-32abbdd357ea-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:36:50 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e71ed19d-7b89-4c4d-a73b-5aaebf955599 tempest-CreateVolumesFromImageTest-76365343 None] Lock "cinder-a5c7f14c-d804-40ce-b852-32abbdd357ea-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:36:50 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1f555030-8ea2-4086-892d-8c467b254beb tempest-CreateVolumesFromImageTest-76365343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.296s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:50 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-1f555030-8ea2-4086-892d-8c467b254beb tempest-CreateVolumesFromImageTest-76365343 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:36:50 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-1f555030-8ea2-4086-892d-8c467b254beb tempest-CreateVolumesFromImageTest-76365343 None] Deleted volume successfully. Nov 03 20:36:50 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1f555030-8ea2-4086-892d-8c467b254beb tempest-CreateVolumesFromImageTest-76365343 None] Lock "cinder-db5c74d3-faf3-41fb-820f-620f8bfae493-delete_volume" released by "delete_volume" :: held 1.262s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:36:50 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e71ed19d-7b89-4c4d-a73b-5aaebf955599 tempest-CreateVolumesFromImageTest-76365343 None] Acquiring lock "cinder-quobyte-a5c7f14c-d804-40ce-b852-32abbdd357ea" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:36:50 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-66722147-1a87-4ea3-8a00-ad6a4eabb698 Nov 03 20:36:50 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:50 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e71ed19d-7b89-4c4d-a73b-5aaebf955599 tempest-CreateVolumesFromImageTest-76365343 None] Lock "cinder-quobyte-a5c7f14c-d804-40ce-b852-32abbdd357ea" acquired by "delete_volume" :: waited 0.027s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:36:50 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70432e7-a976-4f8b-8a0e-62281554b364]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:36:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e71ed19d-7b89-4c4d-a73b-5aaebf955599 tempest-CreateVolumesFromImageTest-76365343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-a5c7f14c-d804-40ce-b852-32abbdd357ea {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:50 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b2d590c9-cf57-4c9d-b5f7-e60fed94d913 tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619.33d73862-d14e-4104-80b8-bf604e175052" returned: 0 in 0.390s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b2d590c9-cf57-4c9d-b5f7-e60fed94d913 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:51 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619.info Nov 03 20:36:51 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:51 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-a5c7f14c-d804-40ce-b852-32abbdd357ea Nov 03 20:36:51 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:51 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b3adf10f-52d6-4e18-9017-780bf17fe253 tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-66722147-1a87-4ea3-8a00-ad6a4eabb698" returned: 0 in 0.418s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b3adf10f-52d6-4e18-9017-780bf17fe253 tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-66722147-1a87-4ea3-8a00-ad6a4eabb698 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:51 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-66722147-1a87-4ea3-8a00-ad6a4eabb698 Nov 03 20:36:51 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:51 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b2d590c9-cf57-4c9d-b5f7-e60fed94d913 tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619.info" returned: 0 in 0.286s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:51 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-b2d590c9-cf57-4c9d-b5f7-e60fed94d913 tempest-ProjectMemberTests-196532882 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619.info is being set with open permissions: ugo+rw Nov 03 20:36:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b2d590c9-cf57-4c9d-b5f7-e60fed94d913 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:51 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619.info Nov 03 20:36:51 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:51 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e71ed19d-7b89-4c4d-a73b-5aaebf955599 tempest-CreateVolumesFromImageTest-76365343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-a5c7f14c-d804-40ce-b852-32abbdd357ea" returned: 0 in 0.411s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e71ed19d-7b89-4c4d-a73b-5aaebf955599 tempest-CreateVolumesFromImageTest-76365343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-a5c7f14c-d804-40ce-b852-32abbdd357ea {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:51 devstack sudo[106391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-a5c7f14c-d804-40ce-b852-32abbdd357ea Nov 03 20:36:51 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:51 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b3adf10f-52d6-4e18-9017-780bf17fe253 tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-66722147-1a87-4ea3-8a00-ad6a4eabb698" returned: 0 in 0.278s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:51 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b3adf10f-52d6-4e18-9017-780bf17fe253 tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Lock "cinder-quobyte-66722147-1a87-4ea3-8a00-ad6a4eabb698" released by "delete_volume" :: held 0.774s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:36:51 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-b3adf10f-52d6-4e18-9017-780bf17fe253 tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Created reservations ['82367cdc-7463-4985-b044-5d828dde06d7', 'c27156c8-2fb3-43a9-bada-90071d68d664', '01c16dd4-7ecf-414d-bd7e-4e0a90c7bf69', '3cb382da-cdef-4614-aadc-dbbe83d60f4c'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:36:51 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b2d590c9-cf57-4c9d-b5f7-e60fed94d913 tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619.info" returned: 0 in 0.259s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b2d590c9-cf57-4c9d-b5f7-e60fed94d913 tempest-ProjectMemberTests-196532882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.342s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2b312aba-c90c-440f-8ef1-c4600a01272c tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.980s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:51 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2b312aba-c90c-440f-8ef1-c4600a01272c tempest-CreateVolumesFromSnapshotTest-997127146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1158975145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8cedc44-149a-49a4-aee6-fc4c3db01a69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ffdf5a5e23f462ca0b62dd2e50cf772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:36:47Z,use_quota=True,user_id='030ae0218a734a249347affed5237da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:36:51 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-2b312aba-c90c-440f-8ef1-c4600a01272c tempest-CreateVolumesFromSnapshotTest-997127146 None] Creating volume f8cedc44-149a-49a4-aee6-fc4c3db01a69 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:36:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2b312aba-c90c-440f-8ef1-c4600a01272c tempest-CreateVolumesFromSnapshotTest-997127146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2b312aba-c90c-440f-8ef1-c4600a01272c tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:51 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2b312aba-c90c-440f-8ef1-c4600a01272c tempest-CreateVolumesFromSnapshotTest-997127146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:36:51 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2b312aba-c90c-440f-8ef1-c4600a01272c tempest-CreateVolumesFromSnapshotTest-997127146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:36:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2b312aba-c90c-440f-8ef1-c4600a01272c tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:51 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2b312aba-c90c-440f-8ef1-c4600a01272c tempest-CreateVolumesFromSnapshotTest-997127146 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:36:51 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-2b312aba-c90c-440f-8ef1-c4600a01272c tempest-CreateVolumesFromSnapshotTest-997127146 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:36:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2b312aba-c90c-440f-8ef1-c4600a01272c tempest-CreateVolumesFromSnapshotTest-997127146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f8cedc44-149a-49a4-aee6-fc4c3db01a69 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:51 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f8cedc44-149a-49a4-aee6-fc4c3db01a69 1073741824 Nov 03 20:36:51 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:51 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e71ed19d-7b89-4c4d-a73b-5aaebf955599 tempest-CreateVolumesFromImageTest-76365343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-a5c7f14c-d804-40ce-b852-32abbdd357ea" returned: 0 in 0.263s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:51 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-b2d590c9-cf57-4c9d-b5f7-e60fed94d913 tempest-ProjectMemberTests-196532882 None] Create snapshot completed successfully Nov 03 20:36:51 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e71ed19d-7b89-4c4d-a73b-5aaebf955599 tempest-CreateVolumesFromImageTest-76365343 None] Lock "cinder-quobyte-a5c7f14c-d804-40ce-b852-32abbdd357ea" released by "delete_volume" :: held 0.720s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:36:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b3adf10f-52d6-4e18-9017-780bf17fe253 tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b3adf10f-52d6-4e18-9017-780bf17fe253 tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:51 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-b3adf10f-52d6-4e18-9017-780bf17fe253 tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:36:51 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-b3adf10f-52d6-4e18-9017-780bf17fe253 tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:36:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b3adf10f-52d6-4e18-9017-780bf17fe253 tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b3adf10f-52d6-4e18-9017-780bf17fe253 tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:51 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:36:51 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:51 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-e71ed19d-7b89-4c4d-a73b-5aaebf955599 tempest-CreateVolumesFromImageTest-76365343 None] Created reservations ['4bb76c4b-b913-46bb-9995-a20523f78ad1', 'b5ef2e46-2c9c-45b7-941a-0a00038d336a', 'e82fdbdc-5adf-4035-9f17-f029ae020e17', 'b272b2f4-373d-4e2a-9863-b8e5f2b35ee7'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:36:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e71ed19d-7b89-4c4d-a73b-5aaebf955599 tempest-CreateVolumesFromImageTest-76365343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e71ed19d-7b89-4c4d-a73b-5aaebf955599 tempest-CreateVolumesFromImageTest-76365343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:51 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e71ed19d-7b89-4c4d-a73b-5aaebf955599 tempest-CreateVolumesFromImageTest-76365343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:36:51 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e71ed19d-7b89-4c4d-a73b-5aaebf955599 tempest-CreateVolumesFromImageTest-76365343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:36:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e71ed19d-7b89-4c4d-a73b-5aaebf955599 tempest-CreateVolumesFromImageTest-76365343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e71ed19d-7b89-4c4d-a73b-5aaebf955599 tempest-CreateVolumesFromImageTest-76365343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:51 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:36:51 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:52 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b3adf10f-52d6-4e18-9017-780bf17fe253 tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.338s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:52 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-b3adf10f-52d6-4e18-9017-780bf17fe253 tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:36:52 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-b3adf10f-52d6-4e18-9017-780bf17fe253 tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Deleted volume successfully. Nov 03 20:36:52 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b3adf10f-52d6-4e18-9017-780bf17fe253 tempest-VolumeAndVolumeTypeFromImageTest-624208806 None] Lock "cinder-66722147-1a87-4ea3-8a00-ad6a4eabb698-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:36:52 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2b312aba-c90c-440f-8ef1-c4600a01272c tempest-CreateVolumesFromSnapshotTest-997127146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f8cedc44-149a-49a4-aee6-fc4c3db01a69 1073741824" returned: 0 in 0.579s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2b312aba-c90c-440f-8ef1-c4600a01272c tempest-CreateVolumesFromSnapshotTest-997127146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f8cedc44-149a-49a4-aee6-fc4c3db01a69 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:52 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f8cedc44-149a-49a4-aee6-fc4c3db01a69 Nov 03 20:36:52 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:52 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e71ed19d-7b89-4c4d-a73b-5aaebf955599 tempest-CreateVolumesFromImageTest-76365343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.393s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:52 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-e71ed19d-7b89-4c4d-a73b-5aaebf955599 tempest-CreateVolumesFromImageTest-76365343 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:36:52 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-e71ed19d-7b89-4c4d-a73b-5aaebf955599 tempest-CreateVolumesFromImageTest-76365343 None] Deleted volume successfully. Nov 03 20:36:52 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e71ed19d-7b89-4c4d-a73b-5aaebf955599 tempest-CreateVolumesFromImageTest-76365343 None] Lock "cinder-a5c7f14c-d804-40ce-b852-32abbdd357ea-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:36:52 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2b312aba-c90c-440f-8ef1-c4600a01272c tempest-CreateVolumesFromSnapshotTest-997127146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f8cedc44-149a-49a4-aee6-fc4c3db01a69" returned: 0 in 0.298s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:52 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2b312aba-c90c-440f-8ef1-c4600a01272c tempest-CreateVolumesFromSnapshotTest-997127146 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:36:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2b312aba-c90c-440f-8ef1-c4600a01272c tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-35d9bdce-a1b0-4602-9756-6619787b9f31 tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.303s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:52 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-35d9bdce-a1b0-4602-9756-6619787b9f31 tempest-CreateVolumesFromSnapshotTest-997127146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1999111342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e22b4d2-9075-4999-805f-4ff3fca4028e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ffdf5a5e23f462ca0b62dd2e50cf772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:36:48Z,use_quota=True,user_id='030ae0218a734a249347affed5237da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:36:52 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-35d9bdce-a1b0-4602-9756-6619787b9f31 tempest-CreateVolumesFromSnapshotTest-997127146 None] Creating volume 3e22b4d2-9075-4999-805f-4ff3fca4028e {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:36:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-35d9bdce-a1b0-4602-9756-6619787b9f31 tempest-CreateVolumesFromSnapshotTest-997127146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-35d9bdce-a1b0-4602-9756-6619787b9f31 tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:52 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-35d9bdce-a1b0-4602-9756-6619787b9f31 tempest-CreateVolumesFromSnapshotTest-997127146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:36:52 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-35d9bdce-a1b0-4602-9756-6619787b9f31 tempest-CreateVolumesFromSnapshotTest-997127146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:36:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-35d9bdce-a1b0-4602-9756-6619787b9f31 tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:52 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-35d9bdce-a1b0-4602-9756-6619787b9f31 tempest-CreateVolumesFromSnapshotTest-997127146 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:36:52 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-35d9bdce-a1b0-4602-9756-6619787b9f31 tempest-CreateVolumesFromSnapshotTest-997127146 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:36:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-35d9bdce-a1b0-4602-9756-6619787b9f31 tempest-CreateVolumesFromSnapshotTest-997127146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3e22b4d2-9075-4999-805f-4ff3fca4028e 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:52 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2b312aba-c90c-440f-8ef1-c4600a01272c tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d55c46a-1b0d-408c-b222-43763329401e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8cedc44-149a-49a4-aee6-fc4c3db01a69', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:52 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2b312aba-c90c-440f-8ef1-c4600a01272c tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ea3d7b9-ddef-4dd9-8bc3-6f10b1828816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:52 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3e22b4d2-9075-4999-805f-4ff3fca4028e 1073741824 Nov 03 20:36:52 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:52 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-2b312aba-c90c-440f-8ef1-c4600a01272c tempest-CreateVolumesFromSnapshotTest-997127146 None] Volume volume-f8cedc44-149a-49a4-aee6-fc4c3db01a69 (f8cedc44-149a-49a4-aee6-fc4c3db01a69): created successfully Nov 03 20:36:52 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2b312aba-c90c-440f-8ef1-c4600a01272c tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ea3d7b9-ddef-4dd9-8bc3-6f10b1828816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:52 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2b312aba-c90c-440f-8ef1-c4600a01272c tempest-CreateVolumesFromSnapshotTest-997127146 None] Flow 'volume_create_manager' (9e2b658e-0825-4110-9a12-b90b536f8bfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:36:52 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9d4336c3-70d7-4089-8ec9-50f929ffc68a tempest-ProjectMemberTests-196532882 None] Acquiring lock "cinder-33d73862-d14e-4104-80b8-bf604e175052-delete_snapshot" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:36:52 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-2b312aba-c90c-440f-8ef1-c4600a01272c tempest-CreateVolumesFromSnapshotTest-997127146 None] Created volume successfully. Nov 03 20:36:52 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9d4336c3-70d7-4089-8ec9-50f929ffc68a tempest-ProjectMemberTests-196532882 None] Lock "cinder-33d73862-d14e-4104-80b8-bf604e175052-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:36:52 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9d4336c3-70d7-4089-8ec9-50f929ffc68a tempest-ProjectMemberTests-196532882 None] Acquiring lock "cinder-quobyte-20c5bcaf-3702-4258-b5ea-9e8a22e2d619" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:36:52 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9d4336c3-70d7-4089-8ec9-50f929ffc68a tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-20c5bcaf-3702-4258-b5ea-9e8a22e2d619" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:36:52 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9d4336c3-70d7-4089-8ec9-50f929ffc68a tempest-ProjectMemberTests-196532882 None] Acquiring lock "cinder-quobyte-33d73862-d14e-4104-80b8-bf604e175052" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:36:52 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9d4336c3-70d7-4089-8ec9-50f929ffc68a tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-33d73862-d14e-4104-80b8-bf604e175052" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:36:52 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-9d4336c3-70d7-4089-8ec9-50f929ffc68a tempest-ProjectMemberTests-196532882 None] Deleting offline snapshot 33d73862-d14e-4104-80b8-bf604e175052 of volume 20c5bcaf-3702-4258-b5ea-9e8a22e2d619 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:36:52 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-9d4336c3-70d7-4089-8ec9-50f929ffc68a tempest-ProjectMemberTests-196532882 None] snapshot_file for this snap is: volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619.33d73862-d14e-4104-80b8-bf604e175052 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:36:52 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[218b9433-f0ca-4bfa-8cab-aa4e27d0b89a]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:36:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9d4336c3-70d7-4089-8ec9-50f929ffc68a tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619.33d73862-d14e-4104-80b8-bf604e175052 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:52 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619.33d73862-d14e-4104-80b8-bf604e175052 Nov 03 20:36:52 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:53 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-35d9bdce-a1b0-4602-9756-6619787b9f31 tempest-CreateVolumesFromSnapshotTest-997127146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3e22b4d2-9075-4999-805f-4ff3fca4028e 1073741824" returned: 0 in 0.718s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-35d9bdce-a1b0-4602-9756-6619787b9f31 tempest-CreateVolumesFromSnapshotTest-997127146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3e22b4d2-9075-4999-805f-4ff3fca4028e {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:53 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3e22b4d2-9075-4999-805f-4ff3fca4028e Nov 03 20:36:53 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:53 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9d4336c3-70d7-4089-8ec9-50f929ffc68a tempest-ProjectMemberTests-196532882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619.33d73862-d14e-4104-80b8-bf604e175052" returned: 0 in 0.549s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:53 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-9d4336c3-70d7-4089-8ec9-50f929ffc68a tempest-ProjectMemberTests-196532882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:36:53 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4b353f-e8b3-4a76-b6a6-cd2640002d4a]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:36:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9d4336c3-70d7-4089-8ec9-50f929ffc68a tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:53 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619 Nov 03 20:36:53 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:53 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-35d9bdce-a1b0-4602-9756-6619787b9f31 tempest-CreateVolumesFromSnapshotTest-997127146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3e22b4d2-9075-4999-805f-4ff3fca4028e" returned: 0 in 0.366s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:53 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-35d9bdce-a1b0-4602-9756-6619787b9f31 tempest-CreateVolumesFromSnapshotTest-997127146 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:36:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-35d9bdce-a1b0-4602-9756-6619787b9f31 tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2648e81c-21a3-4d29-b69c-200249cbd065 tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.016s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:53 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2648e81c-21a3-4d29-b69c-200249cbd065 tempest-CreateVolumesFromSnapshotTest-997127146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1601259746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=802e1060-f7c2-4efa-880a-1d3a537d9ab9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ffdf5a5e23f462ca0b62dd2e50cf772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:36:48Z,use_quota=True,user_id='030ae0218a734a249347affed5237da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:36:53 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-2648e81c-21a3-4d29-b69c-200249cbd065 tempest-CreateVolumesFromSnapshotTest-997127146 None] Creating volume 802e1060-f7c2-4efa-880a-1d3a537d9ab9 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:36:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2648e81c-21a3-4d29-b69c-200249cbd065 tempest-CreateVolumesFromSnapshotTest-997127146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2648e81c-21a3-4d29-b69c-200249cbd065 tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:53 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2648e81c-21a3-4d29-b69c-200249cbd065 tempest-CreateVolumesFromSnapshotTest-997127146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:36:53 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2648e81c-21a3-4d29-b69c-200249cbd065 tempest-CreateVolumesFromSnapshotTest-997127146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:36:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2648e81c-21a3-4d29-b69c-200249cbd065 tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:53 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2648e81c-21a3-4d29-b69c-200249cbd065 tempest-CreateVolumesFromSnapshotTest-997127146 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:36:53 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-2648e81c-21a3-4d29-b69c-200249cbd065 tempest-CreateVolumesFromSnapshotTest-997127146 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:36:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2648e81c-21a3-4d29-b69c-200249cbd065 tempest-CreateVolumesFromSnapshotTest-997127146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-802e1060-f7c2-4efa-880a-1d3a537d9ab9 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:53 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-35d9bdce-a1b0-4602-9756-6619787b9f31 tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee0d5184-be6c-435c-a2ab-ec8989c6c4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e22b4d2-9075-4999-805f-4ff3fca4028e', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:53 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-802e1060-f7c2-4efa-880a-1d3a537d9ab9 1073741824 Nov 03 20:36:53 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:53 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-35d9bdce-a1b0-4602-9756-6619787b9f31 tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc848fa3-4b29-4ceb-b873-dc149fb7da70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:53 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-35d9bdce-a1b0-4602-9756-6619787b9f31 tempest-CreateVolumesFromSnapshotTest-997127146 None] Volume volume-3e22b4d2-9075-4999-805f-4ff3fca4028e (3e22b4d2-9075-4999-805f-4ff3fca4028e): created successfully Nov 03 20:36:53 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-35d9bdce-a1b0-4602-9756-6619787b9f31 tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc848fa3-4b29-4ceb-b873-dc149fb7da70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:53 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-35d9bdce-a1b0-4602-9756-6619787b9f31 tempest-CreateVolumesFromSnapshotTest-997127146 None] Flow 'volume_create_manager' (a3691881-eb92-4c33-a583-3b82fadfcf37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:36:53 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-35d9bdce-a1b0-4602-9756-6619787b9f31 tempest-CreateVolumesFromSnapshotTest-997127146 None] Created volume successfully. Nov 03 20:36:53 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9d4336c3-70d7-4089-8ec9-50f929ffc68a tempest-ProjectMemberTests-196532882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619" returned: 0 in 0.493s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9d4336c3-70d7-4089-8ec9-50f929ffc68a tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619.33d73862-d14e-4104-80b8-bf604e175052 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:53 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619.33d73862-d14e-4104-80b8-bf604e175052 Nov 03 20:36:53 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:54 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2648e81c-21a3-4d29-b69c-200249cbd065 tempest-CreateVolumesFromSnapshotTest-997127146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-802e1060-f7c2-4efa-880a-1d3a537d9ab9 1073741824" returned: 0 in 0.665s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2648e81c-21a3-4d29-b69c-200249cbd065 tempest-CreateVolumesFromSnapshotTest-997127146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-802e1060-f7c2-4efa-880a-1d3a537d9ab9 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:54 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-802e1060-f7c2-4efa-880a-1d3a537d9ab9 Nov 03 20:36:54 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:54 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9d4336c3-70d7-4089-8ec9-50f929ffc68a tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619.33d73862-d14e-4104-80b8-bf604e175052" returned: 0 in 0.560s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9d4336c3-70d7-4089-8ec9-50f929ffc68a tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619.33d73862-d14e-4104-80b8-bf604e175052 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:54 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619.33d73862-d14e-4104-80b8-bf604e175052 Nov 03 20:36:54 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:54 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2648e81c-21a3-4d29-b69c-200249cbd065 tempest-CreateVolumesFromSnapshotTest-997127146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-802e1060-f7c2-4efa-880a-1d3a537d9ab9" returned: 0 in 0.323s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:54 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-2648e81c-21a3-4d29-b69c-200249cbd065 tempest-CreateVolumesFromSnapshotTest-997127146 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:36:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-2648e81c-21a3-4d29-b69c-200249cbd065 tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:54 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2648e81c-21a3-4d29-b69c-200249cbd065 tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70b33c6b-3aa5-4c0e-a6bc-11785f152053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-802e1060-f7c2-4efa-880a-1d3a537d9ab9', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:54 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2648e81c-21a3-4d29-b69c-200249cbd065 tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c5e1d8d-1a10-4c5c-a9f4-d95b787b47bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:54 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9d4336c3-70d7-4089-8ec9-50f929ffc68a tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619.33d73862-d14e-4104-80b8-bf604e175052" returned: 0 in 0.305s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:54 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-2648e81c-21a3-4d29-b69c-200249cbd065 tempest-CreateVolumesFromSnapshotTest-997127146 None] Volume volume-802e1060-f7c2-4efa-880a-1d3a537d9ab9 (802e1060-f7c2-4efa-880a-1d3a537d9ab9): created successfully Nov 03 20:36:54 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2648e81c-21a3-4d29-b69c-200249cbd065 tempest-CreateVolumesFromSnapshotTest-997127146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c5e1d8d-1a10-4c5c-a9f4-d95b787b47bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:54 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-2648e81c-21a3-4d29-b69c-200249cbd065 tempest-CreateVolumesFromSnapshotTest-997127146 None] Flow 'volume_create_manager' (92712326-87fb-4472-9074-18d70d6a1751) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:36:54 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-2648e81c-21a3-4d29-b69c-200249cbd065 tempest-CreateVolumesFromSnapshotTest-997127146 None] Created volume successfully. Nov 03 20:36:54 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9d4336c3-70d7-4089-8ec9-50f929ffc68a tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-33d73862-d14e-4104-80b8-bf604e175052" released by "_delete_snapshot" :: held 2.101s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:36:54 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9d4336c3-70d7-4089-8ec9-50f929ffc68a tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-20c5bcaf-3702-4258-b5ea-9e8a22e2d619" released by "delete_snapshot" :: held 2.139s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:36:54 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-9d4336c3-70d7-4089-8ec9-50f929ffc68a tempest-ProjectMemberTests-196532882 None] Created reservations ['3ec31efb-aa73-4d71-8db4-2038ed8a5a38', '84f66597-63fe-4a4f-8dc0-0769a68ec383', '2004b392-7a6e-4d8f-a155-01f3ec9b228f', '3f166418-a3c3-4f6d-8285-ab78daa76a16'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:36:54 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-9d4336c3-70d7-4089-8ec9-50f929ffc68a tempest-ProjectMemberTests-196532882 None] Delete snapshot completed successfully. Nov 03 20:36:55 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9d4336c3-70d7-4089-8ec9-50f929ffc68a tempest-ProjectMemberTests-196532882 None] Lock "cinder-33d73862-d14e-4104-80b8-bf604e175052-delete_snapshot" released by "delete_snapshot" :: held 2.307s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:36:55 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1e99fa6e-e141-4f7e-a23e-a323881a6551 tempest-CreateVolumesFromSnapshotTest-997127146 None] Acquiring lock "cinder-802e1060-f7c2-4efa-880a-1d3a537d9ab9-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:36:55 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1e99fa6e-e141-4f7e-a23e-a323881a6551 tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "cinder-802e1060-f7c2-4efa-880a-1d3a537d9ab9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:36:55 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1e99fa6e-e141-4f7e-a23e-a323881a6551 tempest-CreateVolumesFromSnapshotTest-997127146 None] Acquiring lock "cinder-quobyte-802e1060-f7c2-4efa-880a-1d3a537d9ab9" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:36:55 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1e99fa6e-e141-4f7e-a23e-a323881a6551 tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "cinder-quobyte-802e1060-f7c2-4efa-880a-1d3a537d9ab9" acquired by "delete_volume" :: waited 0.018s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:36:55 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6037aea-fae4-404f-977a-04e6f115a073]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:36:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1e99fa6e-e141-4f7e-a23e-a323881a6551 tempest-CreateVolumesFromSnapshotTest-997127146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-802e1060-f7c2-4efa-880a-1d3a537d9ab9 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:55 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-802e1060-f7c2-4efa-880a-1d3a537d9ab9 Nov 03 20:36:55 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:55 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1e99fa6e-e141-4f7e-a23e-a323881a6551 tempest-CreateVolumesFromSnapshotTest-997127146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-802e1060-f7c2-4efa-880a-1d3a537d9ab9" returned: 0 in 0.434s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1e99fa6e-e141-4f7e-a23e-a323881a6551 tempest-CreateVolumesFromSnapshotTest-997127146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-802e1060-f7c2-4efa-880a-1d3a537d9ab9 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:55 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8944cd4f-bc34-408c-b4c7-3e2a7fed13fe tempest-ProjectMemberTests-196532882 None] Acquiring lock "cinder-20c5bcaf-3702-4258-b5ea-9e8a22e2d619-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:36:55 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-802e1060-f7c2-4efa-880a-1d3a537d9ab9 Nov 03 20:36:55 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:55 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8944cd4f-bc34-408c-b4c7-3e2a7fed13fe tempest-ProjectMemberTests-196532882 None] Lock "cinder-20c5bcaf-3702-4258-b5ea-9e8a22e2d619-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:36:56 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8944cd4f-bc34-408c-b4c7-3e2a7fed13fe tempest-ProjectMemberTests-196532882 None] Acquiring lock "cinder-quobyte-20c5bcaf-3702-4258-b5ea-9e8a22e2d619" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:36:56 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8944cd4f-bc34-408c-b4c7-3e2a7fed13fe tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-20c5bcaf-3702-4258-b5ea-9e8a22e2d619" acquired by "delete_volume" :: waited 0.029s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:36:56 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[97956ad9-ac95-4e5b-bb0d-22ca3e20e7cc]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:36:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8944cd4f-bc34-408c-b4c7-3e2a7fed13fe tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:56 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1e99fa6e-e141-4f7e-a23e-a323881a6551 tempest-CreateVolumesFromSnapshotTest-997127146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-802e1060-f7c2-4efa-880a-1d3a537d9ab9" returned: 0 in 0.367s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:56 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1e99fa6e-e141-4f7e-a23e-a323881a6551 tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "cinder-quobyte-802e1060-f7c2-4efa-880a-1d3a537d9ab9" released by "delete_volume" :: held 0.859s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:36:56 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619 Nov 03 20:36:56 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:56 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cb6ed8a-c07e-4545-89ee-5e0d582317fc tempest-VolumeDependencyTests-1589553495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:36:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5cb6ed8a-c07e-4545-89ee-5e0d582317fc tempest-VolumeDependencyTests-1589553495 None] Flow 'volume_create_manager' (33e74655-0e6f-41a6-ae4a-73a90f857034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:36:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5cb6ed8a-c07e-4545-89ee-5e0d582317fc tempest-VolumeDependencyTests-1589553495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a047022-c319-464b-8a39-d5a4d043612c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5cb6ed8a-c07e-4545-89ee-5e0d582317fc tempest-VolumeDependencyTests-1589553495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a047022-c319-464b-8a39-d5a4d043612c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1837539723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dda7d68-4eb0-4065-b783-3394d41b8c75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d963345a3e984352b53b7713a76d90d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:36:56Z,use_quota=True,user_id='321199d63c4245d3bc2c8cfb2cef0985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5cb6ed8a-c07e-4545-89ee-5e0d582317fc tempest-VolumeDependencyTests-1589553495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09402fa0-fdf2-46e4-bfd8-85c094a2cea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5cb6ed8a-c07e-4545-89ee-5e0d582317fc tempest-VolumeDependencyTests-1589553495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09402fa0-fdf2-46e4-bfd8-85c094a2cea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5cb6ed8a-c07e-4545-89ee-5e0d582317fc tempest-VolumeDependencyTests-1589553495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b63be3f-2ae4-4607-bd60-fa1a63dc00e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5cb6ed8a-c07e-4545-89ee-5e0d582317fc tempest-VolumeDependencyTests-1589553495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b63be3f-2ae4-4607-bd60-fa1a63dc00e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dda7d68-4eb0-4065-b783-3394d41b8c75', 'volume_name': 'volume-6dda7d68-4eb0-4065-b783-3394d41b8c75', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5cb6ed8a-c07e-4545-89ee-5e0d582317fc tempest-VolumeDependencyTests-1589553495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1342c7e3-53f9-4e83-b5bd-0f651e4f4cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5cb6ed8a-c07e-4545-89ee-5e0d582317fc tempest-VolumeDependencyTests-1589553495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1342c7e3-53f9-4e83-b5bd-0f651e4f4cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5cb6ed8a-c07e-4545-89ee-5e0d582317fc tempest-VolumeDependencyTests-1589553495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69a530c5-7fe5-4978-89f9-d03e4fdb1752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:56 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-5cb6ed8a-c07e-4545-89ee-5e0d582317fc tempest-VolumeDependencyTests-1589553495 None] Volume 6dda7d68-4eb0-4065-b783-3394d41b8c75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dda7d68-4eb0-4065-b783-3394d41b8c75', 'volume_size': 1} Nov 03 20:36:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-5cb6ed8a-c07e-4545-89ee-5e0d582317fc tempest-VolumeDependencyTests-1589553495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-5cb6ed8a-c07e-4545-89ee-5e0d582317fc tempest-VolumeDependencyTests-1589553495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:56 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-5cb6ed8a-c07e-4545-89ee-5e0d582317fc tempest-VolumeDependencyTests-1589553495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1837539723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dda7d68-4eb0-4065-b783-3394d41b8c75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d963345a3e984352b53b7713a76d90d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:36:56Z,use_quota=True,user_id='321199d63c4245d3bc2c8cfb2cef0985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:36:56 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-5cb6ed8a-c07e-4545-89ee-5e0d582317fc tempest-VolumeDependencyTests-1589553495 None] Creating volume 6dda7d68-4eb0-4065-b783-3394d41b8c75 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:36:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-5cb6ed8a-c07e-4545-89ee-5e0d582317fc tempest-VolumeDependencyTests-1589553495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-5cb6ed8a-c07e-4545-89ee-5e0d582317fc tempest-VolumeDependencyTests-1589553495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:56 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-5cb6ed8a-c07e-4545-89ee-5e0d582317fc tempest-VolumeDependencyTests-1589553495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:36:56 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-5cb6ed8a-c07e-4545-89ee-5e0d582317fc tempest-VolumeDependencyTests-1589553495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:36:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-5cb6ed8a-c07e-4545-89ee-5e0d582317fc tempest-VolumeDependencyTests-1589553495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:56 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-5cb6ed8a-c07e-4545-89ee-5e0d582317fc tempest-VolumeDependencyTests-1589553495 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:36:56 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-5cb6ed8a-c07e-4545-89ee-5e0d582317fc tempest-VolumeDependencyTests-1589553495 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:36:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5cb6ed8a-c07e-4545-89ee-5e0d582317fc tempest-VolumeDependencyTests-1589553495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:56 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75 1073741824 Nov 03 20:36:56 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:56 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-1e99fa6e-e141-4f7e-a23e-a323881a6551 tempest-CreateVolumesFromSnapshotTest-997127146 None] Created reservations ['a286c781-93e8-44d5-a620-3def2a0626f7', '182866cc-3b5e-44e6-87e0-cb4ca1e618d1', '28d1b4e7-cf6d-4a3e-992c-af9021288f6e', '045aa9e5-741e-474b-b640-20bc027b1489'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:36:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1e99fa6e-e141-4f7e-a23e-a323881a6551 tempest-CreateVolumesFromSnapshotTest-997127146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1e99fa6e-e141-4f7e-a23e-a323881a6551 tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:56 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-1e99fa6e-e141-4f7e-a23e-a323881a6551 tempest-CreateVolumesFromSnapshotTest-997127146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:36:56 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-1e99fa6e-e141-4f7e-a23e-a323881a6551 tempest-CreateVolumesFromSnapshotTest-997127146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:36:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1e99fa6e-e141-4f7e-a23e-a323881a6551 tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1e99fa6e-e141-4f7e-a23e-a323881a6551 tempest-CreateVolumesFromSnapshotTest-997127146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:56 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:36:56 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:56 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8944cd4f-bc34-408c-b4c7-3e2a7fed13fe tempest-ProjectMemberTests-196532882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619" returned: 0 in 0.624s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8944cd4f-bc34-408c-b4c7-3e2a7fed13fe tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:56 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619 Nov 03 20:36:56 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:57 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1e99fa6e-e141-4f7e-a23e-a323881a6551 tempest-CreateVolumesFromSnapshotTest-997127146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.315s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:57 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-1e99fa6e-e141-4f7e-a23e-a323881a6551 tempest-CreateVolumesFromSnapshotTest-997127146 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:36:57 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-1e99fa6e-e141-4f7e-a23e-a323881a6551 tempest-CreateVolumesFromSnapshotTest-997127146 None] Deleted volume successfully. Nov 03 20:36:57 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:57 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1e99fa6e-e141-4f7e-a23e-a323881a6551 tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "cinder-802e1060-f7c2-4efa-880a-1d3a537d9ab9-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:36:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5cb6ed8a-c07e-4545-89ee-5e0d582317fc tempest-VolumeDependencyTests-1589553495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75 1073741824" returned: 0 in 0.609s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:57 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8944cd4f-bc34-408c-b4c7-3e2a7fed13fe tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-20c5bcaf-3702-4258-b5ea-9e8a22e2d619" returned: 0 in 0.345s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5cb6ed8a-c07e-4545-89ee-5e0d582317fc tempest-VolumeDependencyTests-1589553495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:57 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8944cd4f-bc34-408c-b4c7-3e2a7fed13fe tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-20c5bcaf-3702-4258-b5ea-9e8a22e2d619" released by "delete_volume" :: held 1.100s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:36:57 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75 Nov 03 20:36:57 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:57 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-8944cd4f-bc34-408c-b4c7-3e2a7fed13fe tempest-ProjectMemberTests-196532882 None] Created reservations ['8d23986f-0e12-42f0-98d4-0a2f27b0c16a', 'f2ee3be5-c2ea-4151-9e3c-7447f3c7e9a1', '7b5003d1-40b8-4476-8c18-f789920fac89', 'c496c4c5-117c-4678-9a20-3dd2b14e6602'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:36:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8944cd4f-bc34-408c-b4c7-3e2a7fed13fe tempest-ProjectMemberTests-196532882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8944cd4f-bc34-408c-b4c7-3e2a7fed13fe tempest-ProjectMemberTests-196532882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:57 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8944cd4f-bc34-408c-b4c7-3e2a7fed13fe tempest-ProjectMemberTests-196532882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:36:57 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8944cd4f-bc34-408c-b4c7-3e2a7fed13fe tempest-ProjectMemberTests-196532882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:36:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8944cd4f-bc34-408c-b4c7-3e2a7fed13fe tempest-ProjectMemberTests-196532882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8944cd4f-bc34-408c-b4c7-3e2a7fed13fe tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:57 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:36:57 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:57 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5cb6ed8a-c07e-4545-89ee-5e0d582317fc tempest-VolumeDependencyTests-1589553495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75" returned: 0 in 0.291s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:57 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-5cb6ed8a-c07e-4545-89ee-5e0d582317fc tempest-VolumeDependencyTests-1589553495 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:36:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-5cb6ed8a-c07e-4545-89ee-5e0d582317fc tempest-VolumeDependencyTests-1589553495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:57 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5cb6ed8a-c07e-4545-89ee-5e0d582317fc tempest-VolumeDependencyTests-1589553495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69a530c5-7fe5-4978-89f9-d03e4fdb1752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dda7d68-4eb0-4065-b783-3394d41b8c75', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:57 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5cb6ed8a-c07e-4545-89ee-5e0d582317fc tempest-VolumeDependencyTests-1589553495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7428fca8-4b4a-43f0-a409-82dd672cdd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:57 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-5cb6ed8a-c07e-4545-89ee-5e0d582317fc tempest-VolumeDependencyTests-1589553495 None] Volume volume-6dda7d68-4eb0-4065-b783-3394d41b8c75 (6dda7d68-4eb0-4065-b783-3394d41b8c75): created successfully Nov 03 20:36:57 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5cb6ed8a-c07e-4545-89ee-5e0d582317fc tempest-VolumeDependencyTests-1589553495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7428fca8-4b4a-43f0-a409-82dd672cdd53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:57 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-5cb6ed8a-c07e-4545-89ee-5e0d582317fc tempest-VolumeDependencyTests-1589553495 None] Flow 'volume_create_manager' (33e74655-0e6f-41a6-ae4a-73a90f857034) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:36:57 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-5cb6ed8a-c07e-4545-89ee-5e0d582317fc tempest-VolumeDependencyTests-1589553495 None] Created volume successfully. Nov 03 20:36:57 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8944cd4f-bc34-408c-b4c7-3e2a7fed13fe tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.263s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:57 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-8944cd4f-bc34-408c-b4c7-3e2a7fed13fe tempest-ProjectMemberTests-196532882 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:36:57 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-8944cd4f-bc34-408c-b4c7-3e2a7fed13fe tempest-ProjectMemberTests-196532882 None] Deleted volume successfully. Nov 03 20:36:57 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8944cd4f-bc34-408c-b4c7-3e2a7fed13fe tempest-ProjectMemberTests-196532882 None] Lock "cinder-20c5bcaf-3702-4258-b5ea-9e8a22e2d619-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:36:57 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1a9d18af-63bc-47ec-99be-8bf09a14de8c tempest-CreateVolumesFromSnapshotTest-997127146 None] Acquiring lock "cinder-3e22b4d2-9075-4999-805f-4ff3fca4028e-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:36:57 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1a9d18af-63bc-47ec-99be-8bf09a14de8c tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "cinder-3e22b4d2-9075-4999-805f-4ff3fca4028e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:36:57 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1a9d18af-63bc-47ec-99be-8bf09a14de8c tempest-CreateVolumesFromSnapshotTest-997127146 None] Acquiring lock "cinder-quobyte-3e22b4d2-9075-4999-805f-4ff3fca4028e" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:36:57 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1a9d18af-63bc-47ec-99be-8bf09a14de8c tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "cinder-quobyte-3e22b4d2-9075-4999-805f-4ff3fca4028e" acquired by "delete_volume" :: waited 0.021s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:36:57 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ffa02b-edb2-40fe-8a65-3d9b41a7d75a]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:36:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1a9d18af-63bc-47ec-99be-8bf09a14de8c tempest-CreateVolumesFromSnapshotTest-997127146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3e22b4d2-9075-4999-805f-4ff3fca4028e {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:57 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3e22b4d2-9075-4999-805f-4ff3fca4028e Nov 03 20:36:58 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:58 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5286c82-3a48-437c-8563-24fecc4e8bbf tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:36:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a5286c82-3a48-437c-8563-24fecc4e8bbf tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Flow 'volume_create_manager' (88194a60-02f6-40df-9da8-b5a5514358ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:36:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a5286c82-3a48-437c-8563-24fecc4e8bbf tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4815deb8-6461-4f84-ad44-3dc5efd221df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a5286c82-3a48-437c-8563-24fecc4e8bbf tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4815deb8-6461-4f84-ad44-3dc5efd221df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-447897125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d662cdf-1ce6-4990-ae39-ad8b2184e069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616b987cdebe4c45b6eb46cedd7bbed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:36:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:36:58Z,use_quota=True,user_id='706d48ec1f2c42ae906352318c9469bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a5286c82-3a48-437c-8563-24fecc4e8bbf tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31edef63-7fad-4887-bdb1-88bc9a5965f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a5286c82-3a48-437c-8563-24fecc4e8bbf tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31edef63-7fad-4887-bdb1-88bc9a5965f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a5286c82-3a48-437c-8563-24fecc4e8bbf tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10f69615-60db-4521-8f3f-63cc962ea86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a5286c82-3a48-437c-8563-24fecc4e8bbf tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10f69615-60db-4521-8f3f-63cc962ea86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d662cdf-1ce6-4990-ae39-ad8b2184e069', 'volume_name': 'volume-3d662cdf-1ce6-4990-ae39-ad8b2184e069', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a5286c82-3a48-437c-8563-24fecc4e8bbf tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a53ed11a-7dd3-4595-880a-2f8feb0df714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a5286c82-3a48-437c-8563-24fecc4e8bbf tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a53ed11a-7dd3-4595-880a-2f8feb0df714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a5286c82-3a48-437c-8563-24fecc4e8bbf tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (525243fe-9df9-445d-8082-4bbb2d5c979c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:58 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-a5286c82-3a48-437c-8563-24fecc4e8bbf tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Volume 3d662cdf-1ce6-4990-ae39-ad8b2184e069: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d662cdf-1ce6-4990-ae39-ad8b2184e069', 'volume_size': 1} Nov 03 20:36:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a5286c82-3a48-437c-8563-24fecc4e8bbf tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a5286c82-3a48-437c-8563-24fecc4e8bbf tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:58 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a5286c82-3a48-437c-8563-24fecc4e8bbf tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-447897125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d662cdf-1ce6-4990-ae39-ad8b2184e069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616b987cdebe4c45b6eb46cedd7bbed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:36:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:36:58Z,use_quota=True,user_id='706d48ec1f2c42ae906352318c9469bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:36:58 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-a5286c82-3a48-437c-8563-24fecc4e8bbf tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Creating volume 3d662cdf-1ce6-4990-ae39-ad8b2184e069 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:36:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a5286c82-3a48-437c-8563-24fecc4e8bbf tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a5286c82-3a48-437c-8563-24fecc4e8bbf tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:58 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a5286c82-3a48-437c-8563-24fecc4e8bbf tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:36:58 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a5286c82-3a48-437c-8563-24fecc4e8bbf tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:36:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a5286c82-3a48-437c-8563-24fecc4e8bbf tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:58 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a5286c82-3a48-437c-8563-24fecc4e8bbf tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:36:58 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-a5286c82-3a48-437c-8563-24fecc4e8bbf tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:36:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a5286c82-3a48-437c-8563-24fecc4e8bbf tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3d662cdf-1ce6-4990-ae39-ad8b2184e069 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:58 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3d662cdf-1ce6-4990-ae39-ad8b2184e069 1073741824 Nov 03 20:36:58 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:58 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1a9d18af-63bc-47ec-99be-8bf09a14de8c tempest-CreateVolumesFromSnapshotTest-997127146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3e22b4d2-9075-4999-805f-4ff3fca4028e" returned: 0 in 0.423s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1a9d18af-63bc-47ec-99be-8bf09a14de8c tempest-CreateVolumesFromSnapshotTest-997127146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3e22b4d2-9075-4999-805f-4ff3fca4028e {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:58 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3e22b4d2-9075-4999-805f-4ff3fca4028e Nov 03 20:36:58 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-99472199-e7b2-4aea-9639-3e5f3b295832 tempest-VolumeDependencyTests-1589553495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:58 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a5286c82-3a48-437c-8563-24fecc4e8bbf tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3d662cdf-1ce6-4990-ae39-ad8b2184e069 1073741824" returned: 0 in 0.555s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:58 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1a9d18af-63bc-47ec-99be-8bf09a14de8c tempest-CreateVolumesFromSnapshotTest-997127146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3e22b4d2-9075-4999-805f-4ff3fca4028e" returned: 0 in 0.341s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:58 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1a9d18af-63bc-47ec-99be-8bf09a14de8c tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "cinder-quobyte-3e22b4d2-9075-4999-805f-4ff3fca4028e" released by "delete_volume" :: held 0.819s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:36:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a5286c82-3a48-437c-8563-24fecc4e8bbf tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3d662cdf-1ce6-4990-ae39-ad8b2184e069 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:58 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3d662cdf-1ce6-4990-ae39-ad8b2184e069 Nov 03 20:36:58 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:58 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-1a9d18af-63bc-47ec-99be-8bf09a14de8c tempest-CreateVolumesFromSnapshotTest-997127146 None] Created reservations ['8c13c52b-faad-4d82-8b23-fdfa30898a8c', 'e9c96fc2-f5a2-4bb8-9f79-af13bd1a30da', 'cc497189-910f-4274-88c6-3a6ebba48429', '020278b0-880c-4a6a-ac39-d1c93a457ec5'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:36:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1a9d18af-63bc-47ec-99be-8bf09a14de8c tempest-CreateVolumesFromSnapshotTest-997127146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1a9d18af-63bc-47ec-99be-8bf09a14de8c tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:58 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-1a9d18af-63bc-47ec-99be-8bf09a14de8c tempest-CreateVolumesFromSnapshotTest-997127146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:36:58 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-1a9d18af-63bc-47ec-99be-8bf09a14de8c tempest-CreateVolumesFromSnapshotTest-997127146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:36:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1a9d18af-63bc-47ec-99be-8bf09a14de8c tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1a9d18af-63bc-47ec-99be-8bf09a14de8c tempest-CreateVolumesFromSnapshotTest-997127146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:58 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc9b06f0-da6c-480b-af80-2958e1d7958e tempest-ProjectMemberTests-196532882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:36:58 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:36:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-dc9b06f0-da6c-480b-af80-2958e1d7958e tempest-ProjectMemberTests-196532882 None] Flow 'volume_create_manager' (152843ac-c076-4112-99d8-500aa5ecf46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:36:58 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-dc9b06f0-da6c-480b-af80-2958e1d7958e tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8635913c-6a00-4b31-9bbb-7552f3797175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-dc9b06f0-da6c-480b-af80-2958e1d7958e tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8635913c-6a00-4b31-9bbb-7552f3797175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1098837687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f03ea40-4178-4f93-9f12-f51153230b68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd20413f6d5649da828c1f0bf51455d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:36:59Z,use_quota=True,user_id='595eaffd7e764ae6b07e6aba8405d447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-dc9b06f0-da6c-480b-af80-2958e1d7958e tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5de7810f-7339-468f-95c6-7e8bd33d5127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-dc9b06f0-da6c-480b-af80-2958e1d7958e tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5de7810f-7339-468f-95c6-7e8bd33d5127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-dc9b06f0-da6c-480b-af80-2958e1d7958e tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca61c16b-39e9-4572-aba3-a7fe5d604ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-dc9b06f0-da6c-480b-af80-2958e1d7958e tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca61c16b-39e9-4572-aba3-a7fe5d604ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f03ea40-4178-4f93-9f12-f51153230b68', 'volume_name': 'volume-8f03ea40-4178-4f93-9f12-f51153230b68', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-dc9b06f0-da6c-480b-af80-2958e1d7958e tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad6f3e9c-89fd-4d37-b409-793771d7d7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-dc9b06f0-da6c-480b-af80-2958e1d7958e tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad6f3e9c-89fd-4d37-b409-793771d7d7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:58 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-dc9b06f0-da6c-480b-af80-2958e1d7958e tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (540f5ed9-6b7f-4046-92dd-61ca4e1d466d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:58 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-dc9b06f0-da6c-480b-af80-2958e1d7958e tempest-ProjectMemberTests-196532882 None] Volume 8f03ea40-4178-4f93-9f12-f51153230b68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f03ea40-4178-4f93-9f12-f51153230b68', 'volume_size': 1} Nov 03 20:36:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-dc9b06f0-da6c-480b-af80-2958e1d7958e tempest-ProjectMemberTests-196532882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:59 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9f4013cf-e18c-4e5f-af90-0612991c68fa tempest-CreateVolumesFromSnapshotTest-997127146 None] Acquiring lock "cinder-f8cedc44-149a-49a4-aee6-fc4c3db01a69-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:36:59 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a5286c82-3a48-437c-8563-24fecc4e8bbf tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3d662cdf-1ce6-4990-ae39-ad8b2184e069" returned: 0 in 0.295s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:59 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a5286c82-3a48-437c-8563-24fecc4e8bbf tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:36:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a5286c82-3a48-437c-8563-24fecc4e8bbf tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-99472199-e7b2-4aea-9639-3e5f3b295832 tempest-VolumeDependencyTests-1589553495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.416s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:59 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a5286c82-3a48-437c-8563-24fecc4e8bbf tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (525243fe-9df9-445d-8082-4bbb2d5c979c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d662cdf-1ce6-4990-ae39-ad8b2184e069', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:59 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a5286c82-3a48-437c-8563-24fecc4e8bbf tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bf5c785-5b90-4a1f-b006-92b75528fd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:36:59 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9f4013cf-e18c-4e5f-af90-0612991c68fa tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "cinder-f8cedc44-149a-49a4-aee6-fc4c3db01a69-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:36:59 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-99472199-e7b2-4aea-9639-3e5f3b295832 tempest-VolumeDependencyTests-1589553495 None] Creating offline snapshot 1f0201b0-35cf-4912-ae84-d05c2fdf3b74 of volume 6dda7d68-4eb0-4065-b783-3394d41b8c75 {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:36:59 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-a5286c82-3a48-437c-8563-24fecc4e8bbf tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Volume volume-3d662cdf-1ce6-4990-ae39-ad8b2184e069 (3d662cdf-1ce6-4990-ae39-ad8b2184e069): created successfully Nov 03 20:36:59 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a5286c82-3a48-437c-8563-24fecc4e8bbf tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bf5c785-5b90-4a1f-b006-92b75528fd77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:36:59 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a5286c82-3a48-437c-8563-24fecc4e8bbf tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Flow 'volume_create_manager' (88194a60-02f6-40df-9da8-b5a5514358ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:36:59 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a77ee35-3e1c-431c-b1ad-a37dde60c89b]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:36:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-99472199-e7b2-4aea-9639-3e5f3b295832 tempest-VolumeDependencyTests-1589553495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:59 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-a5286c82-3a48-437c-8563-24fecc4e8bbf tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Created volume successfully. Nov 03 20:36:59 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9f4013cf-e18c-4e5f-af90-0612991c68fa tempest-CreateVolumesFromSnapshotTest-997127146 None] Acquiring lock "cinder-quobyte-f8cedc44-149a-49a4-aee6-fc4c3db01a69" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:36:59 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9f4013cf-e18c-4e5f-af90-0612991c68fa tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "cinder-quobyte-f8cedc44-149a-49a4-aee6-fc4c3db01a69" acquired by "delete_volume" :: waited 0.018s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:36:59 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cebdd3-2798-4666-9bca-707e0abf724b]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:36:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9f4013cf-e18c-4e5f-af90-0612991c68fa tempest-CreateVolumesFromSnapshotTest-997127146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f8cedc44-149a-49a4-aee6-fc4c3db01a69 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:59 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1a9d18af-63bc-47ec-99be-8bf09a14de8c tempest-CreateVolumesFromSnapshotTest-997127146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.340s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:59 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-1a9d18af-63bc-47ec-99be-8bf09a14de8c tempest-CreateVolumesFromSnapshotTest-997127146 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:36:59 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-1a9d18af-63bc-47ec-99be-8bf09a14de8c tempest-CreateVolumesFromSnapshotTest-997127146 None] Deleted volume successfully. Nov 03 20:36:59 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75 Nov 03 20:36:59 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:59 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1a9d18af-63bc-47ec-99be-8bf09a14de8c tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "cinder-3e22b4d2-9075-4999-805f-4ff3fca4028e-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:36:59 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f8cedc44-149a-49a4-aee6-fc4c3db01a69 Nov 03 20:36:59 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:59 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-99472199-e7b2-4aea-9639-3e5f3b295832 tempest-VolumeDependencyTests-1589553495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75" returned: 0 in 0.382s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-99472199-e7b2-4aea-9639-3e5f3b295832 tempest-VolumeDependencyTests-1589553495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75.1f0201b0-35cf-4912-ae84-d05c2fdf3b74 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:59 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75.1f0201b0-35cf-4912-ae84-d05c2fdf3b74 1G Nov 03 20:36:59 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:59 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9f4013cf-e18c-4e5f-af90-0612991c68fa tempest-CreateVolumesFromSnapshotTest-997127146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f8cedc44-149a-49a4-aee6-fc4c3db01a69" returned: 0 in 0.377s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9f4013cf-e18c-4e5f-af90-0612991c68fa tempest-CreateVolumesFromSnapshotTest-997127146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f8cedc44-149a-49a4-aee6-fc4c3db01a69 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:59 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f8cedc44-149a-49a4-aee6-fc4c3db01a69 Nov 03 20:36:59 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:59 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9f4013cf-e18c-4e5f-af90-0612991c68fa tempest-CreateVolumesFromSnapshotTest-997127146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f8cedc44-149a-49a4-aee6-fc4c3db01a69" returned: 0 in 0.259s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:59 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9f4013cf-e18c-4e5f-af90-0612991c68fa tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "cinder-quobyte-f8cedc44-149a-49a4-aee6-fc4c3db01a69" released by "delete_volume" :: held 0.682s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:36:59 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-9f4013cf-e18c-4e5f-af90-0612991c68fa tempest-CreateVolumesFromSnapshotTest-997127146 None] Created reservations ['df45fb69-74a6-45bb-9c1f-945384db7c5a', 'ce188891-bf2e-4b89-8d6f-733db267bd6c', 'ab9cdbc9-4465-4594-9cb6-fda3d9641ac0', 'c1f0f065-39cd-4ae9-a893-7aec3d14da17'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:36:59 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Nov 03 20:36:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-99472199-e7b2-4aea-9639-3e5f3b295832 tempest-VolumeDependencyTests-1589553495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75.1f0201b0-35cf-4912-ae84-d05c2fdf3b74 1G" returned: 0 in 0.433s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:36:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-99472199-e7b2-4aea-9639-3e5f3b295832 tempest-VolumeDependencyTests-1589553495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dda7d68-4eb0-4065-b783-3394d41b8c75 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75.1f0201b0-35cf-4912-ae84-d05c2fdf3b74 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:59 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dda7d68-4eb0-4065-b783-3394d41b8c75 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75.1f0201b0-35cf-4912-ae84-d05c2fdf3b74 Nov 03 20:36:59 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:36:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-9f4013cf-e18c-4e5f-af90-0612991c68fa tempest-CreateVolumesFromSnapshotTest-997127146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:36:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-9f4013cf-e18c-4e5f-af90-0612991c68fa tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:36:59 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-9f4013cf-e18c-4e5f-af90-0612991c68fa tempest-CreateVolumesFromSnapshotTest-997127146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:36:59 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-9f4013cf-e18c-4e5f-af90-0612991c68fa tempest-CreateVolumesFromSnapshotTest-997127146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:36:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-9f4013cf-e18c-4e5f-af90-0612991c68fa tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:36:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9f4013cf-e18c-4e5f-af90-0612991c68fa tempest-CreateVolumesFromSnapshotTest-997127146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:36:59 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:36:59 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:00 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8c350f67-80b9-4f59-a290-5a17e3185fa8 tempest-CreateVolumesFromSnapshotTest-997127146 None] Acquiring lock "cinder-9544f357-1dd3-4b2f-ad07-6c0443901e7f-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:00 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8c350f67-80b9-4f59-a290-5a17e3185fa8 tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "cinder-9544f357-1dd3-4b2f-ad07-6c0443901e7f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:00 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9f4013cf-e18c-4e5f-af90-0612991c68fa tempest-CreateVolumesFromSnapshotTest-997127146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.318s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:00 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-9f4013cf-e18c-4e5f-af90-0612991c68fa tempest-CreateVolumesFromSnapshotTest-997127146 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:37:00 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:00 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8c350f67-80b9-4f59-a290-5a17e3185fa8 tempest-CreateVolumesFromSnapshotTest-997127146 None] Acquiring lock "cinder-quobyte-9544f357-1dd3-4b2f-ad07-6c0443901e7f" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-99472199-e7b2-4aea-9639-3e5f3b295832 tempest-VolumeDependencyTests-1589553495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dda7d68-4eb0-4065-b783-3394d41b8c75 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75.1f0201b0-35cf-4912-ae84-d05c2fdf3b74" returned: 0 in 0.387s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:00 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-9f4013cf-e18c-4e5f-af90-0612991c68fa tempest-CreateVolumesFromSnapshotTest-997127146 None] Deleted volume successfully. Nov 03 20:37:00 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-99472199-e7b2-4aea-9639-3e5f3b295832 tempest-VolumeDependencyTests-1589553495 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75.1f0201b0-35cf-4912-ae84-d05c2fdf3b74 is being set with open permissions: ugo+rw Nov 03 20:37:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-99472199-e7b2-4aea-9639-3e5f3b295832 tempest-VolumeDependencyTests-1589553495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75.1f0201b0-35cf-4912-ae84-d05c2fdf3b74 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:00 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8c350f67-80b9-4f59-a290-5a17e3185fa8 tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "cinder-quobyte-9544f357-1dd3-4b2f-ad07-6c0443901e7f" acquired by "delete_volume" :: waited 0.044s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:00 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75.1f0201b0-35cf-4912-ae84-d05c2fdf3b74 Nov 03 20:37:00 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:00 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9f4013cf-e18c-4e5f-af90-0612991c68fa tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "cinder-f8cedc44-149a-49a4-aee6-fc4c3db01a69-delete_volume" released by "delete_volume" :: held 1.309s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:00 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c08a7df-9acc-4edb-acef-17b0aefc3a91]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8c350f67-80b9-4f59-a290-5a17e3185fa8 tempest-CreateVolumesFromSnapshotTest-997127146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-9544f357-1dd3-4b2f-ad07-6c0443901e7f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:00 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-9544f357-1dd3-4b2f-ad07-6c0443901e7f Nov 03 20:37:00 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:00 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-99472199-e7b2-4aea-9639-3e5f3b295832 tempest-VolumeDependencyTests-1589553495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75.1f0201b0-35cf-4912-ae84-d05c2fdf3b74" returned: 0 in 0.298s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-99472199-e7b2-4aea-9639-3e5f3b295832 tempest-VolumeDependencyTests-1589553495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:00 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75.info Nov 03 20:37:00 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:00 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b3d5302-ab12-4332-8cb7-b14726f19261 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:37:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1b3d5302-ab12-4332-8cb7-b14726f19261 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Flow 'volume_create_manager' (d4f5a7a8-f7f1-4e33-9be0-2860908e680f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:37:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1b3d5302-ab12-4332-8cb7-b14726f19261 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfb900c3-3337-40c1-981e-a43057fc3c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1b3d5302-ab12-4332-8cb7-b14726f19261 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfb900c3-3337-40c1-981e-a43057fc3c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-852186397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2fc2d21-6841-4590-b16f-90d679a557af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616b987cdebe4c45b6eb46cedd7bbed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:37:01Z,use_quota=True,user_id='706d48ec1f2c42ae906352318c9469bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1b3d5302-ab12-4332-8cb7-b14726f19261 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b125308c-a48d-4190-aff1-620d6fedd47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1b3d5302-ab12-4332-8cb7-b14726f19261 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b125308c-a48d-4190-aff1-620d6fedd47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1b3d5302-ab12-4332-8cb7-b14726f19261 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85c23c8e-75b9-4abd-8419-c3178154653e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1b3d5302-ab12-4332-8cb7-b14726f19261 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85c23c8e-75b9-4abd-8419-c3178154653e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2fc2d21-6841-4590-b16f-90d679a557af', 'volume_name': 'volume-c2fc2d21-6841-4590-b16f-90d679a557af', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1b3d5302-ab12-4332-8cb7-b14726f19261 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac4ef6a2-76a4-4ee3-840a-12f2dfd69131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1b3d5302-ab12-4332-8cb7-b14726f19261 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac4ef6a2-76a4-4ee3-840a-12f2dfd69131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1b3d5302-ab12-4332-8cb7-b14726f19261 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ab1b496-cb0f-42e5-8fb7-b13aa99c03aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:00 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-1b3d5302-ab12-4332-8cb7-b14726f19261 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Volume c2fc2d21-6841-4590-b16f-90d679a557af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2fc2d21-6841-4590-b16f-90d679a557af', 'volume_size': 1} Nov 03 20:37:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1b3d5302-ab12-4332-8cb7-b14726f19261 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:00 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8c350f67-80b9-4f59-a290-5a17e3185fa8 tempest-CreateVolumesFromSnapshotTest-997127146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-9544f357-1dd3-4b2f-ad07-6c0443901e7f" returned: 0 in 0.507s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8c350f67-80b9-4f59-a290-5a17e3185fa8 tempest-CreateVolumesFromSnapshotTest-997127146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-9544f357-1dd3-4b2f-ad07-6c0443901e7f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:00 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-9544f357-1dd3-4b2f-ad07-6c0443901e7f Nov 03 20:37:00 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:01 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-99472199-e7b2-4aea-9639-3e5f3b295832 tempest-VolumeDependencyTests-1589553495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75.info" returned: 0 in 0.341s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:01 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-99472199-e7b2-4aea-9639-3e5f3b295832 tempest-VolumeDependencyTests-1589553495 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75.info is being set with open permissions: ugo+rw Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-99472199-e7b2-4aea-9639-3e5f3b295832 tempest-VolumeDependencyTests-1589553495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:01 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75.info Nov 03 20:37:01 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c9d1c1c-72d7-4479-8dba-b3584c8fe6a0 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7c9d1c1c-72d7-4479-8dba-b3584c8fe6a0 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Flow 'volume_create_manager' (ef83c8bc-4b01-4362-b28e-af17f1e4ae5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7c9d1c1c-72d7-4479-8dba-b3584c8fe6a0 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67e7c4da-8bfe-49d1-81cb-1b1f9263a3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7c9d1c1c-72d7-4479-8dba-b3584c8fe6a0 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67e7c4da-8bfe-49d1-81cb-1b1f9263a3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1062371964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d3e403f-c47a-460c-85af-8fa09603b693,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616b987cdebe4c45b6eb46cedd7bbed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:37:01Z,use_quota=True,user_id='706d48ec1f2c42ae906352318c9469bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:01 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7c9d1c1c-72d7-4479-8dba-b3584c8fe6a0 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c07cf06-2334-45c3-8905-0bb0df132132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7c9d1c1c-72d7-4479-8dba-b3584c8fe6a0 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c07cf06-2334-45c3-8905-0bb0df132132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7c9d1c1c-72d7-4479-8dba-b3584c8fe6a0 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d8dc6fc-9dcc-4be0-b633-b456f250e588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7c9d1c1c-72d7-4479-8dba-b3584c8fe6a0 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d8dc6fc-9dcc-4be0-b633-b456f250e588) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d3e403f-c47a-460c-85af-8fa09603b693', 'volume_name': 'volume-3d3e403f-c47a-460c-85af-8fa09603b693', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7c9d1c1c-72d7-4479-8dba-b3584c8fe6a0 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbd8c2fe-856d-4d32-b99f-931df0a6fb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7c9d1c1c-72d7-4479-8dba-b3584c8fe6a0 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbd8c2fe-856d-4d32-b99f-931df0a6fb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7c9d1c1c-72d7-4479-8dba-b3584c8fe6a0 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81c34785-54eb-41c2-bc41-59df5ebcc353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:01 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-7c9d1c1c-72d7-4479-8dba-b3584c8fe6a0 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Volume 3d3e403f-c47a-460c-85af-8fa09603b693: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d3e403f-c47a-460c-85af-8fa09603b693', 'volume_size': 1} Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7c9d1c1c-72d7-4479-8dba-b3584c8fe6a0 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8c350f67-80b9-4f59-a290-5a17e3185fa8 tempest-CreateVolumesFromSnapshotTest-997127146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-9544f357-1dd3-4b2f-ad07-6c0443901e7f" returned: 0 in 0.356s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8c350f67-80b9-4f59-a290-5a17e3185fa8 tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "cinder-quobyte-9544f357-1dd3-4b2f-ad07-6c0443901e7f" released by "delete_volume" :: held 0.911s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:01 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-99472199-e7b2-4aea-9639-3e5f3b295832 tempest-VolumeDependencyTests-1589553495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75.info" returned: 0 in 0.271s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-99472199-e7b2-4aea-9639-3e5f3b295832 tempest-VolumeDependencyTests-1589553495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.280s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-dc9b06f0-da6c-480b-af80-2958e1d7958e tempest-ProjectMemberTests-196532882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.351s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-dc9b06f0-da6c-480b-af80-2958e1d7958e tempest-ProjectMemberTests-196532882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1098837687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f03ea40-4178-4f93-9f12-f51153230b68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd20413f6d5649da828c1f0bf51455d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:36:59Z,use_quota=True,user_id='595eaffd7e764ae6b07e6aba8405d447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-dc9b06f0-da6c-480b-af80-2958e1d7958e tempest-ProjectMemberTests-196532882 None] Creating volume 8f03ea40-4178-4f93-9f12-f51153230b68 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-dc9b06f0-da6c-480b-af80-2958e1d7958e tempest-ProjectMemberTests-196532882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-dc9b06f0-da6c-480b-af80-2958e1d7958e tempest-ProjectMemberTests-196532882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-dc9b06f0-da6c-480b-af80-2958e1d7958e tempest-ProjectMemberTests-196532882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-dc9b06f0-da6c-480b-af80-2958e1d7958e tempest-ProjectMemberTests-196532882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-dc9b06f0-da6c-480b-af80-2958e1d7958e tempest-ProjectMemberTests-196532882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-dc9b06f0-da6c-480b-af80-2958e1d7958e tempest-ProjectMemberTests-196532882 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:37:01 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-dc9b06f0-da6c-480b-af80-2958e1d7958e tempest-ProjectMemberTests-196532882 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-dc9b06f0-da6c-480b-af80-2958e1d7958e tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8f03ea40-4178-4f93-9f12-f51153230b68 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:01 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8f03ea40-4178-4f93-9f12-f51153230b68 1073741824 Nov 03 20:37:01 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:01 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-99472199-e7b2-4aea-9639-3e5f3b295832 tempest-VolumeDependencyTests-1589553495 None] Create snapshot completed successfully Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-8c350f67-80b9-4f59-a290-5a17e3185fa8 tempest-CreateVolumesFromSnapshotTest-997127146 None] Created reservations ['28dc3592-1084-4c55-8dd5-80c5cf898481', 'e0e88a96-c252-4f9f-a74e-c7132c1b6312', 'def04982-b4a1-40b6-8c90-f3ce8010b7ed', '51487a78-ac5d-45bb-8ee0-2a3d089a7ad2'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8c350f67-80b9-4f59-a290-5a17e3185fa8 tempest-CreateVolumesFromSnapshotTest-997127146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8c350f67-80b9-4f59-a290-5a17e3185fa8 tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8c350f67-80b9-4f59-a290-5a17e3185fa8 tempest-CreateVolumesFromSnapshotTest-997127146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8c350f67-80b9-4f59-a290-5a17e3185fa8 tempest-CreateVolumesFromSnapshotTest-997127146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8c350f67-80b9-4f59-a290-5a17e3185fa8 tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8c350f67-80b9-4f59-a290-5a17e3185fa8 tempest-CreateVolumesFromSnapshotTest-997127146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:01 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:37:01 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca5f8127-9bc2-407d-82b0-deace731692b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ca5f8127-9bc2-407d-82b0-deace731692b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Flow 'volume_create_manager' (d322b55d-3cc3-4718-98d3-0b56e25f704c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ca5f8127-9bc2-407d-82b0-deace731692b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (646204bb-f950-4bb8-9ec3-2d23d47740fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ca5f8127-9bc2-407d-82b0-deace731692b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (646204bb-f950-4bb8-9ec3-2d23d47740fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-994677278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f5965d9-c384-4e40-b885-1f1dd0b82591,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616b987cdebe4c45b6eb46cedd7bbed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:37:01Z,use_quota=True,user_id='706d48ec1f2c42ae906352318c9469bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ca5f8127-9bc2-407d-82b0-deace731692b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db0a1a4b-17c2-4afb-ad1e-c5596700f8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ca5f8127-9bc2-407d-82b0-deace731692b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db0a1a4b-17c2-4afb-ad1e-c5596700f8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ca5f8127-9bc2-407d-82b0-deace731692b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (066a4c5c-16d4-4246-9757-256d8d5235d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ca5f8127-9bc2-407d-82b0-deace731692b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (066a4c5c-16d4-4246-9757-256d8d5235d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f5965d9-c384-4e40-b885-1f1dd0b82591', 'volume_name': 'volume-1f5965d9-c384-4e40-b885-1f1dd0b82591', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ca5f8127-9bc2-407d-82b0-deace731692b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (002c5fdf-a8ca-4cab-83c3-9a8fa4a4c556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ca5f8127-9bc2-407d-82b0-deace731692b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (002c5fdf-a8ca-4cab-83c3-9a8fa4a4c556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ca5f8127-9bc2-407d-82b0-deace731692b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (069b23d1-e7d3-47da-bd6c-28189cdf888d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:01 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-ca5f8127-9bc2-407d-82b0-deace731692b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Volume 1f5965d9-c384-4e40-b885-1f1dd0b82591: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f5965d9-c384-4e40-b885-1f1dd0b82591', 'volume_size': 1} Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ca5f8127-9bc2-407d-82b0-deace731692b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:01 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8c350f67-80b9-4f59-a290-5a17e3185fa8 tempest-CreateVolumesFromSnapshotTest-997127146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.354s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-8c350f67-80b9-4f59-a290-5a17e3185fa8 tempest-CreateVolumesFromSnapshotTest-997127146 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:37:01 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-8c350f67-80b9-4f59-a290-5a17e3185fa8 tempest-CreateVolumesFromSnapshotTest-997127146 None] Deleted volume successfully. Nov 03 20:37:01 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-dc9b06f0-da6c-480b-af80-2958e1d7958e tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8f03ea40-4178-4f93-9f12-f51153230b68 1073741824" returned: 0 in 0.595s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8c350f67-80b9-4f59-a290-5a17e3185fa8 tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "cinder-9544f357-1dd3-4b2f-ad07-6c0443901e7f-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-dc9b06f0-da6c-480b-af80-2958e1d7958e tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8f03ea40-4178-4f93-9f12-f51153230b68 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:02 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8f03ea40-4178-4f93-9f12-f51153230b68 Nov 03 20:37:02 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-a088a7a5-7cad-402c-b12f-c85d6ec31da5 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a088a7a5-7cad-402c-b12f-c85d6ec31da5 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Flow 'volume_create_manager' (a10b9ac0-aefe-4599-8b45-be9ef5fc1cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a088a7a5-7cad-402c-b12f-c85d6ec31da5 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f21194bb-5e4d-4982-a208-423bbcee302e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a088a7a5-7cad-402c-b12f-c85d6ec31da5 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f21194bb-5e4d-4982-a208-423bbcee302e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-71246226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce9020e5-38e8-406c-a5f5-6636e6620e43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616b987cdebe4c45b6eb46cedd7bbed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:37:02Z,use_quota=True,user_id='706d48ec1f2c42ae906352318c9469bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a088a7a5-7cad-402c-b12f-c85d6ec31da5 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09f36095-0d60-44f1-8120-50f79a231b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a088a7a5-7cad-402c-b12f-c85d6ec31da5 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09f36095-0d60-44f1-8120-50f79a231b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a088a7a5-7cad-402c-b12f-c85d6ec31da5 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15e435ca-08a2-43d2-9683-62affe0c6142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a088a7a5-7cad-402c-b12f-c85d6ec31da5 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15e435ca-08a2-43d2-9683-62affe0c6142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce9020e5-38e8-406c-a5f5-6636e6620e43', 'volume_name': 'volume-ce9020e5-38e8-406c-a5f5-6636e6620e43', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a088a7a5-7cad-402c-b12f-c85d6ec31da5 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dc7fe8e-05b9-4666-8de2-abfac831eaaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a088a7a5-7cad-402c-b12f-c85d6ec31da5 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dc7fe8e-05b9-4666-8de2-abfac831eaaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a088a7a5-7cad-402c-b12f-c85d6ec31da5 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27fb3c72-e395-463d-9f09-ce3c2dbcb2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:02 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-a088a7a5-7cad-402c-b12f-c85d6ec31da5 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Volume ce9020e5-38e8-406c-a5f5-6636e6620e43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce9020e5-38e8-406c-a5f5-6636e6620e43', 'volume_size': 1} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a088a7a5-7cad-402c-b12f-c85d6ec31da5 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:02 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-dc9b06f0-da6c-480b-af80-2958e1d7958e tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8f03ea40-4178-4f93-9f12-f51153230b68" returned: 0 in 0.401s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-dc9b06f0-da6c-480b-af80-2958e1d7958e tempest-ProjectMemberTests-196532882 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-dc9b06f0-da6c-480b-af80-2958e1d7958e tempest-ProjectMemberTests-196532882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1b3d5302-ab12-4332-8cb7-b14726f19261 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.532s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-1b3d5302-ab12-4332-8cb7-b14726f19261 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-852186397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2fc2d21-6841-4590-b16f-90d679a557af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616b987cdebe4c45b6eb46cedd7bbed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:37:01Z,use_quota=True,user_id='706d48ec1f2c42ae906352318c9469bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-1b3d5302-ab12-4332-8cb7-b14726f19261 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Creating volume c2fc2d21-6841-4590-b16f-90d679a557af {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1b3d5302-ab12-4332-8cb7-b14726f19261 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1b3d5302-ab12-4332-8cb7-b14726f19261 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-1b3d5302-ab12-4332-8cb7-b14726f19261 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-1b3d5302-ab12-4332-8cb7-b14726f19261 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1b3d5302-ab12-4332-8cb7-b14726f19261 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-1b3d5302-ab12-4332-8cb7-b14726f19261 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:37:02 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-1b3d5302-ab12-4332-8cb7-b14726f19261 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1b3d5302-ab12-4332-8cb7-b14726f19261 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-c2fc2d21-6841-4590-b16f-90d679a557af 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-dc9b06f0-da6c-480b-af80-2958e1d7958e tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (540f5ed9-6b7f-4046-92dd-61ca4e1d466d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f03ea40-4178-4f93-9f12-f51153230b68', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-dc9b06f0-da6c-480b-af80-2958e1d7958e tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eec30d85-a5cd-41b7-a44a-47c0bd82237c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:02 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-c2fc2d21-6841-4590-b16f-90d679a557af 1073741824 Nov 03 20:37:02 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:02 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-dc9b06f0-da6c-480b-af80-2958e1d7958e tempest-ProjectMemberTests-196532882 None] Volume volume-8f03ea40-4178-4f93-9f12-f51153230b68 (8f03ea40-4178-4f93-9f12-f51153230b68): created successfully Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-dc9b06f0-da6c-480b-af80-2958e1d7958e tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eec30d85-a5cd-41b7-a44a-47c0bd82237c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-dc9b06f0-da6c-480b-af80-2958e1d7958e tempest-ProjectMemberTests-196532882 None] Flow 'volume_create_manager' (152843ac-c076-4112-99d8-500aa5ecf46b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:37:02 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-dc9b06f0-da6c-480b-af80-2958e1d7958e tempest-ProjectMemberTests-196532882 None] Created volume successfully. Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e6fcf3ab-396e-447d-9e31-7649346093e2 tempest-CreateVolumesFromSnapshotTest-997127146 None] Acquiring lock "cinder-5cecc924-9318-449d-9da0-1c3c9d559e4d-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e6fcf3ab-396e-447d-9e31-7649346093e2 tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "cinder-5cecc924-9318-449d-9da0-1c3c9d559e4d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e6fcf3ab-396e-447d-9e31-7649346093e2 tempest-CreateVolumesFromSnapshotTest-997127146 None] Acquiring lock "cinder-quobyte-5cecc924-9318-449d-9da0-1c3c9d559e4d" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e6fcf3ab-396e-447d-9e31-7649346093e2 tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "cinder-quobyte-5cecc924-9318-449d-9da0-1c3c9d559e4d" acquired by "delete_volume" :: waited 0.019s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede043e2-8c10-4ab7-bc14-c4592b7a4b6b]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e6fcf3ab-396e-447d-9e31-7649346093e2 tempest-CreateVolumesFromSnapshotTest-997127146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5cecc924-9318-449d-9da0-1c3c9d559e4d {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:02 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5cecc924-9318-449d-9da0-1c3c9d559e4d Nov 03 20:37:02 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dec0e7c-f563-476e-8194-94dd70362af7 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4dec0e7c-f563-476e-8194-94dd70362af7 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Flow 'volume_create_manager' (c64a8d60-7003-4181-a3cf-6ab4bed2fdc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4dec0e7c-f563-476e-8194-94dd70362af7 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59ef2faa-bcc8-4aed-bf32-0cbd0be8a507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4dec0e7c-f563-476e-8194-94dd70362af7 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59ef2faa-bcc8-4aed-bf32-0cbd0be8a507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1673182946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db320d41-1ea3-4f8f-be39-52fd581a02e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616b987cdebe4c45b6eb46cedd7bbed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:37:03Z,use_quota=True,user_id='706d48ec1f2c42ae906352318c9469bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4dec0e7c-f563-476e-8194-94dd70362af7 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebd3c1e8-854d-484d-9255-8871c548f342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4dec0e7c-f563-476e-8194-94dd70362af7 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebd3c1e8-854d-484d-9255-8871c548f342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4dec0e7c-f563-476e-8194-94dd70362af7 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb74a64b-7b63-4fc9-a5d7-b4f0be8dba41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4dec0e7c-f563-476e-8194-94dd70362af7 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb74a64b-7b63-4fc9-a5d7-b4f0be8dba41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db320d41-1ea3-4f8f-be39-52fd581a02e1', 'volume_name': 'volume-db320d41-1ea3-4f8f-be39-52fd581a02e1', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4dec0e7c-f563-476e-8194-94dd70362af7 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (121dafa3-50f1-4387-b063-dae643bca7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4dec0e7c-f563-476e-8194-94dd70362af7 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (121dafa3-50f1-4387-b063-dae643bca7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4dec0e7c-f563-476e-8194-94dd70362af7 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e31eb32-c043-4623-b656-5dc5ded61839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:02 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-4dec0e7c-f563-476e-8194-94dd70362af7 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Volume db320d41-1ea3-4f8f-be39-52fd581a02e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db320d41-1ea3-4f8f-be39-52fd581a02e1', 'volume_size': 1} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4dec0e7c-f563-476e-8194-94dd70362af7 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] Flow 'volume_create_manager' (56da3420-7323-4ef4-8644-2098d74de986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63b7319c-12ef-49b0-88e2-ab1c3b79da25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63b7319c-12ef-49b0-88e2-ab1c3b79da25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-372072125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73f75b04-9315-4221-aa9f-e328ef7e76fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d963345a3e984352b53b7713a76d90d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1f0201b0-35cf-4912-ae84-d05c2fdf3b74,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:37:03Z,use_quota=True,user_id='321199d63c4245d3bc2c8cfb2cef0985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba95ebdd-c769-4e5f-a4ea-82aee5ec02cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba95ebdd-c769-4e5f-a4ea-82aee5ec02cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:02 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (235e1517-0b7c-43df-8d69-21b2ea4e61d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (235e1517-0b7c-43df-8d69-21b2ea4e61d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '73f75b04-9315-4221-aa9f-e328ef7e76fe', 'volume_name': 'volume-73f75b04-9315-4221-aa9f-e328ef7e76fe', 'volume_size': 1, 'snapshot_id': '1f0201b0-35cf-4912-ae84-d05c2fdf3b74'}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0f01c4f-134b-4438-9ac2-697a84fac890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0f01c4f-134b-4438-9ac2-697a84fac890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a0c4417-0d69-473b-bd43-fa58d65e7136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:02 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] Volume 73f75b04-9315-4221-aa9f-e328ef7e76fe: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-73f75b04-9315-4221-aa9f-e328ef7e76fe', 'volume_size': 1, 'snapshot_id': '1f0201b0-35cf-4912-ae84-d05c2fdf3b74'} Nov 03 20:37:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1b3d5302-ab12-4332-8cb7-b14726f19261 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-c2fc2d21-6841-4590-b16f-90d679a557af 1073741824" returned: 0 in 0.603s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1b3d5302-ab12-4332-8cb7-b14726f19261 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-c2fc2d21-6841-4590-b16f-90d679a557af {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:03 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-c2fc2d21-6841-4590-b16f-90d679a557af Nov 03 20:37:03 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:03 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e6fcf3ab-396e-447d-9e31-7649346093e2 tempest-CreateVolumesFromSnapshotTest-997127146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5cecc924-9318-449d-9da0-1c3c9d559e4d" returned: 0 in 0.446s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e6fcf3ab-396e-447d-9e31-7649346093e2 tempest-CreateVolumesFromSnapshotTest-997127146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5cecc924-9318-449d-9da0-1c3c9d559e4d {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:03 devstack sudo[106580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5cecc924-9318-449d-9da0-1c3c9d559e4d Nov 03 20:37:03 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:03 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1b3d5302-ab12-4332-8cb7-b14726f19261 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-c2fc2d21-6841-4590-b16f-90d679a557af" returned: 0 in 0.249s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:03 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-1b3d5302-ab12-4332-8cb7-b14726f19261 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:37:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1b3d5302-ab12-4332-8cb7-b14726f19261 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7c9d1c1c-72d7-4479-8dba-b3584c8fe6a0 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.054s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:03 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-7c9d1c1c-72d7-4479-8dba-b3584c8fe6a0 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1062371964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d3e403f-c47a-460c-85af-8fa09603b693,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616b987cdebe4c45b6eb46cedd7bbed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:37:01Z,use_quota=True,user_id='706d48ec1f2c42ae906352318c9469bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:37:03 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-7c9d1c1c-72d7-4479-8dba-b3584c8fe6a0 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Creating volume 3d3e403f-c47a-460c-85af-8fa09603b693 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:37:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7c9d1c1c-72d7-4479-8dba-b3584c8fe6a0 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7c9d1c1c-72d7-4479-8dba-b3584c8fe6a0 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:03 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-7c9d1c1c-72d7-4479-8dba-b3584c8fe6a0 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:37:03 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-7c9d1c1c-72d7-4479-8dba-b3584c8fe6a0 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:37:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7c9d1c1c-72d7-4479-8dba-b3584c8fe6a0 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:03 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-7c9d1c1c-72d7-4479-8dba-b3584c8fe6a0 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:37:03 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-7c9d1c1c-72d7-4479-8dba-b3584c8fe6a0 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:37:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7c9d1c1c-72d7-4479-8dba-b3584c8fe6a0 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3d3e403f-c47a-460c-85af-8fa09603b693 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:03 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1b3d5302-ab12-4332-8cb7-b14726f19261 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ab1b496-cb0f-42e5-8fb7-b13aa99c03aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2fc2d21-6841-4590-b16f-90d679a557af', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:03 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3d3e403f-c47a-460c-85af-8fa09603b693 1073741824 Nov 03 20:37:03 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1b3d5302-ab12-4332-8cb7-b14726f19261 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b27da45b-0a6b-47dc-aec1-19436c56874e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:03 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:03 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e6fcf3ab-396e-447d-9e31-7649346093e2 tempest-CreateVolumesFromSnapshotTest-997127146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-5cecc924-9318-449d-9da0-1c3c9d559e4d" returned: 0 in 0.277s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:03 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-1b3d5302-ab12-4332-8cb7-b14726f19261 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Volume volume-c2fc2d21-6841-4590-b16f-90d679a557af (c2fc2d21-6841-4590-b16f-90d679a557af): created successfully Nov 03 20:37:03 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1b3d5302-ab12-4332-8cb7-b14726f19261 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b27da45b-0a6b-47dc-aec1-19436c56874e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:03 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1b3d5302-ab12-4332-8cb7-b14726f19261 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Flow 'volume_create_manager' (d4f5a7a8-f7f1-4e33-9be0-2860908e680f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:37:03 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e6fcf3ab-396e-447d-9e31-7649346093e2 tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "cinder-quobyte-5cecc924-9318-449d-9da0-1c3c9d559e4d" released by "delete_volume" :: held 0.845s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:03 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-1b3d5302-ab12-4332-8cb7-b14726f19261 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Created volume successfully. Nov 03 20:37:03 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-e6fcf3ab-396e-447d-9e31-7649346093e2 tempest-CreateVolumesFromSnapshotTest-997127146 None] Created reservations ['20324607-03fb-4c04-8138-43b5e9399b90', '97264cbd-d629-40ec-a3f1-3ebcccffe80f', '102ab075-3dfe-4e63-97be-288f12a3df6c', '95544d16-8f48-42b2-a7b7-f271a7d84484'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:37:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e6fcf3ab-396e-447d-9e31-7649346093e2 tempest-CreateVolumesFromSnapshotTest-997127146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e6fcf3ab-396e-447d-9e31-7649346093e2 tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:03 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e6fcf3ab-396e-447d-9e31-7649346093e2 tempest-CreateVolumesFromSnapshotTest-997127146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:37:03 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e6fcf3ab-396e-447d-9e31-7649346093e2 tempest-CreateVolumesFromSnapshotTest-997127146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:37:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e6fcf3ab-396e-447d-9e31-7649346093e2 tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e6fcf3ab-396e-447d-9e31-7649346093e2 tempest-CreateVolumesFromSnapshotTest-997127146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:03 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:37:03 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:03 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9d008544-9f7a-4c5e-92d0-a4b56cb0db5c tempest-CreateVolumesFromSnapshotTest-997127146 None] Acquiring lock "cinder-9ade2251-2e77-4e84-9974-46ba2e655f91-delete_snapshot" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:03 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9d008544-9f7a-4c5e-92d0-a4b56cb0db5c tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "cinder-9ade2251-2e77-4e84-9974-46ba2e655f91-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:03 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9d008544-9f7a-4c5e-92d0-a4b56cb0db5c tempest-CreateVolumesFromSnapshotTest-997127146 None] Acquiring lock "cinder-quobyte-b2d077ab-47f0-456e-bf92-85ce7e83aa83" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-46a492d3-711f-4a1e-b115-e8f291811468 tempest-ProjectMemberTests-196532882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:03 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9d008544-9f7a-4c5e-92d0-a4b56cb0db5c tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "cinder-quobyte-b2d077ab-47f0-456e-bf92-85ce7e83aa83" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:03 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9d008544-9f7a-4c5e-92d0-a4b56cb0db5c tempest-CreateVolumesFromSnapshotTest-997127146 None] Acquiring lock "cinder-quobyte-9ade2251-2e77-4e84-9974-46ba2e655f91" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:03 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9d008544-9f7a-4c5e-92d0-a4b56cb0db5c tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "cinder-quobyte-9ade2251-2e77-4e84-9974-46ba2e655f91" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:03 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-9d008544-9f7a-4c5e-92d0-a4b56cb0db5c tempest-CreateVolumesFromSnapshotTest-997127146 None] Deleting offline snapshot 9ade2251-2e77-4e84-9974-46ba2e655f91 of volume b2d077ab-47f0-456e-bf92-85ce7e83aa83 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:37:03 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-9d008544-9f7a-4c5e-92d0-a4b56cb0db5c tempest-CreateVolumesFromSnapshotTest-997127146 None] snapshot_file for this snap is: volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83.9ade2251-2e77-4e84-9974-46ba2e655f91 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:37:03 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5a44ec-4296-4183-9368-6e7a226ea5ad]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9d008544-9f7a-4c5e-92d0-a4b56cb0db5c tempest-CreateVolumesFromSnapshotTest-997127146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83.9ade2251-2e77-4e84-9974-46ba2e655f91 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:03 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7c9d1c1c-72d7-4479-8dba-b3584c8fe6a0 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3d3e403f-c47a-460c-85af-8fa09603b693 1073741824" returned: 0 in 0.567s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7c9d1c1c-72d7-4479-8dba-b3584c8fe6a0 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3d3e403f-c47a-460c-85af-8fa09603b693 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:03 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3d3e403f-c47a-460c-85af-8fa09603b693 Nov 03 20:37:03 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:03 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e6fcf3ab-396e-447d-9e31-7649346093e2 tempest-CreateVolumesFromSnapshotTest-997127146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.348s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:03 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-e6fcf3ab-396e-447d-9e31-7649346093e2 tempest-CreateVolumesFromSnapshotTest-997127146 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:37:03 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-e6fcf3ab-396e-447d-9e31-7649346093e2 tempest-CreateVolumesFromSnapshotTest-997127146 None] Deleted volume successfully. Nov 03 20:37:03 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e6fcf3ab-396e-447d-9e31-7649346093e2 tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "cinder-5cecc924-9318-449d-9da0-1c3c9d559e4d-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:03 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83.9ade2251-2e77-4e84-9974-46ba2e655f91 Nov 03 20:37:03 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:04 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7c9d1c1c-72d7-4479-8dba-b3584c8fe6a0 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3d3e403f-c47a-460c-85af-8fa09603b693" returned: 0 in 0.255s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:04 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-7c9d1c1c-72d7-4479-8dba-b3584c8fe6a0 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:37:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7c9d1c1c-72d7-4479-8dba-b3584c8fe6a0 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ca5f8127-9bc2-407d-82b0-deace731692b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.466s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:04 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-ca5f8127-9bc2-407d-82b0-deace731692b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-994677278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f5965d9-c384-4e40-b885-1f1dd0b82591,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616b987cdebe4c45b6eb46cedd7bbed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:37:01Z,use_quota=True,user_id='706d48ec1f2c42ae906352318c9469bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:37:04 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-ca5f8127-9bc2-407d-82b0-deace731692b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Creating volume 1f5965d9-c384-4e40-b885-1f1dd0b82591 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:37:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ca5f8127-9bc2-407d-82b0-deace731692b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ca5f8127-9bc2-407d-82b0-deace731692b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:04 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-ca5f8127-9bc2-407d-82b0-deace731692b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:37:04 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-ca5f8127-9bc2-407d-82b0-deace731692b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:37:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ca5f8127-9bc2-407d-82b0-deace731692b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:04 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-ca5f8127-9bc2-407d-82b0-deace731692b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:37:04 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-ca5f8127-9bc2-407d-82b0-deace731692b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:37:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ca5f8127-9bc2-407d-82b0-deace731692b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f5965d9-c384-4e40-b885-1f1dd0b82591 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:04 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7c9d1c1c-72d7-4479-8dba-b3584c8fe6a0 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81c34785-54eb-41c2-bc41-59df5ebcc353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d3e403f-c47a-460c-85af-8fa09603b693', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:04 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f5965d9-c384-4e40-b885-1f1dd0b82591 1073741824 Nov 03 20:37:04 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:04 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7c9d1c1c-72d7-4479-8dba-b3584c8fe6a0 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce7af3b1-a22f-493b-a9ad-fb835b2da78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:04 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-7c9d1c1c-72d7-4479-8dba-b3584c8fe6a0 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Volume volume-3d3e403f-c47a-460c-85af-8fa09603b693 (3d3e403f-c47a-460c-85af-8fa09603b693): created successfully Nov 03 20:37:04 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7c9d1c1c-72d7-4479-8dba-b3584c8fe6a0 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce7af3b1-a22f-493b-a9ad-fb835b2da78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:04 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7c9d1c1c-72d7-4479-8dba-b3584c8fe6a0 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Flow 'volume_create_manager' (ef83c8bc-4b01-4362-b28e-af17f1e4ae5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:37:04 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:04 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-7c9d1c1c-72d7-4479-8dba-b3584c8fe6a0 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Created volume successfully. Nov 03 20:37:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9d008544-9f7a-4c5e-92d0-a4b56cb0db5c tempest-CreateVolumesFromSnapshotTest-997127146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83.9ade2251-2e77-4e84-9974-46ba2e655f91" returned: 0 in 0.411s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:04 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-9d008544-9f7a-4c5e-92d0-a4b56cb0db5c tempest-CreateVolumesFromSnapshotTest-997127146 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:37:04 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d16f01-f8e7-486a-8eeb-68d527c586f2]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9d008544-9f7a-4c5e-92d0-a4b56cb0db5c tempest-CreateVolumesFromSnapshotTest-997127146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:04 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83 Nov 03 20:37:04 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:04 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ca5f8127-9bc2-407d-82b0-deace731692b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f5965d9-c384-4e40-b885-1f1dd0b82591 1073741824" returned: 0 in 0.483s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:04 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9d008544-9f7a-4c5e-92d0-a4b56cb0db5c tempest-CreateVolumesFromSnapshotTest-997127146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83" returned: 0 in 0.397s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9d008544-9f7a-4c5e-92d0-a4b56cb0db5c tempest-CreateVolumesFromSnapshotTest-997127146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83.9ade2251-2e77-4e84-9974-46ba2e655f91 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:04 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83.9ade2251-2e77-4e84-9974-46ba2e655f91 Nov 03 20:37:04 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ca5f8127-9bc2-407d-82b0-deace731692b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f5965d9-c384-4e40-b885-1f1dd0b82591 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:04 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f5965d9-c384-4e40-b885-1f1dd0b82591 Nov 03 20:37:04 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:04 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ca5f8127-9bc2-407d-82b0-deace731692b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f5965d9-c384-4e40-b885-1f1dd0b82591" returned: 0 in 0.255s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:04 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-ca5f8127-9bc2-407d-82b0-deace731692b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:37:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ca5f8127-9bc2-407d-82b0-deace731692b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a088a7a5-7cad-402c-b12f-c85d6ec31da5 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.786s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:04 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a088a7a5-7cad-402c-b12f-c85d6ec31da5 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-71246226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce9020e5-38e8-406c-a5f5-6636e6620e43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616b987cdebe4c45b6eb46cedd7bbed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:37:02Z,use_quota=True,user_id='706d48ec1f2c42ae906352318c9469bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:37:04 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-a088a7a5-7cad-402c-b12f-c85d6ec31da5 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Creating volume ce9020e5-38e8-406c-a5f5-6636e6620e43 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:37:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a088a7a5-7cad-402c-b12f-c85d6ec31da5 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a088a7a5-7cad-402c-b12f-c85d6ec31da5 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:04 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a088a7a5-7cad-402c-b12f-c85d6ec31da5 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:37:04 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a088a7a5-7cad-402c-b12f-c85d6ec31da5 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:37:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a088a7a5-7cad-402c-b12f-c85d6ec31da5 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:04 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a088a7a5-7cad-402c-b12f-c85d6ec31da5 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:37:04 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-a088a7a5-7cad-402c-b12f-c85d6ec31da5 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:37:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a088a7a5-7cad-402c-b12f-c85d6ec31da5 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ce9020e5-38e8-406c-a5f5-6636e6620e43 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:05 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ca5f8127-9bc2-407d-82b0-deace731692b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (069b23d1-e7d3-47da-bd6c-28189cdf888d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f5965d9-c384-4e40-b885-1f1dd0b82591', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:05 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ce9020e5-38e8-406c-a5f5-6636e6620e43 1073741824 Nov 03 20:37:05 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:05 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:05 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ca5f8127-9bc2-407d-82b0-deace731692b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23094d74-6d1c-4021-9a0b-b61c3778a637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9d008544-9f7a-4c5e-92d0-a4b56cb0db5c tempest-CreateVolumesFromSnapshotTest-997127146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83.9ade2251-2e77-4e84-9974-46ba2e655f91" returned: 0 in 0.335s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9d008544-9f7a-4c5e-92d0-a4b56cb0db5c tempest-CreateVolumesFromSnapshotTest-997127146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83.9ade2251-2e77-4e84-9974-46ba2e655f91 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:05 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-ca5f8127-9bc2-407d-82b0-deace731692b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Volume volume-1f5965d9-c384-4e40-b885-1f1dd0b82591 (1f5965d9-c384-4e40-b885-1f1dd0b82591): created successfully Nov 03 20:37:05 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83.9ade2251-2e77-4e84-9974-46ba2e655f91 Nov 03 20:37:05 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:05 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ca5f8127-9bc2-407d-82b0-deace731692b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23094d74-6d1c-4021-9a0b-b61c3778a637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:05 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ca5f8127-9bc2-407d-82b0-deace731692b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Flow 'volume_create_manager' (d322b55d-3cc3-4718-98d3-0b56e25f704c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:37:05 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-ca5f8127-9bc2-407d-82b0-deace731692b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Created volume successfully. Nov 03 20:37:05 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9d008544-9f7a-4c5e-92d0-a4b56cb0db5c tempest-CreateVolumesFromSnapshotTest-997127146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83.9ade2251-2e77-4e84-9974-46ba2e655f91" returned: 0 in 0.246s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:05 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9d008544-9f7a-4c5e-92d0-a4b56cb0db5c tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "cinder-quobyte-9ade2251-2e77-4e84-9974-46ba2e655f91" released by "_delete_snapshot" :: held 1.504s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:05 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9d008544-9f7a-4c5e-92d0-a4b56cb0db5c tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "cinder-quobyte-b2d077ab-47f0-456e-bf92-85ce7e83aa83" released by "delete_snapshot" :: held 1.529s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:05 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-9d008544-9f7a-4c5e-92d0-a4b56cb0db5c tempest-CreateVolumesFromSnapshotTest-997127146 None] Created reservations ['d8702d88-ce44-4c80-8ed1-bd8e50dbb667', '1f263837-1b24-42cf-a2c7-4881720513eb', '72b7084b-3df4-4781-aeda-ab975969bb34', '9e02a2a5-d6bd-4ae8-b60d-1062ae0afb64'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:37:05 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-9d008544-9f7a-4c5e-92d0-a4b56cb0db5c tempest-CreateVolumesFromSnapshotTest-997127146 None] Delete snapshot completed successfully. Nov 03 20:37:05 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a088a7a5-7cad-402c-b12f-c85d6ec31da5 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ce9020e5-38e8-406c-a5f5-6636e6620e43 1073741824" returned: 0 in 0.449s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:05 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9d008544-9f7a-4c5e-92d0-a4b56cb0db5c tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "cinder-9ade2251-2e77-4e84-9974-46ba2e655f91-delete_snapshot" released by "delete_snapshot" :: held 1.684s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a088a7a5-7cad-402c-b12f-c85d6ec31da5 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ce9020e5-38e8-406c-a5f5-6636e6620e43 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:05 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ce9020e5-38e8-406c-a5f5-6636e6620e43 Nov 03 20:37:05 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:05 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a088a7a5-7cad-402c-b12f-c85d6ec31da5 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ce9020e5-38e8-406c-a5f5-6636e6620e43" returned: 0 in 0.259s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:05 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a088a7a5-7cad-402c-b12f-c85d6ec31da5 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:37:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a088a7a5-7cad-402c-b12f-c85d6ec31da5 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4dec0e7c-f563-476e-8194-94dd70362af7 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.811s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:05 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-4dec0e7c-f563-476e-8194-94dd70362af7 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1673182946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db320d41-1ea3-4f8f-be39-52fd581a02e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616b987cdebe4c45b6eb46cedd7bbed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:37:03Z,use_quota=True,user_id='706d48ec1f2c42ae906352318c9469bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:37:05 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-4dec0e7c-f563-476e-8194-94dd70362af7 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Creating volume db320d41-1ea3-4f8f-be39-52fd581a02e1 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:37:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4dec0e7c-f563-476e-8194-94dd70362af7 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4dec0e7c-f563-476e-8194-94dd70362af7 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:05 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-4dec0e7c-f563-476e-8194-94dd70362af7 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:37:05 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-4dec0e7c-f563-476e-8194-94dd70362af7 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:37:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4dec0e7c-f563-476e-8194-94dd70362af7 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:05 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-4dec0e7c-f563-476e-8194-94dd70362af7 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:37:05 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-4dec0e7c-f563-476e-8194-94dd70362af7 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:37:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4dec0e7c-f563-476e-8194-94dd70362af7 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-db320d41-1ea3-4f8f-be39-52fd581a02e1 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:05 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a088a7a5-7cad-402c-b12f-c85d6ec31da5 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27fb3c72-e395-463d-9f09-ce3c2dbcb2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce9020e5-38e8-406c-a5f5-6636e6620e43', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:05 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-db320d41-1ea3-4f8f-be39-52fd581a02e1 1073741824 Nov 03 20:37:05 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a088a7a5-7cad-402c-b12f-c85d6ec31da5 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18994aef-9717-49ac-baa5-3b5b0992814a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:05 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:05 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-a088a7a5-7cad-402c-b12f-c85d6ec31da5 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Volume volume-ce9020e5-38e8-406c-a5f5-6636e6620e43 (ce9020e5-38e8-406c-a5f5-6636e6620e43): created successfully Nov 03 20:37:05 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a088a7a5-7cad-402c-b12f-c85d6ec31da5 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18994aef-9717-49ac-baa5-3b5b0992814a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:05 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a088a7a5-7cad-402c-b12f-c85d6ec31da5 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Flow 'volume_create_manager' (a10b9ac0-aefe-4599-8b45-be9ef5fc1cdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:37:05 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-a088a7a5-7cad-402c-b12f-c85d6ec31da5 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Created volume successfully. Nov 03 20:37:05 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-0de46e99-13f0-4e73-b5ad-e1fbe0d3e7f2 tempest-CreateVolumesFromSnapshotTest-997127146 None] Acquiring lock "cinder-b2d077ab-47f0-456e-bf92-85ce7e83aa83-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:05 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-0de46e99-13f0-4e73-b5ad-e1fbe0d3e7f2 tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "cinder-b2d077ab-47f0-456e-bf92-85ce7e83aa83-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:05 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-0de46e99-13f0-4e73-b5ad-e1fbe0d3e7f2 tempest-CreateVolumesFromSnapshotTest-997127146 None] Acquiring lock "cinder-quobyte-b2d077ab-47f0-456e-bf92-85ce7e83aa83" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:05 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-0de46e99-13f0-4e73-b5ad-e1fbe0d3e7f2 tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "cinder-quobyte-b2d077ab-47f0-456e-bf92-85ce7e83aa83" acquired by "delete_volume" :: waited 0.026s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:06 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89bdc1b-ca8a-49bc-893a-ee8263513414]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-0de46e99-13f0-4e73-b5ad-e1fbe0d3e7f2 tempest-CreateVolumesFromSnapshotTest-997127146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:06 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83 Nov 03 20:37:06 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:06 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4dec0e7c-f563-476e-8194-94dd70362af7 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-db320d41-1ea3-4f8f-be39-52fd581a02e1 1073741824" returned: 0 in 0.476s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4dec0e7c-f563-476e-8194-94dd70362af7 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-db320d41-1ea3-4f8f-be39-52fd581a02e1 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:06 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-db320d41-1ea3-4f8f-be39-52fd581a02e1 Nov 03 20:37:06 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:06 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-0de46e99-13f0-4e73-b5ad-e1fbe0d3e7f2 tempest-CreateVolumesFromSnapshotTest-997127146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83" returned: 0 in 0.385s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-0de46e99-13f0-4e73-b5ad-e1fbe0d3e7f2 tempest-CreateVolumesFromSnapshotTest-997127146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:06 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83 Nov 03 20:37:06 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:06 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4dec0e7c-f563-476e-8194-94dd70362af7 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-db320d41-1ea3-4f8f-be39-52fd581a02e1" returned: 0 in 0.273s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-4dec0e7c-f563-476e-8194-94dd70362af7 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:37:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4dec0e7c-f563-476e-8194-94dd70362af7 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.544s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:06 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] Acquiring lock "cinder-quobyte-1f0201b0-35cf-4912-ae84-d05c2fdf3b74-73f75b04-9315-4221-aa9f-e328ef7e76fe" by "_create_volume_from_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4dec0e7c-f563-476e-8194-94dd70362af7 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e31eb32-c043-4623-b656-5dc5ded61839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db320d41-1ea3-4f8f-be39-52fd581a02e1', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4dec0e7c-f563-476e-8194-94dd70362af7 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4983e2d-3b28-4ff5-a9ef-7a9ac1b4ce78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:06 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] Lock "cinder-quobyte-1f0201b0-35cf-4912-ae84-d05c2fdf3b74-73f75b04-9315-4221-aa9f-e328ef7e76fe" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] Creating volume 73f75b04-9315-4221-aa9f-e328ef7e76fe from snapshot 1f0201b0-35cf-4912-ae84-d05c2fdf3b74 {{(pid=87248) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 20:37:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:37:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:37:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:37:06 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] Acquiring lock "cinder-quobyte-73f75b04-9315-4221-aa9f-e328ef7e76fe" by "_copy_volume_from_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:06 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-4dec0e7c-f563-476e-8194-94dd70362af7 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Volume volume-db320d41-1ea3-4f8f-be39-52fd581a02e1 (db320d41-1ea3-4f8f-be39-52fd581a02e1): created successfully Nov 03 20:37:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4dec0e7c-f563-476e-8194-94dd70362af7 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4983e2d-3b28-4ff5-a9ef-7a9ac1b4ce78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:06 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-4dec0e7c-f563-476e-8194-94dd70362af7 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Flow 'volume_create_manager' (c64a8d60-7003-4181-a3cf-6ab4bed2fdc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:37:06 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] Lock "cinder-quobyte-73f75b04-9315-4221-aa9f-e328ef7e76fe" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] snapshot: 1f0201b0-35cf-4912-ae84-d05c2fdf3b74, volume: 73f75b04-9315-4221-aa9f-e328ef7e76fe, {{(pid=87248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 20:37:06 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-4dec0e7c-f563-476e-8194-94dd70362af7 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Created volume successfully. Nov 03 20:37:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:37:06 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:37:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-0de46e99-13f0-4e73-b5ad-e1fbe0d3e7f2 tempest-CreateVolumesFromSnapshotTest-997127146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-b2d077ab-47f0-456e-bf92-85ce7e83aa83" returned: 0 in 0.286s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:06 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0ebe11-9f4b-4217-a2c5-17af3c269674]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75.1f0201b0-35cf-4912-ae84-d05c2fdf3b74 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:06 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-0de46e99-13f0-4e73-b5ad-e1fbe0d3e7f2 tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "cinder-quobyte-b2d077ab-47f0-456e-bf92-85ce7e83aa83" released by "delete_volume" :: held 0.748s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:06 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-0de46e99-13f0-4e73-b5ad-e1fbe0d3e7f2 tempest-CreateVolumesFromSnapshotTest-997127146 None] Created reservations ['f2707593-221d-4902-b3ac-c34f88970ca2', '79424703-bb7f-496a-9b1b-eeeb16328d4a', 'c771bdb2-8fd3-4425-ab5a-eb4edfc5a383', 'b797650c-b041-4094-8498-9e32ee245076'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:37:06 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75.1f0201b0-35cf-4912-ae84-d05c2fdf3b74 Nov 03 20:37:06 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-0de46e99-13f0-4e73-b5ad-e1fbe0d3e7f2 tempest-CreateVolumesFromSnapshotTest-997127146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-0de46e99-13f0-4e73-b5ad-e1fbe0d3e7f2 tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-0de46e99-13f0-4e73-b5ad-e1fbe0d3e7f2 tempest-CreateVolumesFromSnapshotTest-997127146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:37:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-0de46e99-13f0-4e73-b5ad-e1fbe0d3e7f2 tempest-CreateVolumesFromSnapshotTest-997127146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:37:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-0de46e99-13f0-4e73-b5ad-e1fbe0d3e7f2 tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-0de46e99-13f0-4e73-b5ad-e1fbe0d3e7f2 tempest-CreateVolumesFromSnapshotTest-997127146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:06 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:37:06 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:07 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7e8776ef-cd65-4d69-80aa-20391b0641d3 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Acquiring lock "cinder-db320d41-1ea3-4f8f-be39-52fd581a02e1-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:07 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7e8776ef-cd65-4d69-80aa-20391b0641d3 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "cinder-db320d41-1ea3-4f8f-be39-52fd581a02e1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:07 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7e8776ef-cd65-4d69-80aa-20391b0641d3 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Acquiring lock "cinder-quobyte-db320d41-1ea3-4f8f-be39-52fd581a02e1" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:07 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7e8776ef-cd65-4d69-80aa-20391b0641d3 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "cinder-quobyte-db320d41-1ea3-4f8f-be39-52fd581a02e1" acquired by "delete_volume" :: waited 0.026s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:07 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75.1f0201b0-35cf-4912-ae84-d05c2fdf3b74" returned: 0 in 0.455s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:07 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dda7d68-4eb0-4065-b783-3394d41b8c75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:37:07 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6dac67-0b16-464a-8ca6-fa9d3211c2bd]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7e8776ef-cd65-4d69-80aa-20391b0641d3 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-db320d41-1ea3-4f8f-be39-52fd581a02e1 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:07 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:07 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3f7354-3919-47a5-87ad-4ec8706291bc]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-0de46e99-13f0-4e73-b5ad-e1fbe0d3e7f2 tempest-CreateVolumesFromSnapshotTest-997127146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.341s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:07 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-0de46e99-13f0-4e73-b5ad-e1fbe0d3e7f2 tempest-CreateVolumesFromSnapshotTest-997127146 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:37:07 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-0de46e99-13f0-4e73-b5ad-e1fbe0d3e7f2 tempest-CreateVolumesFromSnapshotTest-997127146 None] Deleted volume successfully. Nov 03 20:37:07 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-0de46e99-13f0-4e73-b5ad-e1fbe0d3e7f2 tempest-CreateVolumesFromSnapshotTest-997127146 None] Lock "cinder-b2d077ab-47f0-456e-bf92-85ce7e83aa83-delete_volume" released by "delete_volume" :: held 1.329s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:07 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-db320d41-1ea3-4f8f-be39-52fd581a02e1 Nov 03 20:37:07 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:07 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75 Nov 03 20:37:07 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:07 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7e8776ef-cd65-4d69-80aa-20391b0641d3 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-db320d41-1ea3-4f8f-be39-52fd581a02e1" returned: 0 in 0.415s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7e8776ef-cd65-4d69-80aa-20391b0641d3 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-db320d41-1ea3-4f8f-be39-52fd581a02e1 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:07 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-db320d41-1ea3-4f8f-be39-52fd581a02e1 Nov 03 20:37:07 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:07 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75" returned: 0 in 0.442s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:07 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75 {{(pid=87248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 20:37:07 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] Creating direct copy from snapshot {{(pid=87248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 20:37:07 devstack cinder-volume[87248]: DEBUG cinder.utils [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] Path /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-73f75b04-9315-4221-aa9f-e328ef7e76fe not found in is_blk_device check {{(pid=87248) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 20:37:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-73f75b04-9315-4221-aa9f-e328ef7e76fe {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:07 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-73f75b04-9315-4221-aa9f-e328ef7e76fe Nov 03 20:37:07 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:07 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7e8776ef-cd65-4d69-80aa-20391b0641d3 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-db320d41-1ea3-4f8f-be39-52fd581a02e1" returned: 0 in 0.301s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:07 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7e8776ef-cd65-4d69-80aa-20391b0641d3 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "cinder-quobyte-db320d41-1ea3-4f8f-be39-52fd581a02e1" released by "delete_volume" :: held 0.780s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:07 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-7e8776ef-cd65-4d69-80aa-20391b0641d3 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Created reservations ['1e3a1848-4bdb-498d-9689-bbea013f4a75', '0a388665-8761-4c87-9389-13ba4dc12f08', '68f87ccb-f863-42f3-9c0a-ccd2a327269f', '4161953a-5614-4c90-a6ad-a9fafbf34e1b'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:37:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7e8776ef-cd65-4d69-80aa-20391b0641d3 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7e8776ef-cd65-4d69-80aa-20391b0641d3 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:08 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-7e8776ef-cd65-4d69-80aa-20391b0641d3 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:37:08 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-7e8776ef-cd65-4d69-80aa-20391b0641d3 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:37:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7e8776ef-cd65-4d69-80aa-20391b0641d3 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7e8776ef-cd65-4d69-80aa-20391b0641d3 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:08 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:37:08 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:08 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fefaff21-8c91-43cc-b574-8bc23faa621c tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Acquiring lock "cinder-ce9020e5-38e8-406c-a5f5-6636e6620e43-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:08 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fefaff21-8c91-43cc-b574-8bc23faa621c tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "cinder-ce9020e5-38e8-406c-a5f5-6636e6620e43-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:08 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fefaff21-8c91-43cc-b574-8bc23faa621c tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Acquiring lock "cinder-quobyte-ce9020e5-38e8-406c-a5f5-6636e6620e43" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:08 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fefaff21-8c91-43cc-b574-8bc23faa621c tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "cinder-quobyte-ce9020e5-38e8-406c-a5f5-6636e6620e43" acquired by "delete_volume" :: waited 0.035s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:08 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[6872d1a1-bd5b-4949-8f9a-f13cdfa50933]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fefaff21-8c91-43cc-b574-8bc23faa621c tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ce9020e5-38e8-406c-a5f5-6636e6620e43 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:08 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7e8776ef-cd65-4d69-80aa-20391b0641d3 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.426s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:08 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-7e8776ef-cd65-4d69-80aa-20391b0641d3 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:37:08 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-7e8776ef-cd65-4d69-80aa-20391b0641d3 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Deleted volume successfully. Nov 03 20:37:08 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7e8776ef-cd65-4d69-80aa-20391b0641d3 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "cinder-db320d41-1ea3-4f8f-be39-52fd581a02e1-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:08 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ce9020e5-38e8-406c-a5f5-6636e6620e43 Nov 03 20:37:08 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:09 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fefaff21-8c91-43cc-b574-8bc23faa621c tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ce9020e5-38e8-406c-a5f5-6636e6620e43" returned: 0 in 0.859s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fefaff21-8c91-43cc-b574-8bc23faa621c tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ce9020e5-38e8-406c-a5f5-6636e6620e43 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:09 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ce9020e5-38e8-406c-a5f5-6636e6620e43 Nov 03 20:37:09 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:09 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fefaff21-8c91-43cc-b574-8bc23faa621c tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ce9020e5-38e8-406c-a5f5-6636e6620e43" returned: 0 in 0.546s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:09 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fefaff21-8c91-43cc-b574-8bc23faa621c tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "cinder-quobyte-ce9020e5-38e8-406c-a5f5-6636e6620e43" released by "delete_volume" :: held 1.511s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:10 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-fefaff21-8c91-43cc-b574-8bc23faa621c tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Created reservations ['99462ed4-e4b7-4544-9ee0-e13e479d6296', '3d9d0f67-b63a-4091-93dd-7813937f440b', '38575817-d875-4ba1-8987-c5bfaa44afb1', '6c3cc062-c5e7-45c1-a32b-717fd324d6bd'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:37:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-fefaff21-8c91-43cc-b574-8bc23faa621c tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-fefaff21-8c91-43cc-b574-8bc23faa621c tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:10 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-fefaff21-8c91-43cc-b574-8bc23faa621c tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:37:10 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-fefaff21-8c91-43cc-b574-8bc23faa621c tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:37:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-fefaff21-8c91-43cc-b574-8bc23faa621c tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fefaff21-8c91-43cc-b574-8bc23faa621c tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:10 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:37:10 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:10 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fefaff21-8c91-43cc-b574-8bc23faa621c tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.448s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:10 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-fefaff21-8c91-43cc-b574-8bc23faa621c tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:37:10 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-fefaff21-8c91-43cc-b574-8bc23faa621c tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Deleted volume successfully. Nov 03 20:37:10 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-872de9c0-4d5b-4319-8ef2-c7a0cb1be1e3 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Acquiring lock "cinder-1f5965d9-c384-4e40-b885-1f1dd0b82591-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:10 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fefaff21-8c91-43cc-b574-8bc23faa621c tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "cinder-ce9020e5-38e8-406c-a5f5-6636e6620e43-delete_volume" released by "delete_volume" :: held 2.475s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:10 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-872de9c0-4d5b-4319-8ef2-c7a0cb1be1e3 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "cinder-1f5965d9-c384-4e40-b885-1f1dd0b82591-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:10 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-872de9c0-4d5b-4319-8ef2-c7a0cb1be1e3 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Acquiring lock "cinder-quobyte-1f5965d9-c384-4e40-b885-1f1dd0b82591" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:10 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-872de9c0-4d5b-4319-8ef2-c7a0cb1be1e3 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "cinder-quobyte-1f5965d9-c384-4e40-b885-1f1dd0b82591" acquired by "delete_volume" :: waited 0.031s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:10 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[8070e5fe-97ff-478e-98a8-fa17caeac9a5]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-872de9c0-4d5b-4319-8ef2-c7a0cb1be1e3 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f5965d9-c384-4e40-b885-1f1dd0b82591 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:11 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f5965d9-c384-4e40-b885-1f1dd0b82591 Nov 03 20:37:11 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:11 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-872de9c0-4d5b-4319-8ef2-c7a0cb1be1e3 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f5965d9-c384-4e40-b885-1f1dd0b82591" returned: 0 in 0.559s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-872de9c0-4d5b-4319-8ef2-c7a0cb1be1e3 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f5965d9-c384-4e40-b885-1f1dd0b82591 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:11 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f5965d9-c384-4e40-b885-1f1dd0b82591 Nov 03 20:37:11 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:11 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-872de9c0-4d5b-4319-8ef2-c7a0cb1be1e3 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1f5965d9-c384-4e40-b885-1f1dd0b82591" returned: 0 in 0.497s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:12 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-872de9c0-4d5b-4319-8ef2-c7a0cb1be1e3 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "cinder-quobyte-1f5965d9-c384-4e40-b885-1f1dd0b82591" released by "delete_volume" :: held 1.177s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:12 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-872de9c0-4d5b-4319-8ef2-c7a0cb1be1e3 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Created reservations ['a5da8faf-6a34-4557-9afc-52733f5da776', '03ece942-6de0-4e62-a9bc-32ff6ab38a33', 'a1880a67-fdbb-4725-bacc-153b9f7a70ef', '1cff40e5-d86a-4dce-bd97-db6e181c19e1'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:37:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-872de9c0-4d5b-4319-8ef2-c7a0cb1be1e3 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-872de9c0-4d5b-4319-8ef2-c7a0cb1be1e3 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:12 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-872de9c0-4d5b-4319-8ef2-c7a0cb1be1e3 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:37:12 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-872de9c0-4d5b-4319-8ef2-c7a0cb1be1e3 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:37:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-872de9c0-4d5b-4319-8ef2-c7a0cb1be1e3 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-872de9c0-4d5b-4319-8ef2-c7a0cb1be1e3 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:12 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:37:12 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-ce6d2b95-d20c-440a-a230-2b6890c5b969 tempest-ProjectAdminTests-1017391939 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6631889343262, 'free_capacity_gb': 1773.6631889343262, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87248) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 03 20:37:12 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-872de9c0-4d5b-4319-8ef2-c7a0cb1be1e3 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.471s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:12 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-872de9c0-4d5b-4319-8ef2-c7a0cb1be1e3 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:37:12 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-872de9c0-4d5b-4319-8ef2-c7a0cb1be1e3 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Deleted volume successfully. Nov 03 20:37:12 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-872de9c0-4d5b-4319-8ef2-c7a0cb1be1e3 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "cinder-1f5965d9-c384-4e40-b885-1f1dd0b82591-delete_volume" released by "delete_volume" :: held 2.192s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:13 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-f46c0490-3758-4eb8-b701-2a6a9d4efc33 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Acquiring lock "cinder-3d3e403f-c47a-460c-85af-8fa09603b693-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:13 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-f46c0490-3758-4eb8-b701-2a6a9d4efc33 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "cinder-3d3e403f-c47a-460c-85af-8fa09603b693-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:13 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-f46c0490-3758-4eb8-b701-2a6a9d4efc33 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Acquiring lock "cinder-quobyte-3d3e403f-c47a-460c-85af-8fa09603b693" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:13 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-f46c0490-3758-4eb8-b701-2a6a9d4efc33 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "cinder-quobyte-3d3e403f-c47a-460c-85af-8fa09603b693" acquired by "delete_volume" :: waited 0.031s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:13 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[4497c04f-2494-4671-949b-37ed5683be83]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f46c0490-3758-4eb8-b701-2a6a9d4efc33 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3d3e403f-c47a-460c-85af-8fa09603b693 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:13 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3d3e403f-c47a-460c-85af-8fa09603b693 Nov 03 20:37:13 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:14 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f46c0490-3758-4eb8-b701-2a6a9d4efc33 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3d3e403f-c47a-460c-85af-8fa09603b693" returned: 0 in 0.875s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f46c0490-3758-4eb8-b701-2a6a9d4efc33 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3d3e403f-c47a-460c-85af-8fa09603b693 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:14 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3d3e403f-c47a-460c-85af-8fa09603b693 Nov 03 20:37:14 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:14 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f46c0490-3758-4eb8-b701-2a6a9d4efc33 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3d3e403f-c47a-460c-85af-8fa09603b693" returned: 0 in 0.629s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:15 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-f46c0490-3758-4eb8-b701-2a6a9d4efc33 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "cinder-quobyte-3d3e403f-c47a-460c-85af-8fa09603b693" released by "delete_volume" :: held 1.590s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:15 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-f46c0490-3758-4eb8-b701-2a6a9d4efc33 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Created reservations ['54b3bf10-b1c6-4c72-a9a4-13141f107806', '78750544-68c1-452d-830b-bc8b8bc6681e', 'abc63908-8e7a-4fca-984b-1441f5327ad0', '34febb53-a1b3-4295-8db3-4868e2cb2bae'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:37:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f46c0490-3758-4eb8-b701-2a6a9d4efc33 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f46c0490-3758-4eb8-b701-2a6a9d4efc33 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:15 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-f46c0490-3758-4eb8-b701-2a6a9d4efc33 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:37:15 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-f46c0490-3758-4eb8-b701-2a6a9d4efc33 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:37:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f46c0490-3758-4eb8-b701-2a6a9d4efc33 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f46c0490-3758-4eb8-b701-2a6a9d4efc33 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:15 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:37:15 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:15 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a3b38dd2-5655-491e-ac1f-435d8943292b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Acquiring lock "cinder-c2fc2d21-6841-4590-b16f-90d679a557af-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:15 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a3b38dd2-5655-491e-ac1f-435d8943292b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "cinder-c2fc2d21-6841-4590-b16f-90d679a557af-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:15 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f46c0490-3758-4eb8-b701-2a6a9d4efc33 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.558s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:15 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-f46c0490-3758-4eb8-b701-2a6a9d4efc33 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:37:15 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-f46c0490-3758-4eb8-b701-2a6a9d4efc33 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Deleted volume successfully. Nov 03 20:37:15 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a3b38dd2-5655-491e-ac1f-435d8943292b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Acquiring lock "cinder-quobyte-c2fc2d21-6841-4590-b16f-90d679a557af" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:15 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-f46c0490-3758-4eb8-b701-2a6a9d4efc33 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "cinder-3d3e403f-c47a-460c-85af-8fa09603b693-delete_volume" released by "delete_volume" :: held 2.647s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:15 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a3b38dd2-5655-491e-ac1f-435d8943292b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "cinder-quobyte-c2fc2d21-6841-4590-b16f-90d679a557af" acquired by "delete_volume" :: waited 0.040s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:15 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[993fd039-7d6f-4040-9ace-e4da546e1aa7]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a3b38dd2-5655-491e-ac1f-435d8943292b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-c2fc2d21-6841-4590-b16f-90d679a557af {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:16 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-73f75b04-9315-4221-aa9f-e328ef7e76fe" returned: 0 in 8.471s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:16 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] Image conversion details: src /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75, size 1024.00 MB, duration 8.47 sec, destination /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-73f75b04-9315-4221-aa9f-e328ef7e76fe {{(pid=87248) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:37:16 devstack cinder-volume[87248]: INFO cinder.image.image_utils [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] Converted 1024.00 MB image at 120.87 MB/s Nov 03 20:37:16 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-73f75b04-9315-4221-aa9f-e328ef7e76fe is being set with open permissions: ugo+rw Nov 03 20:37:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-73f75b04-9315-4221-aa9f-e328ef7e76fe {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:16 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-c2fc2d21-6841-4590-b16f-90d679a557af Nov 03 20:37:16 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:16 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-73f75b04-9315-4221-aa9f-e328ef7e76fe Nov 03 20:37:16 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:16 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-73f75b04-9315-4221-aa9f-e328ef7e76fe" returned: 0 in 0.256s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:16 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] Lock "cinder-quobyte-73f75b04-9315-4221-aa9f-e328ef7e76fe" released by "_copy_volume_from_snapshot" :: held 9.728s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:16 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a3b38dd2-5655-491e-ac1f-435d8943292b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-c2fc2d21-6841-4590-b16f-90d679a557af" returned: 0 in 0.433s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a3b38dd2-5655-491e-ac1f-435d8943292b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-c2fc2d21-6841-4590-b16f-90d679a557af {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:16 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] Lock "cinder-quobyte-1f0201b0-35cf-4912-ae84-d05c2fdf3b74-73f75b04-9315-4221-aa9f-e328ef7e76fe" released by "_create_volume_from_snapshot" :: held 9.825s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.867s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-46a492d3-711f-4a1e-b115-e8f291811468 tempest-ProjectMemberTests-196532882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.639s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:16 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-c2fc2d21-6841-4590-b16f-90d679a557af Nov 03 20:37:16 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:16 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-46a492d3-711f-4a1e-b115-e8f291811468 tempest-ProjectMemberTests-196532882 None] Creating offline snapshot 293b83da-3604-4abe-9447-71a31b1cbad2 of volume 8f03ea40-4178-4f93-9f12-f51153230b68 {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:37:16 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a0c4417-0d69-473b-bd43-fa58d65e7136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73f75b04-9315-4221-aa9f-e328ef7e76fe', 'volume_size': 1, 'snapshot_id': '1f0201b0-35cf-4912-ae84-d05c2fdf3b74'}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:16 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4d95de4-6606-4128-b172-59eadb3bb882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:16 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[487894fc-b987-4d6d-8c86-553f4ac3950a]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-46a492d3-711f-4a1e-b115-e8f291811468 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8f03ea40-4178-4f93-9f12-f51153230b68 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:16 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] Volume volume-73f75b04-9315-4221-aa9f-e328ef7e76fe (73f75b04-9315-4221-aa9f-e328ef7e76fe): created successfully Nov 03 20:37:16 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4d95de4-6606-4128-b172-59eadb3bb882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:16 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] Flow 'volume_create_manager' (56da3420-7323-4ef4-8644-2098d74de986) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:37:16 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-8817159a-6c84-467a-8742-9008cdf22b0e tempest-VolumeDependencyTests-1589553495 None] Created volume successfully. Nov 03 20:37:16 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8f03ea40-4178-4f93-9f12-f51153230b68 Nov 03 20:37:16 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:16 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a3b38dd2-5655-491e-ac1f-435d8943292b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-c2fc2d21-6841-4590-b16f-90d679a557af" returned: 0 in 0.352s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:16 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a3b38dd2-5655-491e-ac1f-435d8943292b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "cinder-quobyte-c2fc2d21-6841-4590-b16f-90d679a557af" released by "delete_volume" :: held 0.866s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:16 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-a3b38dd2-5655-491e-ac1f-435d8943292b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Created reservations ['a547563f-6e8f-4bfa-ad5a-df508a8d78f2', '7963ece1-75aa-4794-ab8f-51f1c9beca03', 'f5ae3ef2-ba77-4965-ac99-4e930938a90b', '7a252693-72ee-4d3b-9163-56175df9b7a8'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:37:16 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-5fcc7de4-2c3f-4ab8-98b9-01713845e058 tempest-VolumeDependencyTests-1589553495 None] Acquiring lock "cinder-1f0201b0-35cf-4912-ae84-d05c2fdf3b74-delete_snapshot" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:16 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-5fcc7de4-2c3f-4ab8-98b9-01713845e058 tempest-VolumeDependencyTests-1589553495 None] Lock "cinder-1f0201b0-35cf-4912-ae84-d05c2fdf3b74-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:16 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-5fcc7de4-2c3f-4ab8-98b9-01713845e058 tempest-VolumeDependencyTests-1589553495 None] Acquiring lock "cinder-quobyte-6dda7d68-4eb0-4065-b783-3394d41b8c75" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:16 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-5fcc7de4-2c3f-4ab8-98b9-01713845e058 tempest-VolumeDependencyTests-1589553495 None] Lock "cinder-quobyte-6dda7d68-4eb0-4065-b783-3394d41b8c75" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:16 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-5fcc7de4-2c3f-4ab8-98b9-01713845e058 tempest-VolumeDependencyTests-1589553495 None] Acquiring lock "cinder-quobyte-1f0201b0-35cf-4912-ae84-d05c2fdf3b74" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:16 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:16 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-5fcc7de4-2c3f-4ab8-98b9-01713845e058 tempest-VolumeDependencyTests-1589553495 None] Lock "cinder-quobyte-1f0201b0-35cf-4912-ae84-d05c2fdf3b74" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:16 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-5fcc7de4-2c3f-4ab8-98b9-01713845e058 tempest-VolumeDependencyTests-1589553495 None] Deleting offline snapshot 1f0201b0-35cf-4912-ae84-d05c2fdf3b74 of volume 6dda7d68-4eb0-4065-b783-3394d41b8c75 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:37:16 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-5fcc7de4-2c3f-4ab8-98b9-01713845e058 tempest-VolumeDependencyTests-1589553495 None] snapshot_file for this snap is: volume-6dda7d68-4eb0-4065-b783-3394d41b8c75.1f0201b0-35cf-4912-ae84-d05c2fdf3b74 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:37:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-46a492d3-711f-4a1e-b115-e8f291811468 tempest-ProjectMemberTests-196532882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8f03ea40-4178-4f93-9f12-f51153230b68" returned: 0 in 0.497s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-46a492d3-711f-4a1e-b115-e8f291811468 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8f03ea40-4178-4f93-9f12-f51153230b68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8f03ea40-4178-4f93-9f12-f51153230b68.293b83da-3604-4abe-9447-71a31b1cbad2 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:17 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b26421-f4bd-4bd8-83b2-3b842529f5bf]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5fcc7de4-2c3f-4ab8-98b9-01713845e058 tempest-VolumeDependencyTests-1589553495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75.1f0201b0-35cf-4912-ae84-d05c2fdf3b74 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:17 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8f03ea40-4178-4f93-9f12-f51153230b68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8f03ea40-4178-4f93-9f12-f51153230b68.293b83da-3604-4abe-9447-71a31b1cbad2 1G Nov 03 20:37:17 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a3b38dd2-5655-491e-ac1f-435d8943292b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a3b38dd2-5655-491e-ac1f-435d8943292b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:17 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a3b38dd2-5655-491e-ac1f-435d8943292b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:37:17 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a3b38dd2-5655-491e-ac1f-435d8943292b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:37:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a3b38dd2-5655-491e-ac1f-435d8943292b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a3b38dd2-5655-491e-ac1f-435d8943292b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:17 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:37:17 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:17 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c9434309-9e1a-4b4b-a687-e90025341fc2 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Acquiring lock "cinder-3d662cdf-1ce6-4990-ae39-ad8b2184e069-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:17 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c9434309-9e1a-4b4b-a687-e90025341fc2 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "cinder-3d662cdf-1ce6-4990-ae39-ad8b2184e069-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:17 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75.1f0201b0-35cf-4912-ae84-d05c2fdf3b74 Nov 03 20:37:17 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:17 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c9434309-9e1a-4b4b-a687-e90025341fc2 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Acquiring lock "cinder-quobyte-3d662cdf-1ce6-4990-ae39-ad8b2184e069" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:17 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c9434309-9e1a-4b4b-a687-e90025341fc2 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "cinder-quobyte-3d662cdf-1ce6-4990-ae39-ad8b2184e069" acquired by "delete_volume" :: waited 0.019s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:17 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[2170a0fd-fcc7-4d82-a171-f881743f2f3e]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c9434309-9e1a-4b4b-a687-e90025341fc2 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3d662cdf-1ce6-4990-ae39-ad8b2184e069 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:17 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3d662cdf-1ce6-4990-ae39-ad8b2184e069 Nov 03 20:37:17 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:17 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:17 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5fcc7de4-2c3f-4ab8-98b9-01713845e058 tempest-VolumeDependencyTests-1589553495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75.1f0201b0-35cf-4912-ae84-d05c2fdf3b74" returned: 0 in 0.508s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:17 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-5fcc7de4-2c3f-4ab8-98b9-01713845e058 tempest-VolumeDependencyTests-1589553495 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dda7d68-4eb0-4065-b783-3394d41b8c75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:37:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a3b38dd2-5655-491e-ac1f-435d8943292b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.486s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:17 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-a3b38dd2-5655-491e-ac1f-435d8943292b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:37:17 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-a3b38dd2-5655-491e-ac1f-435d8943292b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Deleted volume successfully. Nov 03 20:37:17 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77c670f-3731-4c95-a882-cf8c4bd7bec2]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5fcc7de4-2c3f-4ab8-98b9-01713845e058 tempest-VolumeDependencyTests-1589553495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:17 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-46a492d3-711f-4a1e-b115-e8f291811468 tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8f03ea40-4178-4f93-9f12-f51153230b68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8f03ea40-4178-4f93-9f12-f51153230b68.293b83da-3604-4abe-9447-71a31b1cbad2 1G" returned: 0 in 0.606s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-46a492d3-711f-4a1e-b115-e8f291811468 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f03ea40-4178-4f93-9f12-f51153230b68 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8f03ea40-4178-4f93-9f12-f51153230b68.293b83da-3604-4abe-9447-71a31b1cbad2 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:17 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a3b38dd2-5655-491e-ac1f-435d8943292b tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "cinder-c2fc2d21-6841-4590-b16f-90d679a557af-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:17 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f03ea40-4178-4f93-9f12-f51153230b68 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8f03ea40-4178-4f93-9f12-f51153230b68.293b83da-3604-4abe-9447-71a31b1cbad2 Nov 03 20:37:17 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:17 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75 Nov 03 20:37:17 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:17 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c9434309-9e1a-4b4b-a687-e90025341fc2 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3d662cdf-1ce6-4990-ae39-ad8b2184e069" returned: 0 in 0.509s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c9434309-9e1a-4b4b-a687-e90025341fc2 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3d662cdf-1ce6-4990-ae39-ad8b2184e069 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:17 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3d662cdf-1ce6-4990-ae39-ad8b2184e069 Nov 03 20:37:17 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:17 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-46a492d3-711f-4a1e-b115-e8f291811468 tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f03ea40-4178-4f93-9f12-f51153230b68 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8f03ea40-4178-4f93-9f12-f51153230b68.293b83da-3604-4abe-9447-71a31b1cbad2" returned: 0 in 0.337s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:17 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-46a492d3-711f-4a1e-b115-e8f291811468 tempest-ProjectMemberTests-196532882 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8f03ea40-4178-4f93-9f12-f51153230b68.293b83da-3604-4abe-9447-71a31b1cbad2 is being set with open permissions: ugo+rw Nov 03 20:37:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-46a492d3-711f-4a1e-b115-e8f291811468 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8f03ea40-4178-4f93-9f12-f51153230b68.293b83da-3604-4abe-9447-71a31b1cbad2 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:17 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8f03ea40-4178-4f93-9f12-f51153230b68.293b83da-3604-4abe-9447-71a31b1cbad2 Nov 03 20:37:17 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:18 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c9434309-9e1a-4b4b-a687-e90025341fc2 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-3d662cdf-1ce6-4990-ae39-ad8b2184e069" returned: 0 in 0.335s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:18 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c9434309-9e1a-4b4b-a687-e90025341fc2 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "cinder-quobyte-3d662cdf-1ce6-4990-ae39-ad8b2184e069" released by "delete_volume" :: held 0.925s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:18 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-c9434309-9e1a-4b4b-a687-e90025341fc2 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Created reservations ['b19dac1b-f386-44cf-955a-6df101d0a354', 'b864a671-f6ae-490d-9144-1506744f034e', 'bee2a6e8-e2d6-479e-94cd-7e0328f1db0c', '70a9b744-61f8-4990-ab36-3aa743c9d3ba'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:37:18 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:18 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-46a492d3-711f-4a1e-b115-e8f291811468 tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8f03ea40-4178-4f93-9f12-f51153230b68.293b83da-3604-4abe-9447-71a31b1cbad2" returned: 0 in 0.316s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5fcc7de4-2c3f-4ab8-98b9-01713845e058 tempest-VolumeDependencyTests-1589553495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75" returned: 0 in 0.689s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5fcc7de4-2c3f-4ab8-98b9-01713845e058 tempest-VolumeDependencyTests-1589553495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75.1f0201b0-35cf-4912-ae84-d05c2fdf3b74 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:18 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75.1f0201b0-35cf-4912-ae84-d05c2fdf3b74 Nov 03 20:37:18 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-46a492d3-711f-4a1e-b115-e8f291811468 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8f03ea40-4178-4f93-9f12-f51153230b68.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:18 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8f03ea40-4178-4f93-9f12-f51153230b68.info Nov 03 20:37:18 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c9434309-9e1a-4b4b-a687-e90025341fc2 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c9434309-9e1a-4b4b-a687-e90025341fc2 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:18 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c9434309-9e1a-4b4b-a687-e90025341fc2 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:37:18 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c9434309-9e1a-4b4b-a687-e90025341fc2 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:37:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c9434309-9e1a-4b4b-a687-e90025341fc2 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c9434309-9e1a-4b4b-a687-e90025341fc2 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:18 devstack sudo[106818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:37:18 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:18 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5fcc7de4-2c3f-4ab8-98b9-01713845e058 tempest-VolumeDependencyTests-1589553495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75.1f0201b0-35cf-4912-ae84-d05c2fdf3b74" returned: 0 in 0.400s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5fcc7de4-2c3f-4ab8-98b9-01713845e058 tempest-VolumeDependencyTests-1589553495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75.1f0201b0-35cf-4912-ae84-d05c2fdf3b74 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:18 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75.1f0201b0-35cf-4912-ae84-d05c2fdf3b74 Nov 03 20:37:18 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:18 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-46a492d3-711f-4a1e-b115-e8f291811468 tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8f03ea40-4178-4f93-9f12-f51153230b68.info" returned: 0 in 0.340s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:18 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-46a492d3-711f-4a1e-b115-e8f291811468 tempest-ProjectMemberTests-196532882 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8f03ea40-4178-4f93-9f12-f51153230b68.info is being set with open permissions: ugo+rw Nov 03 20:37:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-46a492d3-711f-4a1e-b115-e8f291811468 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8f03ea40-4178-4f93-9f12-f51153230b68.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:18 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8f03ea40-4178-4f93-9f12-f51153230b68.info Nov 03 20:37:18 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:18 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c9434309-9e1a-4b4b-a687-e90025341fc2 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.323s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:18 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-c9434309-9e1a-4b4b-a687-e90025341fc2 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:37:18 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-c9434309-9e1a-4b4b-a687-e90025341fc2 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Deleted volume successfully. Nov 03 20:37:18 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-c9434309-9e1a-4b4b-a687-e90025341fc2 tempest-CreateVolumesFromSourceVolumeTest-1557167563 None] Lock "cinder-3d662cdf-1ce6-4990-ae39-ad8b2184e069-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:18 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5fcc7de4-2c3f-4ab8-98b9-01713845e058 tempest-VolumeDependencyTests-1589553495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75.1f0201b0-35cf-4912-ae84-d05c2fdf3b74" returned: 0 in 0.345s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:19 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-46a492d3-711f-4a1e-b115-e8f291811468 tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8f03ea40-4178-4f93-9f12-f51153230b68.info" returned: 0 in 0.321s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-46a492d3-711f-4a1e-b115-e8f291811468 tempest-ProjectMemberTests-196532882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.629s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:19 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-5fcc7de4-2c3f-4ab8-98b9-01713845e058 tempest-VolumeDependencyTests-1589553495 None] Lock "cinder-quobyte-1f0201b0-35cf-4912-ae84-d05c2fdf3b74" released by "_delete_snapshot" :: held 2.112s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:19 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-5fcc7de4-2c3f-4ab8-98b9-01713845e058 tempest-VolumeDependencyTests-1589553495 None] Lock "cinder-quobyte-6dda7d68-4eb0-4065-b783-3394d41b8c75" released by "delete_snapshot" :: held 2.158s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:19 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-46a492d3-711f-4a1e-b115-e8f291811468 tempest-ProjectMemberTests-196532882 None] Create snapshot completed successfully Nov 03 20:37:19 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-252b5e53-7697-4481-9ad4-98b0bd7b5db6 tempest-ProjectReaderTests-433089253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:37:19 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-252b5e53-7697-4481-9ad4-98b0bd7b5db6 tempest-ProjectReaderTests-433089253 None] Flow 'volume_create_manager' (9f9b1998-e9e6-4ee6-8315-ca6a6b5b4534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:37:19 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-252b5e53-7697-4481-9ad4-98b0bd7b5db6 tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b8b5f6a-67fe-4454-9d58-138878f4586b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:19 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-252b5e53-7697-4481-9ad4-98b0bd7b5db6 tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b8b5f6a-67fe-4454-9d58-138878f4586b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-358394289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18caf7eb-1298-4b9b-9d69-a3dafe8aff1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c44365c19f64452a4ca43ddbc83b98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:37:19Z,use_quota=True,user_id='b4a43cba6ec642509e771e8a42d91883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:19 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-252b5e53-7697-4481-9ad4-98b0bd7b5db6 tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7080f481-8a80-41ea-9ec4-967060a0dd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:19 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-252b5e53-7697-4481-9ad4-98b0bd7b5db6 tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7080f481-8a80-41ea-9ec4-967060a0dd6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:19 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-252b5e53-7697-4481-9ad4-98b0bd7b5db6 tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b53847e9-3ccd-4666-ae81-c265d97c6c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:19 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-252b5e53-7697-4481-9ad4-98b0bd7b5db6 tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b53847e9-3ccd-4666-ae81-c265d97c6c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18caf7eb-1298-4b9b-9d69-a3dafe8aff1b', 'volume_name': 'volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:19 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-252b5e53-7697-4481-9ad4-98b0bd7b5db6 tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a5bbf05-1028-4eb0-935a-5ae3da1e8664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:19 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-252b5e53-7697-4481-9ad4-98b0bd7b5db6 tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a5bbf05-1028-4eb0-935a-5ae3da1e8664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:19 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-252b5e53-7697-4481-9ad4-98b0bd7b5db6 tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e04c343e-8111-4ac1-a1c2-206fd9b55c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:19 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-252b5e53-7697-4481-9ad4-98b0bd7b5db6 tempest-ProjectReaderTests-433089253 None] Volume 18caf7eb-1298-4b9b-9d69-a3dafe8aff1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b', 'volume_size': 1} Nov 03 20:37:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-252b5e53-7697-4481-9ad4-98b0bd7b5db6 tempest-ProjectReaderTests-433089253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-252b5e53-7697-4481-9ad4-98b0bd7b5db6 tempest-ProjectReaderTests-433089253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:19 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-252b5e53-7697-4481-9ad4-98b0bd7b5db6 tempest-ProjectReaderTests-433089253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-358394289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18caf7eb-1298-4b9b-9d69-a3dafe8aff1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c44365c19f64452a4ca43ddbc83b98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:37:19Z,use_quota=True,user_id='b4a43cba6ec642509e771e8a42d91883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:37:19 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-252b5e53-7697-4481-9ad4-98b0bd7b5db6 tempest-ProjectReaderTests-433089253 None] Creating volume 18caf7eb-1298-4b9b-9d69-a3dafe8aff1b {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:37:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-252b5e53-7697-4481-9ad4-98b0bd7b5db6 tempest-ProjectReaderTests-433089253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-252b5e53-7697-4481-9ad4-98b0bd7b5db6 tempest-ProjectReaderTests-433089253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:19 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-252b5e53-7697-4481-9ad4-98b0bd7b5db6 tempest-ProjectReaderTests-433089253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:37:19 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-252b5e53-7697-4481-9ad4-98b0bd7b5db6 tempest-ProjectReaderTests-433089253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:37:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-252b5e53-7697-4481-9ad4-98b0bd7b5db6 tempest-ProjectReaderTests-433089253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:19 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-252b5e53-7697-4481-9ad4-98b0bd7b5db6 tempest-ProjectReaderTests-433089253 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:37:19 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-252b5e53-7697-4481-9ad4-98b0bd7b5db6 tempest-ProjectReaderTests-433089253 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:37:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-252b5e53-7697-4481-9ad4-98b0bd7b5db6 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:19 devstack sudo[106832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b 1073741824 Nov 03 20:37:19 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:19 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-5fcc7de4-2c3f-4ab8-98b9-01713845e058 tempest-VolumeDependencyTests-1589553495 None] Created reservations ['8f4c956b-6943-4b88-abd5-c942e5794039', '3178cdfd-d412-4792-9328-1f14097e9bc7', '57b4c303-8547-4b33-a845-0a585d1bbe12', '38dc02f7-f931-4db9-9afe-60ab9708a72e'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:37:19 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-5fcc7de4-2c3f-4ab8-98b9-01713845e058 tempest-VolumeDependencyTests-1589553495 None] Delete snapshot completed successfully. Nov 03 20:37:19 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-5fcc7de4-2c3f-4ab8-98b9-01713845e058 tempest-VolumeDependencyTests-1589553495 None] Lock "cinder-1f0201b0-35cf-4912-ae84-d05c2fdf3b74-delete_snapshot" released by "delete_snapshot" :: held 2.422s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:19 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a2ec0189-4333-4eb8-8cf5-bf766e48fb0b tempest-ProjectMemberTests-196532882 None] Acquiring lock "cinder-293b83da-3604-4abe-9447-71a31b1cbad2-delete_snapshot" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:19 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a2ec0189-4333-4eb8-8cf5-bf766e48fb0b tempest-ProjectMemberTests-196532882 None] Lock "cinder-293b83da-3604-4abe-9447-71a31b1cbad2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:19 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a2ec0189-4333-4eb8-8cf5-bf766e48fb0b tempest-ProjectMemberTests-196532882 None] Acquiring lock "cinder-quobyte-8f03ea40-4178-4f93-9f12-f51153230b68" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:19 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a2ec0189-4333-4eb8-8cf5-bf766e48fb0b tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-8f03ea40-4178-4f93-9f12-f51153230b68" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:19 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a2ec0189-4333-4eb8-8cf5-bf766e48fb0b tempest-ProjectMemberTests-196532882 None] Acquiring lock "cinder-quobyte-293b83da-3604-4abe-9447-71a31b1cbad2" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:19 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a2ec0189-4333-4eb8-8cf5-bf766e48fb0b tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-293b83da-3604-4abe-9447-71a31b1cbad2" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:19 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-a2ec0189-4333-4eb8-8cf5-bf766e48fb0b tempest-ProjectMemberTests-196532882 None] Deleting offline snapshot 293b83da-3604-4abe-9447-71a31b1cbad2 of volume 8f03ea40-4178-4f93-9f12-f51153230b68 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:37:19 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-a2ec0189-4333-4eb8-8cf5-bf766e48fb0b tempest-ProjectMemberTests-196532882 None] snapshot_file for this snap is: volume-8f03ea40-4178-4f93-9f12-f51153230b68.293b83da-3604-4abe-9447-71a31b1cbad2 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:37:19 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02f0251-d250-4e29-a65f-58b8f5c3f5c3]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a2ec0189-4333-4eb8-8cf5-bf766e48fb0b tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8f03ea40-4178-4f93-9f12-f51153230b68.293b83da-3604-4abe-9447-71a31b1cbad2 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:19 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-252b5e53-7697-4481-9ad4-98b0bd7b5db6 tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b 1073741824" returned: 0 in 0.512s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-252b5e53-7697-4481-9ad4-98b0bd7b5db6 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:19 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b Nov 03 20:37:19 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:19 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8f03ea40-4178-4f93-9f12-f51153230b68.293b83da-3604-4abe-9447-71a31b1cbad2 Nov 03 20:37:19 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:20 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-252b5e53-7697-4481-9ad4-98b0bd7b5db6 tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b" returned: 0 in 0.270s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:20 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-252b5e53-7697-4481-9ad4-98b0bd7b5db6 tempest-ProjectReaderTests-433089253 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:37:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-252b5e53-7697-4481-9ad4-98b0bd7b5db6 tempest-ProjectReaderTests-433089253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-252b5e53-7697-4481-9ad4-98b0bd7b5db6 tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e04c343e-8111-4ac1-a1c2-206fd9b55c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-252b5e53-7697-4481-9ad4-98b0bd7b5db6 tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d01d859c-f369-42f1-947b-73cc4528b602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:20 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-252b5e53-7697-4481-9ad4-98b0bd7b5db6 tempest-ProjectReaderTests-433089253 None] Volume volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b (18caf7eb-1298-4b9b-9d69-a3dafe8aff1b): created successfully Nov 03 20:37:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-252b5e53-7697-4481-9ad4-98b0bd7b5db6 tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d01d859c-f369-42f1-947b-73cc4528b602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:20 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-252b5e53-7697-4481-9ad4-98b0bd7b5db6 tempest-ProjectReaderTests-433089253 None] Flow 'volume_create_manager' (9f9b1998-e9e6-4ee6-8315-ca6a6b5b4534) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:37:20 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-252b5e53-7697-4481-9ad4-98b0bd7b5db6 tempest-ProjectReaderTests-433089253 None] Created volume successfully. Nov 03 20:37:20 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:20 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-aeed6393-c13d-4d49-be92-cf08d6b84f39 tempest-VolumeDependencyTests-1589553495 None] Acquiring lock "cinder-6dda7d68-4eb0-4065-b783-3394d41b8c75-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a2ec0189-4333-4eb8-8cf5-bf766e48fb0b tempest-ProjectMemberTests-196532882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8f03ea40-4178-4f93-9f12-f51153230b68.293b83da-3604-4abe-9447-71a31b1cbad2" returned: 0 in 0.455s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:20 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-a2ec0189-4333-4eb8-8cf5-bf766e48fb0b tempest-ProjectMemberTests-196532882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f03ea40-4178-4f93-9f12-f51153230b68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:37:20 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-aeed6393-c13d-4d49-be92-cf08d6b84f39 tempest-VolumeDependencyTests-1589553495 None] Lock "cinder-6dda7d68-4eb0-4065-b783-3394d41b8c75-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:20 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[60336849-5006-4ebb-9c6f-c8eab1f7ed06]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a2ec0189-4333-4eb8-8cf5-bf766e48fb0b tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8f03ea40-4178-4f93-9f12-f51153230b68 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:20 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-aeed6393-c13d-4d49-be92-cf08d6b84f39 tempest-VolumeDependencyTests-1589553495 None] Acquiring lock "cinder-quobyte-6dda7d68-4eb0-4065-b783-3394d41b8c75" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:20 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-aeed6393-c13d-4d49-be92-cf08d6b84f39 tempest-VolumeDependencyTests-1589553495 None] Lock "cinder-quobyte-6dda7d68-4eb0-4065-b783-3394d41b8c75" acquired by "delete_volume" :: waited 0.027s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:20 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[63192e85-ad3a-48af-a6fd-70ab73706f08]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-aeed6393-c13d-4d49-be92-cf08d6b84f39 tempest-VolumeDependencyTests-1589553495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:20 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8f03ea40-4178-4f93-9f12-f51153230b68 Nov 03 20:37:20 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:20 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75 Nov 03 20:37:20 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:20 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a2ec0189-4333-4eb8-8cf5-bf766e48fb0b tempest-ProjectMemberTests-196532882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8f03ea40-4178-4f93-9f12-f51153230b68" returned: 0 in 0.397s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a2ec0189-4333-4eb8-8cf5-bf766e48fb0b tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8f03ea40-4178-4f93-9f12-f51153230b68.293b83da-3604-4abe-9447-71a31b1cbad2 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:20 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8f03ea40-4178-4f93-9f12-f51153230b68.293b83da-3604-4abe-9447-71a31b1cbad2 Nov 03 20:37:20 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:20 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-aeed6393-c13d-4d49-be92-cf08d6b84f39 tempest-VolumeDependencyTests-1589553495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75" returned: 0 in 0.417s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-aeed6393-c13d-4d49-be92-cf08d6b84f39 tempest-VolumeDependencyTests-1589553495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:20 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75 Nov 03 20:37:20 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:20 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a2ec0189-4333-4eb8-8cf5-bf766e48fb0b tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8f03ea40-4178-4f93-9f12-f51153230b68.293b83da-3604-4abe-9447-71a31b1cbad2" returned: 0 in 0.381s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a2ec0189-4333-4eb8-8cf5-bf766e48fb0b tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8f03ea40-4178-4f93-9f12-f51153230b68.293b83da-3604-4abe-9447-71a31b1cbad2 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:20 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8f03ea40-4178-4f93-9f12-f51153230b68.293b83da-3604-4abe-9447-71a31b1cbad2 Nov 03 20:37:20 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:21 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-aeed6393-c13d-4d49-be92-cf08d6b84f39 tempest-VolumeDependencyTests-1589553495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-6dda7d68-4eb0-4065-b783-3394d41b8c75" returned: 0 in 0.282s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:21 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-aeed6393-c13d-4d49-be92-cf08d6b84f39 tempest-VolumeDependencyTests-1589553495 None] Lock "cinder-quobyte-6dda7d68-4eb0-4065-b783-3394d41b8c75" released by "delete_volume" :: held 0.771s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:21 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-aeed6393-c13d-4d49-be92-cf08d6b84f39 tempest-VolumeDependencyTests-1589553495 None] Created reservations ['feaf29dd-ab41-4dd8-b923-f6b28357d1d1', 'f98fc338-12e9-4220-8484-fa66346adf74', '844a6f9c-6437-4117-b42f-0e377123936c', '0c72964e-1b05-4874-9503-bbcc12a35135'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:37:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-aeed6393-c13d-4d49-be92-cf08d6b84f39 tempest-VolumeDependencyTests-1589553495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-aeed6393-c13d-4d49-be92-cf08d6b84f39 tempest-VolumeDependencyTests-1589553495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-aeed6393-c13d-4d49-be92-cf08d6b84f39 tempest-VolumeDependencyTests-1589553495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:37:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-aeed6393-c13d-4d49-be92-cf08d6b84f39 tempest-VolumeDependencyTests-1589553495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:37:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-aeed6393-c13d-4d49-be92-cf08d6b84f39 tempest-VolumeDependencyTests-1589553495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-aeed6393-c13d-4d49-be92-cf08d6b84f39 tempest-VolumeDependencyTests-1589553495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:21 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:37:21 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:21 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a2ec0189-4333-4eb8-8cf5-bf766e48fb0b tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8f03ea40-4178-4f93-9f12-f51153230b68.293b83da-3604-4abe-9447-71a31b1cbad2" returned: 0 in 0.335s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:21 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a2ec0189-4333-4eb8-8cf5-bf766e48fb0b tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-293b83da-3604-4abe-9447-71a31b1cbad2" released by "_delete_snapshot" :: held 1.725s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:21 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a2ec0189-4333-4eb8-8cf5-bf766e48fb0b tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-8f03ea40-4178-4f93-9f12-f51153230b68" released by "delete_snapshot" :: held 1.753s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:21 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fad603b4-903c-4b0a-a253-651c0de0bc9f tempest-VolumeDependencyTests-1589553495 None] Acquiring lock "cinder-73f75b04-9315-4221-aa9f-e328ef7e76fe-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:21 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fad603b4-903c-4b0a-a253-651c0de0bc9f tempest-VolumeDependencyTests-1589553495 None] Lock "cinder-73f75b04-9315-4221-aa9f-e328ef7e76fe-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:21 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:21 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fad603b4-903c-4b0a-a253-651c0de0bc9f tempest-VolumeDependencyTests-1589553495 None] Acquiring lock "cinder-quobyte-73f75b04-9315-4221-aa9f-e328ef7e76fe" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-aeed6393-c13d-4d49-be92-cf08d6b84f39 tempest-VolumeDependencyTests-1589553495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.368s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:21 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-aeed6393-c13d-4d49-be92-cf08d6b84f39 tempest-VolumeDependencyTests-1589553495 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:37:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-29d92789-1376-4b87-9c38-fc04b34c501e tempest-ProjectReaderTests-433089253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-29d92789-1376-4b87-9c38-fc04b34c501e tempest-ProjectReaderTests-433089253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:21 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fad603b4-903c-4b0a-a253-651c0de0bc9f tempest-VolumeDependencyTests-1589553495 None] Lock "cinder-quobyte-73f75b04-9315-4221-aa9f-e328ef7e76fe" acquired by "delete_volume" :: waited 0.034s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:21 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-aeed6393-c13d-4d49-be92-cf08d6b84f39 tempest-VolumeDependencyTests-1589553495 None] Deleted volume successfully. Nov 03 20:37:21 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ece90e6-684d-4052-b079-6249e3017ac1]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fad603b4-903c-4b0a-a253-651c0de0bc9f tempest-VolumeDependencyTests-1589553495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-73f75b04-9315-4221-aa9f-e328ef7e76fe {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-29d92789-1376-4b87-9c38-fc04b34c501e tempest-ProjectReaderTests-433089253 None] Creating offline snapshot 6434c8cc-2ebd-4654-8e42-706195d9b741 of volume 18caf7eb-1298-4b9b-9d69-a3dafe8aff1b {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:37:21 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-a2ec0189-4333-4eb8-8cf5-bf766e48fb0b tempest-ProjectMemberTests-196532882 None] Created reservations ['640603a0-a3fa-4946-b138-c255e5914685', 'c4b47f78-29ff-4cf5-96b1-eee38408c801', '4ece4a54-963f-4ae4-a727-82189efdff2d', '2288b919-cdc0-42b2-b2af-0b891541f5c6'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:37:21 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-aeed6393-c13d-4d49-be92-cf08d6b84f39 tempest-VolumeDependencyTests-1589553495 None] Lock "cinder-6dda7d68-4eb0-4065-b783-3394d41b8c75-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:21 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c4eed1-8f08-43f6-9d2b-baf4e764871c]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-29d92789-1376-4b87-9c38-fc04b34c501e tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:21 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-73f75b04-9315-4221-aa9f-e328ef7e76fe Nov 03 20:37:21 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:21 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b Nov 03 20:37:21 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:21 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-a2ec0189-4333-4eb8-8cf5-bf766e48fb0b tempest-ProjectMemberTests-196532882 None] Delete snapshot completed successfully. Nov 03 20:37:21 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a2ec0189-4333-4eb8-8cf5-bf766e48fb0b tempest-ProjectMemberTests-196532882 None] Lock "cinder-293b83da-3604-4abe-9447-71a31b1cbad2-delete_snapshot" released by "delete_snapshot" :: held 2.256s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:22 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fad603b4-903c-4b0a-a253-651c0de0bc9f tempest-VolumeDependencyTests-1589553495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-73f75b04-9315-4221-aa9f-e328ef7e76fe" returned: 0 in 0.456s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fad603b4-903c-4b0a-a253-651c0de0bc9f tempest-VolumeDependencyTests-1589553495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-73f75b04-9315-4221-aa9f-e328ef7e76fe {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:22 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-73f75b04-9315-4221-aa9f-e328ef7e76fe Nov 03 20:37:22 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:22 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-29d92789-1376-4b87-9c38-fc04b34c501e tempest-ProjectReaderTests-433089253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b" returned: 0 in 0.456s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-29d92789-1376-4b87-9c38-fc04b34c501e tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b.6434c8cc-2ebd-4654-8e42-706195d9b741 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:22 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b.6434c8cc-2ebd-4654-8e42-706195d9b741 1G Nov 03 20:37:22 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:22 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fad603b4-903c-4b0a-a253-651c0de0bc9f tempest-VolumeDependencyTests-1589553495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-73f75b04-9315-4221-aa9f-e328ef7e76fe" returned: 0 in 0.267s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:22 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fad603b4-903c-4b0a-a253-651c0de0bc9f tempest-VolumeDependencyTests-1589553495 None] Lock "cinder-quobyte-73f75b04-9315-4221-aa9f-e328ef7e76fe" released by "delete_volume" :: held 0.779s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:22 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-fad603b4-903c-4b0a-a253-651c0de0bc9f tempest-VolumeDependencyTests-1589553495 None] Created reservations ['83af8d22-8da8-4670-8224-52d19783fa04', 'a491ed10-2a9d-44da-ac7d-cc0708661065', 'd37c461a-2d8a-49be-971b-fe7e9638baa2', '779003ac-23b5-4791-9874-26044094d0f5'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:37:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-fad603b4-903c-4b0a-a253-651c0de0bc9f tempest-VolumeDependencyTests-1589553495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-fad603b4-903c-4b0a-a253-651c0de0bc9f tempest-VolumeDependencyTests-1589553495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:22 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-fad603b4-903c-4b0a-a253-651c0de0bc9f tempest-VolumeDependencyTests-1589553495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:37:22 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-fad603b4-903c-4b0a-a253-651c0de0bc9f tempest-VolumeDependencyTests-1589553495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:37:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-fad603b4-903c-4b0a-a253-651c0de0bc9f tempest-VolumeDependencyTests-1589553495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fad603b4-903c-4b0a-a253-651c0de0bc9f tempest-VolumeDependencyTests-1589553495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:22 devstack sudo[106890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:37:22 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:22 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-29d92789-1376-4b87-9c38-fc04b34c501e tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b.6434c8cc-2ebd-4654-8e42-706195d9b741 1G" returned: 0 in 0.556s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-29d92789-1376-4b87-9c38-fc04b34c501e tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b.6434c8cc-2ebd-4654-8e42-706195d9b741 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:22 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b.6434c8cc-2ebd-4654-8e42-706195d9b741 Nov 03 20:37:22 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:22 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fad603b4-903c-4b0a-a253-651c0de0bc9f tempest-VolumeDependencyTests-1589553495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.384s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:22 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-fad603b4-903c-4b0a-a253-651c0de0bc9f tempest-VolumeDependencyTests-1589553495 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:37:22 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b1e3ea5b-09ad-4acd-9d6d-be06d3cdf6bc tempest-ProjectMemberTests-196532882 None] Acquiring lock "cinder-8f03ea40-4178-4f93-9f12-f51153230b68-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:22 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-fad603b4-903c-4b0a-a253-651c0de0bc9f tempest-VolumeDependencyTests-1589553495 None] Deleted volume successfully. Nov 03 20:37:22 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b1e3ea5b-09ad-4acd-9d6d-be06d3cdf6bc tempest-ProjectMemberTests-196532882 None] Lock "cinder-8f03ea40-4178-4f93-9f12-f51153230b68-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:22 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fad603b4-903c-4b0a-a253-651c0de0bc9f tempest-VolumeDependencyTests-1589553495 None] Lock "cinder-73f75b04-9315-4221-aa9f-e328ef7e76fe-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:22 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b1e3ea5b-09ad-4acd-9d6d-be06d3cdf6bc tempest-ProjectMemberTests-196532882 None] Acquiring lock "cinder-quobyte-8f03ea40-4178-4f93-9f12-f51153230b68" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:22 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b1e3ea5b-09ad-4acd-9d6d-be06d3cdf6bc tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-8f03ea40-4178-4f93-9f12-f51153230b68" acquired by "delete_volume" :: waited 0.025s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:23 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1aaa588-ab7f-41d1-bafe-28886865a03b]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b1e3ea5b-09ad-4acd-9d6d-be06d3cdf6bc tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8f03ea40-4178-4f93-9f12-f51153230b68 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:23 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-29d92789-1376-4b87-9c38-fc04b34c501e tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b.6434c8cc-2ebd-4654-8e42-706195d9b741" returned: 0 in 0.497s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:23 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-29d92789-1376-4b87-9c38-fc04b34c501e tempest-ProjectReaderTests-433089253 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b.6434c8cc-2ebd-4654-8e42-706195d9b741 is being set with open permissions: ugo+rw Nov 03 20:37:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-29d92789-1376-4b87-9c38-fc04b34c501e tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b.6434c8cc-2ebd-4654-8e42-706195d9b741 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:23 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8f03ea40-4178-4f93-9f12-f51153230b68 Nov 03 20:37:23 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:23 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b.6434c8cc-2ebd-4654-8e42-706195d9b741 Nov 03 20:37:23 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:23 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-29d92789-1376-4b87-9c38-fc04b34c501e tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b.6434c8cc-2ebd-4654-8e42-706195d9b741" returned: 0 in 0.276s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-29d92789-1376-4b87-9c38-fc04b34c501e tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:23 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b1e3ea5b-09ad-4acd-9d6d-be06d3cdf6bc tempest-ProjectMemberTests-196532882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8f03ea40-4178-4f93-9f12-f51153230b68" returned: 0 in 0.464s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b1e3ea5b-09ad-4acd-9d6d-be06d3cdf6bc tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8f03ea40-4178-4f93-9f12-f51153230b68 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:23 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b.info Nov 03 20:37:23 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:23 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8f03ea40-4178-4f93-9f12-f51153230b68 Nov 03 20:37:23 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:23 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:23 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-29d92789-1376-4b87-9c38-fc04b34c501e tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b.info" returned: 0 in 0.346s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:23 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-29d92789-1376-4b87-9c38-fc04b34c501e tempest-ProjectReaderTests-433089253 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b.info is being set with open permissions: ugo+rw Nov 03 20:37:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-29d92789-1376-4b87-9c38-fc04b34c501e tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b1e3ea5b-09ad-4acd-9d6d-be06d3cdf6bc tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8f03ea40-4178-4f93-9f12-f51153230b68" returned: 0 in 0.331s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:23 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b.info Nov 03 20:37:23 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:23 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b1e3ea5b-09ad-4acd-9d6d-be06d3cdf6bc tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-8f03ea40-4178-4f93-9f12-f51153230b68" released by "delete_volume" :: held 0.884s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:23 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-b1e3ea5b-09ad-4acd-9d6d-be06d3cdf6bc tempest-ProjectMemberTests-196532882 None] Created reservations ['31be90ca-5235-47f0-a59e-ecf4b8b4a926', '1cd43d0f-17bf-4a2a-b43c-e95bd3f3b370', 'ca54e669-4dbe-4193-92f2-a0b41aa547be', '60da688d-76c9-498d-8bd3-2adb8576ff1e'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:37:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b1e3ea5b-09ad-4acd-9d6d-be06d3cdf6bc tempest-ProjectMemberTests-196532882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b1e3ea5b-09ad-4acd-9d6d-be06d3cdf6bc tempest-ProjectMemberTests-196532882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:24 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-b1e3ea5b-09ad-4acd-9d6d-be06d3cdf6bc tempest-ProjectMemberTests-196532882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:37:24 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-b1e3ea5b-09ad-4acd-9d6d-be06d3cdf6bc tempest-ProjectMemberTests-196532882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:37:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b1e3ea5b-09ad-4acd-9d6d-be06d3cdf6bc tempest-ProjectMemberTests-196532882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b1e3ea5b-09ad-4acd-9d6d-be06d3cdf6bc tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:24 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:37:24 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:24 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-29d92789-1376-4b87-9c38-fc04b34c501e tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b.info" returned: 0 in 0.337s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-29d92789-1376-4b87-9c38-fc04b34c501e tempest-ProjectReaderTests-433089253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.644s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:24 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-29d92789-1376-4b87-9c38-fc04b34c501e tempest-ProjectReaderTests-433089253 None] Create snapshot completed successfully Nov 03 20:37:24 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b1e3ea5b-09ad-4acd-9d6d-be06d3cdf6bc tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.399s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:24 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-b1e3ea5b-09ad-4acd-9d6d-be06d3cdf6bc tempest-ProjectMemberTests-196532882 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:37:24 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-b1e3ea5b-09ad-4acd-9d6d-be06d3cdf6bc tempest-ProjectMemberTests-196532882 None] Deleted volume successfully. Nov 03 20:37:24 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-b1e3ea5b-09ad-4acd-9d6d-be06d3cdf6bc tempest-ProjectMemberTests-196532882 None] Lock "cinder-8f03ea40-4178-4f93-9f12-f51153230b68-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:24 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-43628149-497d-4d97-baf3-b6d965b2fc98 tempest-ProjectMemberTests-196532882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:37:24 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-43628149-497d-4d97-baf3-b6d965b2fc98 tempest-ProjectMemberTests-196532882 None] Flow 'volume_create_manager' (e03244d6-012e-4596-8deb-d6e3da8bd470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:37:24 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-43628149-497d-4d97-baf3-b6d965b2fc98 tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40256d4c-6b7f-4438-8aa3-f32d4ae9170a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:24 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-43628149-497d-4d97-baf3-b6d965b2fc98 tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40256d4c-6b7f-4438-8aa3-f32d4ae9170a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-412562922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40330863-70f7-4023-8e63-3fb0808f5467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd20413f6d5649da828c1f0bf51455d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:37:25Z,use_quota=True,user_id='595eaffd7e764ae6b07e6aba8405d447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:24 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-43628149-497d-4d97-baf3-b6d965b2fc98 tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1989990-e420-4a73-955d-1302d421cb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:24 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-43628149-497d-4d97-baf3-b6d965b2fc98 tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1989990-e420-4a73-955d-1302d421cb20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:24 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-43628149-497d-4d97-baf3-b6d965b2fc98 tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22632767-baf1-40c2-ab1f-a23aac8fd267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:24 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-43628149-497d-4d97-baf3-b6d965b2fc98 tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22632767-baf1-40c2-ab1f-a23aac8fd267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40330863-70f7-4023-8e63-3fb0808f5467', 'volume_name': 'volume-40330863-70f7-4023-8e63-3fb0808f5467', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:24 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-43628149-497d-4d97-baf3-b6d965b2fc98 tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b973ff5-bab9-48ed-b58c-50fbfd109ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:24 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-43628149-497d-4d97-baf3-b6d965b2fc98 tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b973ff5-bab9-48ed-b58c-50fbfd109ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:24 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-43628149-497d-4d97-baf3-b6d965b2fc98 tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fc14414-8186-444c-af40-8bb5ab5c25ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:24 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-43628149-497d-4d97-baf3-b6d965b2fc98 tempest-ProjectMemberTests-196532882 None] Volume 40330863-70f7-4023-8e63-3fb0808f5467: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40330863-70f7-4023-8e63-3fb0808f5467', 'volume_size': 1} Nov 03 20:37:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-43628149-497d-4d97-baf3-b6d965b2fc98 tempest-ProjectMemberTests-196532882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-43628149-497d-4d97-baf3-b6d965b2fc98 tempest-ProjectMemberTests-196532882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:24 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-43628149-497d-4d97-baf3-b6d965b2fc98 tempest-ProjectMemberTests-196532882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-412562922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40330863-70f7-4023-8e63-3fb0808f5467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd20413f6d5649da828c1f0bf51455d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:37:25Z,use_quota=True,user_id='595eaffd7e764ae6b07e6aba8405d447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:37:24 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-43628149-497d-4d97-baf3-b6d965b2fc98 tempest-ProjectMemberTests-196532882 None] Creating volume 40330863-70f7-4023-8e63-3fb0808f5467 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:37:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-43628149-497d-4d97-baf3-b6d965b2fc98 tempest-ProjectMemberTests-196532882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-43628149-497d-4d97-baf3-b6d965b2fc98 tempest-ProjectMemberTests-196532882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:24 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-43628149-497d-4d97-baf3-b6d965b2fc98 tempest-ProjectMemberTests-196532882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:37:24 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-43628149-497d-4d97-baf3-b6d965b2fc98 tempest-ProjectMemberTests-196532882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:37:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-43628149-497d-4d97-baf3-b6d965b2fc98 tempest-ProjectMemberTests-196532882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:24 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-43628149-497d-4d97-baf3-b6d965b2fc98 tempest-ProjectMemberTests-196532882 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:37:24 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-43628149-497d-4d97-baf3-b6d965b2fc98 tempest-ProjectMemberTests-196532882 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:37:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-43628149-497d-4d97-baf3-b6d965b2fc98 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-40330863-70f7-4023-8e63-3fb0808f5467 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:24 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-40330863-70f7-4023-8e63-3fb0808f5467 1073741824 Nov 03 20:37:24 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:25 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8cf39787-d501-42cc-82bd-79a36e6ca2e3 tempest-ProjectReaderTests-433089253 None] Acquiring lock "cinder-6434c8cc-2ebd-4654-8e42-706195d9b741-delete_snapshot" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:25 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8cf39787-d501-42cc-82bd-79a36e6ca2e3 tempest-ProjectReaderTests-433089253 None] Lock "cinder-6434c8cc-2ebd-4654-8e42-706195d9b741-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:25 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8cf39787-d501-42cc-82bd-79a36e6ca2e3 tempest-ProjectReaderTests-433089253 None] Acquiring lock "cinder-quobyte-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:25 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8cf39787-d501-42cc-82bd-79a36e6ca2e3 tempest-ProjectReaderTests-433089253 None] Lock "cinder-quobyte-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:25 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8cf39787-d501-42cc-82bd-79a36e6ca2e3 tempest-ProjectReaderTests-433089253 None] Acquiring lock "cinder-quobyte-6434c8cc-2ebd-4654-8e42-706195d9b741" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:25 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8cf39787-d501-42cc-82bd-79a36e6ca2e3 tempest-ProjectReaderTests-433089253 None] Lock "cinder-quobyte-6434c8cc-2ebd-4654-8e42-706195d9b741" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:25 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-8cf39787-d501-42cc-82bd-79a36e6ca2e3 tempest-ProjectReaderTests-433089253 None] Deleting offline snapshot 6434c8cc-2ebd-4654-8e42-706195d9b741 of volume 18caf7eb-1298-4b9b-9d69-a3dafe8aff1b {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:37:25 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-8cf39787-d501-42cc-82bd-79a36e6ca2e3 tempest-ProjectReaderTests-433089253 None] snapshot_file for this snap is: volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b.6434c8cc-2ebd-4654-8e42-706195d9b741 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:37:25 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce243d3a-c14c-486c-be41-4d87e890255c]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8cf39787-d501-42cc-82bd-79a36e6ca2e3 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b.6434c8cc-2ebd-4654-8e42-706195d9b741 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:25 devstack sudo[106928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b.6434c8cc-2ebd-4654-8e42-706195d9b741 Nov 03 20:37:25 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:25 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-43628149-497d-4d97-baf3-b6d965b2fc98 tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-40330863-70f7-4023-8e63-3fb0808f5467 1073741824" returned: 0 in 0.552s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-43628149-497d-4d97-baf3-b6d965b2fc98 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-40330863-70f7-4023-8e63-3fb0808f5467 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:25 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-40330863-70f7-4023-8e63-3fb0808f5467 Nov 03 20:37:25 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:25 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8cf39787-d501-42cc-82bd-79a36e6ca2e3 tempest-ProjectReaderTests-433089253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b.6434c8cc-2ebd-4654-8e42-706195d9b741" returned: 0 in 0.517s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:25 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-8cf39787-d501-42cc-82bd-79a36e6ca2e3 tempest-ProjectReaderTests-433089253 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:37:25 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ffa16b-6615-433c-b1e1-5c2f8782ef34]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8cf39787-d501-42cc-82bd-79a36e6ca2e3 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:25 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-43628149-497d-4d97-baf3-b6d965b2fc98 tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-40330863-70f7-4023-8e63-3fb0808f5467" returned: 0 in 0.408s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:25 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-43628149-497d-4d97-baf3-b6d965b2fc98 tempest-ProjectMemberTests-196532882 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:37:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-43628149-497d-4d97-baf3-b6d965b2fc98 tempest-ProjectMemberTests-196532882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-43628149-497d-4d97-baf3-b6d965b2fc98 tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fc14414-8186-444c-af40-8bb5ab5c25ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40330863-70f7-4023-8e63-3fb0808f5467', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-43628149-497d-4d97-baf3-b6d965b2fc98 tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ac3c3bf-57a5-48d4-bd77-713f78f2e14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:25 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b Nov 03 20:37:25 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:25 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:37:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Flow 'volume_create_manager' (e83e73d7-5802-41b3-9e9f-ebc85a62645c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:37:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eac5b653-4c05-4500-848d-0c86790cad57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:25 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-43628149-497d-4d97-baf3-b6d965b2fc98 tempest-ProjectMemberTests-196532882 None] Volume volume-40330863-70f7-4023-8e63-3fb0808f5467 (40330863-70f7-4023-8e63-3fb0808f5467): created successfully Nov 03 20:37:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-43628149-497d-4d97-baf3-b6d965b2fc98 tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ac3c3bf-57a5-48d4-bd77-713f78f2e14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-43628149-497d-4d97-baf3-b6d965b2fc98 tempest-ProjectMemberTests-196532882 None] Flow 'volume_create_manager' (e03244d6-012e-4596-8deb-d6e3da8bd470) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:37:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eac5b653-4c05-4500-848d-0c86790cad57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10e3de3b-5dbc-48ff-8685-244727465b0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a5eda781fb043d0b402e2e533fc7fc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:37:26Z,use_quota=True,user_id='0a627e9219334675886cbf2d69f3c220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (115cf50e-56ae-4568-ad58-8ca06ab05f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (115cf50e-56ae-4568-ad58-8ca06ab05f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (343b74b6-e1c5-4d28-af01-d2feb6c85d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:26 devstack cinder-volume[87248]: DEBUG cinder.image.glance [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Creating Keystone auth plugin from conf {{(pid=87248) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 20:37:26 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-43628149-497d-4d97-baf3-b6d965b2fc98 tempest-ProjectMemberTests-196532882 None] Created volume successfully. Nov 03 20:37:26 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8cf39787-d501-42cc-82bd-79a36e6ca2e3 tempest-ProjectReaderTests-433089253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b" returned: 0 in 0.438s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8cf39787-d501-42cc-82bd-79a36e6ca2e3 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b.6434c8cc-2ebd-4654-8e42-706195d9b741 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:26 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b.6434c8cc-2ebd-4654-8e42-706195d9b741 Nov 03 20:37:26 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (343b74b6-e1c5-4d28-af01-d2feb6c85d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '10e3de3b-5dbc-48ff-8685-244727465b0e', 'volume_name': 'volume-10e3de3b-5dbc-48ff-8685-244727465b0e', 'volume_size': 1, 'image_id': 'dab5c70b-bdd0-4988-98b9-4b60a944614c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dab5c70b-bdd0-4988-98b9-4b60a944614c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '60c01d258c0917d34ecd6ad1ebecd06d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7a5eda781fb043d0b402e2e533fc7fc7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1b291eba01710ef329b699dddc4749046dcd6f3bd25caa089b99c966a05712314036ca07a01e86854399780e0adb9b076b8f7d417244df35806c63562fb88cfd', 'id': 'dab5c70b-bdd0-4988-98b9-4b60a944614c', 'created_at': datetime.datetime(2026, 11, 3, 19, 37, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 37, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dab5c70b-bdd0-4988-98b9-4b60a944614c/file', 'properties': {}}, 'image_service': }' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48064504-a560-410b-9432-b6ea76f3d541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48064504-a560-410b-9432-b6ea76f3d541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88f901ad-3e1b-404c-bf5f-ed5faf86b9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:26 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Volume 10e3de3b-5dbc-48ff-8685-244727465b0e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-10e3de3b-5dbc-48ff-8685-244727465b0e', 'volume_size': 1, 'image_id': 'dab5c70b-bdd0-4988-98b9-4b60a944614c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dab5c70b-bdd0-4988-98b9-4b60a944614c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '60c01d258c0917d34ecd6ad1ebecd06d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7a5eda781fb043d0b402e2e533fc7fc7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1b291eba01710ef329b699dddc4749046dcd6f3bd25caa089b99c966a05712314036ca07a01e86854399780e0adb9b076b8f7d417244df35806c63562fb88cfd', 'id': 'dab5c70b-bdd0-4988-98b9-4b60a944614c', 'created_at': datetime.datetime(2026, 11, 3, 19, 37, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 37, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dab5c70b-bdd0-4988-98b9-4b60a944614c/file', 'properties': {}}, 'image_service': } Nov 03 20:37:26 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Trying to clone 10e3de3b-5dbc-48ff-8685-244727465b0e from image dab5c70b-bdd0-4988-98b9-4b60a944614c at location (None, [{'url': 'file:///opt/stack/data/glance/images/dab5c70b-bdd0-4988-98b9-4b60a944614c', 'metadata': {}}]). {{(pid=87248) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 20:37:26 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dab5c70b-bdd0-4988-98b9-4b60a944614c_0xwv4_cadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87248) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 20:37:26 devstack cinder-volume[87248]: INFO cinder.image.image_utils [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Image download 0.00 MB at 0.00 MB/s Nov 03 20:37:26 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[0761df9a-6620-4c19-9f65-6ef873790b1f]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dab5c70b-bdd0-4988-98b9-4b60a944614c_0xwv4_cadevstack@QuobyteHD {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:26 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8cf39787-d501-42cc-82bd-79a36e6ca2e3 tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b.6434c8cc-2ebd-4654-8e42-706195d9b741" returned: 0 in 0.420s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8cf39787-d501-42cc-82bd-79a36e6ca2e3 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b.6434c8cc-2ebd-4654-8e42-706195d9b741 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:26 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8763ae9-8c91-4f12-a5d6-3c5761e0a921 tempest-CinderUnicodeTest-2050519788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:37:26 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b.6434c8cc-2ebd-4654-8e42-706195d9b741 Nov 03 20:37:26 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f8763ae9-8c91-4f12-a5d6-3c5761e0a921 tempest-CinderUnicodeTest-2050519788 None] Flow 'volume_create_manager' (7bc6f22d-91ad-4a0e-8357-f2f87b3be458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:37:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f8763ae9-8c91-4f12-a5d6-3c5761e0a921 tempest-CinderUnicodeTest-2050519788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa123a71-dc35-417a-ab7a-194b8b368299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:26 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dab5c70b-bdd0-4988-98b9-4b60a944614c_0xwv4_cadevstack@QuobyteHD Nov 03 20:37:26 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f8763ae9-8c91-4f12-a5d6-3c5761e0a921 tempest-CinderUnicodeTest-2050519788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa123a71-dc35-417a-ab7a-194b8b368299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2252b121-dce5-49bf-beca-4a60be3e7340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6700f71251074c67b31f1812d2a253d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:37:27Z,use_quota=True,user_id='fa398cab549c455686350ea0af161bcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f8763ae9-8c91-4f12-a5d6-3c5761e0a921 tempest-CinderUnicodeTest-2050519788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (186b44cb-c6a4-4b93-9580-42acd81e66a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f8763ae9-8c91-4f12-a5d6-3c5761e0a921 tempest-CinderUnicodeTest-2050519788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (186b44cb-c6a4-4b93-9580-42acd81e66a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f8763ae9-8c91-4f12-a5d6-3c5761e0a921 tempest-CinderUnicodeTest-2050519788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9bd5e0c-03b8-4fe5-b531-172b7c7cf4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f8763ae9-8c91-4f12-a5d6-3c5761e0a921 tempest-CinderUnicodeTest-2050519788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9bd5e0c-03b8-4fe5-b531-172b7c7cf4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2252b121-dce5-49bf-beca-4a60be3e7340', 'volume_name': 'volume-2252b121-dce5-49bf-beca-4a60be3e7340', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f8763ae9-8c91-4f12-a5d6-3c5761e0a921 tempest-CinderUnicodeTest-2050519788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aac2a8a-dade-4d48-adce-cd97855c6f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f8763ae9-8c91-4f12-a5d6-3c5761e0a921 tempest-CinderUnicodeTest-2050519788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aac2a8a-dade-4d48-adce-cd97855c6f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f8763ae9-8c91-4f12-a5d6-3c5761e0a921 tempest-CinderUnicodeTest-2050519788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41c8e2de-a3f8-4582-8449-00056f60fcc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:26 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-f8763ae9-8c91-4f12-a5d6-3c5761e0a921 tempest-CinderUnicodeTest-2050519788 None] Volume 2252b121-dce5-49bf-beca-4a60be3e7340: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2252b121-dce5-49bf-beca-4a60be3e7340', 'volume_size': 1} Nov 03 20:37:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f8763ae9-8c91-4f12-a5d6-3c5761e0a921 tempest-CinderUnicodeTest-2050519788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f8763ae9-8c91-4f12-a5d6-3c5761e0a921 tempest-CinderUnicodeTest-2050519788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:26 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-f8763ae9-8c91-4f12-a5d6-3c5761e0a921 tempest-CinderUnicodeTest-2050519788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2252b121-dce5-49bf-beca-4a60be3e7340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6700f71251074c67b31f1812d2a253d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:37:27Z,use_quota=True,user_id='fa398cab549c455686350ea0af161bcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:37:26 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-f8763ae9-8c91-4f12-a5d6-3c5761e0a921 tempest-CinderUnicodeTest-2050519788 None] Creating volume 2252b121-dce5-49bf-beca-4a60be3e7340 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:37:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f8763ae9-8c91-4f12-a5d6-3c5761e0a921 tempest-CinderUnicodeTest-2050519788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f8763ae9-8c91-4f12-a5d6-3c5761e0a921 tempest-CinderUnicodeTest-2050519788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:26 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-f8763ae9-8c91-4f12-a5d6-3c5761e0a921 tempest-CinderUnicodeTest-2050519788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:37:26 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-f8763ae9-8c91-4f12-a5d6-3c5761e0a921 tempest-CinderUnicodeTest-2050519788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:37:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f8763ae9-8c91-4f12-a5d6-3c5761e0a921 tempest-CinderUnicodeTest-2050519788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:26 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-f8763ae9-8c91-4f12-a5d6-3c5761e0a921 tempest-CinderUnicodeTest-2050519788 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:37:26 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-f8763ae9-8c91-4f12-a5d6-3c5761e0a921 tempest-CinderUnicodeTest-2050519788 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:37:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f8763ae9-8c91-4f12-a5d6-3c5761e0a921 tempest-CinderUnicodeTest-2050519788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2252b121-dce5-49bf-beca-4a60be3e7340 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:26 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2252b121-dce5-49bf-beca-4a60be3e7340 1073741824 Nov 03 20:37:26 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:26 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8cf39787-d501-42cc-82bd-79a36e6ca2e3 tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b.6434c8cc-2ebd-4654-8e42-706195d9b741" returned: 0 in 0.283s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:26 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8cf39787-d501-42cc-82bd-79a36e6ca2e3 tempest-ProjectReaderTests-433089253 None] Lock "cinder-quobyte-6434c8cc-2ebd-4654-8e42-706195d9b741" released by "_delete_snapshot" :: held 1.800s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:26 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8cf39787-d501-42cc-82bd-79a36e6ca2e3 tempest-ProjectReaderTests-433089253 None] Lock "cinder-quobyte-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b" released by "delete_snapshot" :: held 1.836s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:26 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dab5c70b-bdd0-4988-98b9-4b60a944614c_0xwv4_cadevstack@QuobyteHD" returned: 0 in 0.413s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dab5c70b-bdd0-4988-98b9-4b60a944614c_0xwv4_cadevstack@QuobyteHD {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:27 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dab5c70b-bdd0-4988-98b9-4b60a944614c_0xwv4_cadevstack@QuobyteHD Nov 03 20:37:27 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-626f4655-fcee-46e4-a6df-3cd56bfe8054 tempest-ProjectMemberTests-196532882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:27 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-8cf39787-d501-42cc-82bd-79a36e6ca2e3 tempest-ProjectReaderTests-433089253 None] Created reservations ['f1ddc9be-115a-4eac-b55d-12b91ddde87b', '8adb44fd-8eca-48bd-ac24-e5418b16eedc', 'c1d82c6a-f05b-45f4-9b65-47793a06eacb', 'adf7ecf8-b571-4bde-bf83-88f43e4f995b'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:37:27 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-8cf39787-d501-42cc-82bd-79a36e6ca2e3 tempest-ProjectReaderTests-433089253 None] Delete snapshot completed successfully. Nov 03 20:37:27 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8cf39787-d501-42cc-82bd-79a36e6ca2e3 tempest-ProjectReaderTests-433089253 None] Lock "cinder-6434c8cc-2ebd-4654-8e42-706195d9b741-delete_snapshot" released by "delete_snapshot" :: held 2.099s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:27 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f8763ae9-8c91-4f12-a5d6-3c5761e0a921 tempest-CinderUnicodeTest-2050519788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2252b121-dce5-49bf-beca-4a60be3e7340 1073741824" returned: 0 in 0.548s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:27 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-5962bb43-984c-4899-a5f4-f049ac303dc8 tempest-ProjectReaderTests-433089253 None] Acquiring lock "cinder-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:27 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-5962bb43-984c-4899-a5f4-f049ac303dc8 tempest-ProjectReaderTests-433089253 None] Lock "cinder-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:27 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dab5c70b-bdd0-4988-98b9-4b60a944614c_0xwv4_cadevstack@QuobyteHD" returned: 1 in 0.364s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dab5c70b-bdd0-4988-98b9-4b60a944614c_0xwv4_cadevstack@QuobyteHD' failed. Not Retrying. {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 20:37:27 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Temporary image dab5c70b-bdd0-4988-98b9-4b60a944614c is fetched for user 0a627e9219334675886cbf2d69f3c220. {{(pid=87248) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 20:37:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f8763ae9-8c91-4f12-a5d6-3c5761e0a921 tempest-CinderUnicodeTest-2050519788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2252b121-dce5-49bf-beca-4a60be3e7340 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:27 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2252b121-dce5-49bf-beca-4a60be3e7340 Nov 03 20:37:27 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:27 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-5962bb43-984c-4899-a5f4-f049ac303dc8 tempest-ProjectReaderTests-433089253 None] Acquiring lock "cinder-quobyte-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:27 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-5962bb43-984c-4899-a5f4-f049ac303dc8 tempest-ProjectReaderTests-433089253 None] Lock "cinder-quobyte-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b" acquired by "delete_volume" :: waited 0.020s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:27 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce71331-4218-4dff-8b09-d53c1468a8bf]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5962bb43-984c-4899-a5f4-f049ac303dc8 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:27 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eaffc75-f224-4aab-bb11-7b4994ca53dd]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dab5c70b-bdd0-4988-98b9-4b60a944614c_0xwv4_cadevstack@QuobyteHD {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:27 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b Nov 03 20:37:27 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:27 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dab5c70b-bdd0-4988-98b9-4b60a944614c_0xwv4_cadevstack@QuobyteHD Nov 03 20:37:27 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:27 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f8763ae9-8c91-4f12-a5d6-3c5761e0a921 tempest-CinderUnicodeTest-2050519788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2252b121-dce5-49bf-beca-4a60be3e7340" returned: 0 in 0.268s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:27 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-f8763ae9-8c91-4f12-a5d6-3c5761e0a921 tempest-CinderUnicodeTest-2050519788 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:37:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f8763ae9-8c91-4f12-a5d6-3c5761e0a921 tempest-CinderUnicodeTest-2050519788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-626f4655-fcee-46e4-a6df-3cd56bfe8054 tempest-ProjectMemberTests-196532882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.519s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:27 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-626f4655-fcee-46e4-a6df-3cd56bfe8054 tempest-ProjectMemberTests-196532882 None] Creating offline snapshot 41da624f-4275-4dd8-8218-8b82e6523764 of volume 40330863-70f7-4023-8e63-3fb0808f5467 {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:37:27 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f8763ae9-8c91-4f12-a5d6-3c5761e0a921 tempest-CinderUnicodeTest-2050519788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41c8e2de-a3f8-4582-8449-00056f60fcc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2252b121-dce5-49bf-beca-4a60be3e7340', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:27 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f8763ae9-8c91-4f12-a5d6-3c5761e0a921 tempest-CinderUnicodeTest-2050519788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af186165-9371-4b76-b302-56d03a65615c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:27 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[862f8e8c-c4e6-475d-b13c-9e104fa88561]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-626f4655-fcee-46e4-a6df-3cd56bfe8054 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-40330863-70f7-4023-8e63-3fb0808f5467 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:27 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-f8763ae9-8c91-4f12-a5d6-3c5761e0a921 tempest-CinderUnicodeTest-2050519788 None] Volume volume-2252b121-dce5-49bf-beca-4a60be3e7340 (2252b121-dce5-49bf-beca-4a60be3e7340): created successfully Nov 03 20:37:27 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f8763ae9-8c91-4f12-a5d6-3c5761e0a921 tempest-CinderUnicodeTest-2050519788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af186165-9371-4b76-b302-56d03a65615c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:27 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-f8763ae9-8c91-4f12-a5d6-3c5761e0a921 tempest-CinderUnicodeTest-2050519788 None] Flow 'volume_create_manager' (7bc6f22d-91ad-4a0e-8357-f2f87b3be458) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:37:27 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-f8763ae9-8c91-4f12-a5d6-3c5761e0a921 tempest-CinderUnicodeTest-2050519788 None] Created volume successfully. Nov 03 20:37:27 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-40330863-70f7-4023-8e63-3fb0808f5467 Nov 03 20:37:27 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:27 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5962bb43-984c-4899-a5f4-f049ac303dc8 tempest-ProjectReaderTests-433089253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b" returned: 0 in 0.412s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5962bb43-984c-4899-a5f4-f049ac303dc8 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:27 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dab5c70b-bdd0-4988-98b9-4b60a944614c_0xwv4_cadevstack@QuobyteHD" returned: 0 in 0.410s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dab5c70b-bdd0-4988-98b9-4b60a944614c_0xwv4_cadevstack@QuobyteHD {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:27 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b Nov 03 20:37:27 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:28 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dab5c70b-bdd0-4988-98b9-4b60a944614c_0xwv4_cadevstack@QuobyteHD Nov 03 20:37:28 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:28 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5962bb43-984c-4899-a5f4-f049ac303dc8 tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b" returned: 0 in 0.278s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:28 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-5962bb43-984c-4899-a5f4-f049ac303dc8 tempest-ProjectReaderTests-433089253 None] Lock "cinder-quobyte-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b" released by "delete_volume" :: held 0.756s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:28 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-626f4655-fcee-46e4-a6df-3cd56bfe8054 tempest-ProjectMemberTests-196532882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-40330863-70f7-4023-8e63-3fb0808f5467" returned: 0 in 0.485s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-626f4655-fcee-46e4-a6df-3cd56bfe8054 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-40330863-70f7-4023-8e63-3fb0808f5467,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-40330863-70f7-4023-8e63-3fb0808f5467.41da624f-4275-4dd8-8218-8b82e6523764 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:28 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-40330863-70f7-4023-8e63-3fb0808f5467,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-40330863-70f7-4023-8e63-3fb0808f5467.41da624f-4275-4dd8-8218-8b82e6523764 1G Nov 03 20:37:28 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:28 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-5962bb43-984c-4899-a5f4-f049ac303dc8 tempest-ProjectReaderTests-433089253 None] Created reservations ['31c69d1a-92e4-4106-b288-9c561237514d', '32a3cf83-0d6f-448f-978d-2fba6322c692', '80ed4093-b122-4c59-b2a3-32c0903bc846', '3d420263-dfc5-4318-ae93-8baf5fbdd512'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:37:28 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dab5c70b-bdd0-4988-98b9-4b60a944614c_0xwv4_cadevstack@QuobyteHD" returned: 1 in 0.376s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dab5c70b-bdd0-4988-98b9-4b60a944614c_0xwv4_cadevstack@QuobyteHD' failed. Not Retrying. {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 20:37:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-5962bb43-984c-4899-a5f4-f049ac303dc8 tempest-ProjectReaderTests-433089253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-5962bb43-984c-4899-a5f4-f049ac303dc8 tempest-ProjectReaderTests-433089253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-5962bb43-984c-4899-a5f4-f049ac303dc8 tempest-ProjectReaderTests-433089253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:37:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-5962bb43-984c-4899-a5f4-f049ac303dc8 tempest-ProjectReaderTests-433089253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:37:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-5962bb43-984c-4899-a5f4-f049ac303dc8 tempest-ProjectReaderTests-433089253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5962bb43-984c-4899-a5f4-f049ac303dc8 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:28 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:37:28 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:28 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:28 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5962bb43-984c-4899-a5f4-f049ac303dc8 tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.299s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:28 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-5962bb43-984c-4899-a5f4-f049ac303dc8 tempest-ProjectReaderTests-433089253 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:37:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-626f4655-fcee-46e4-a6df-3cd56bfe8054 tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-40330863-70f7-4023-8e63-3fb0808f5467,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-40330863-70f7-4023-8e63-3fb0808f5467.41da624f-4275-4dd8-8218-8b82e6523764 1G" returned: 0 in 0.440s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-626f4655-fcee-46e4-a6df-3cd56bfe8054 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40330863-70f7-4023-8e63-3fb0808f5467 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-40330863-70f7-4023-8e63-3fb0808f5467.41da624f-4275-4dd8-8218-8b82e6523764 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:28 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-5962bb43-984c-4899-a5f4-f049ac303dc8 tempest-ProjectReaderTests-433089253 None] Deleted volume successfully. Nov 03 20:37:28 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40330863-70f7-4023-8e63-3fb0808f5467 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-40330863-70f7-4023-8e63-3fb0808f5467.41da624f-4275-4dd8-8218-8b82e6523764 Nov 03 20:37:28 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:28 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-5962bb43-984c-4899-a5f4-f049ac303dc8 tempest-ProjectReaderTests-433089253 None] Lock "cinder-18caf7eb-1298-4b9b-9d69-a3dafe8aff1b-delete_volume" released by "delete_volume" :: held 1.355s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:28 devstack cinder-volume[87248]: DEBUG oslo_service.periodic_task [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:37:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:37:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:37:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:28 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:37:28 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:29 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.299s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:29 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:37:29 devstack cinder-volume[87248]: DEBUG oslo_service.periodic_task [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running periodic task VolumeManager._thread_info {{(pid=87248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:37:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] thread count: 28 {{(pid=87248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:37:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] thread info: [<_MainThread(MainThread, started 124862067372160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:37:29 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-626f4655-fcee-46e4-a6df-3cd56bfe8054 tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40330863-70f7-4023-8e63-3fb0808f5467 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-40330863-70f7-4023-8e63-3fb0808f5467.41da624f-4275-4dd8-8218-8b82e6523764" returned: 0 in 0.461s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:29 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-626f4655-fcee-46e4-a6df-3cd56bfe8054 tempest-ProjectMemberTests-196532882 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-40330863-70f7-4023-8e63-3fb0808f5467.41da624f-4275-4dd8-8218-8b82e6523764 is being set with open permissions: ugo+rw Nov 03 20:37:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-626f4655-fcee-46e4-a6df-3cd56bfe8054 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-40330863-70f7-4023-8e63-3fb0808f5467.41da624f-4275-4dd8-8218-8b82e6523764 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:29 devstack sudo[107006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-40330863-70f7-4023-8e63-3fb0808f5467.41da624f-4275-4dd8-8218-8b82e6523764 Nov 03 20:37:29 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:29 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-8361fbde-7435-47d0-84ef-d496cf9b27e2 tempest-ProjectReaderTests-433089253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:37:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8361fbde-7435-47d0-84ef-d496cf9b27e2 tempest-ProjectReaderTests-433089253 None] Flow 'volume_create_manager' (5568acc9-5fde-422d-94db-6ffee90df120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:37:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8361fbde-7435-47d0-84ef-d496cf9b27e2 tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2c6e366-a201-4abb-9820-ed7397794179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8361fbde-7435-47d0-84ef-d496cf9b27e2 tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2c6e366-a201-4abb-9820-ed7397794179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-887287334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b196d98-3ea4-4ab8-9f4d-401f3adae0e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c44365c19f64452a4ca43ddbc83b98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:37:29Z,use_quota=True,user_id='b4a43cba6ec642509e771e8a42d91883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8361fbde-7435-47d0-84ef-d496cf9b27e2 tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab6f027f-99a8-41a3-82a5-43de4d55eb56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8361fbde-7435-47d0-84ef-d496cf9b27e2 tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab6f027f-99a8-41a3-82a5-43de4d55eb56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8361fbde-7435-47d0-84ef-d496cf9b27e2 tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93bc2568-6765-4c50-8c24-d211e8ac13cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8361fbde-7435-47d0-84ef-d496cf9b27e2 tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93bc2568-6765-4c50-8c24-d211e8ac13cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b196d98-3ea4-4ab8-9f4d-401f3adae0e4', 'volume_name': 'volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8361fbde-7435-47d0-84ef-d496cf9b27e2 tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e5103c5-05c8-4d40-b8ef-08b6385bbd29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8361fbde-7435-47d0-84ef-d496cf9b27e2 tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e5103c5-05c8-4d40-b8ef-08b6385bbd29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8361fbde-7435-47d0-84ef-d496cf9b27e2 tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df840780-95ed-4260-b9d0-f49845028a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:29 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-8361fbde-7435-47d0-84ef-d496cf9b27e2 tempest-ProjectReaderTests-433089253 None] Volume 1b196d98-3ea4-4ab8-9f4d-401f3adae0e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4', 'volume_size': 1} Nov 03 20:37:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8361fbde-7435-47d0-84ef-d496cf9b27e2 tempest-ProjectReaderTests-433089253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:29 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5093154-b82c-4f3f-ac01-e758e17d9dea tempest-CinderUnicodeTest-2050519788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:37:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a5093154-b82c-4f3f-ac01-e758e17d9dea tempest-CinderUnicodeTest-2050519788 None] Flow 'volume_create_manager' (cb26d6bd-d7c7-4691-92c0-9e0b0ba60f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:37:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a5093154-b82c-4f3f-ac01-e758e17d9dea tempest-CinderUnicodeTest-2050519788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e456dd5d-5b22-469c-89ac-56505df1325d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:29 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-626f4655-fcee-46e4-a6df-3cd56bfe8054 tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-40330863-70f7-4023-8e63-3fb0808f5467.41da624f-4275-4dd8-8218-8b82e6523764" returned: 0 in 0.296s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a5093154-b82c-4f3f-ac01-e758e17d9dea tempest-CinderUnicodeTest-2050519788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e456dd5d-5b22-469c-89ac-56505df1325d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:37:29Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-779704229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63fb2197-1296-427b-93f7-a6b4c9236a4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6700f71251074c67b31f1812d2a253d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:37:29Z,use_quota=True,user_id='fa398cab549c455686350ea0af161bcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a5093154-b82c-4f3f-ac01-e758e17d9dea tempest-CinderUnicodeTest-2050519788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a630e188-b282-4eb4-921e-1aa5d804deb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a5093154-b82c-4f3f-ac01-e758e17d9dea tempest-CinderUnicodeTest-2050519788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a630e188-b282-4eb4-921e-1aa5d804deb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a5093154-b82c-4f3f-ac01-e758e17d9dea tempest-CinderUnicodeTest-2050519788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbc42afc-56e8-4a95-8626-eb98259338e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a5093154-b82c-4f3f-ac01-e758e17d9dea tempest-CinderUnicodeTest-2050519788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbc42afc-56e8-4a95-8626-eb98259338e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63fb2197-1296-427b-93f7-a6b4c9236a4f', 'volume_name': 'volume-63fb2197-1296-427b-93f7-a6b4c9236a4f', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a5093154-b82c-4f3f-ac01-e758e17d9dea tempest-CinderUnicodeTest-2050519788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79e1b7c0-b04c-4932-af25-5470421ffb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a5093154-b82c-4f3f-ac01-e758e17d9dea tempest-CinderUnicodeTest-2050519788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79e1b7c0-b04c-4932-af25-5470421ffb28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a5093154-b82c-4f3f-ac01-e758e17d9dea tempest-CinderUnicodeTest-2050519788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (110c1b84-c24c-4c47-8e52-8c6347346c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:29 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-a5093154-b82c-4f3f-ac01-e758e17d9dea tempest-CinderUnicodeTest-2050519788 None] Volume 63fb2197-1296-427b-93f7-a6b4c9236a4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63fb2197-1296-427b-93f7-a6b4c9236a4f', 'volume_size': 1} Nov 03 20:37:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a5093154-b82c-4f3f-ac01-e758e17d9dea tempest-CinderUnicodeTest-2050519788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-626f4655-fcee-46e4-a6df-3cd56bfe8054 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-40330863-70f7-4023-8e63-3fb0808f5467.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:29 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-40330863-70f7-4023-8e63-3fb0808f5467.info Nov 03 20:37:29 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:29 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-626f4655-fcee-46e4-a6df-3cd56bfe8054 tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-40330863-70f7-4023-8e63-3fb0808f5467.info" returned: 0 in 0.249s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:29 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-626f4655-fcee-46e4-a6df-3cd56bfe8054 tempest-ProjectMemberTests-196532882 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-40330863-70f7-4023-8e63-3fb0808f5467.info is being set with open permissions: ugo+rw Nov 03 20:37:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-626f4655-fcee-46e4-a6df-3cd56bfe8054 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-40330863-70f7-4023-8e63-3fb0808f5467.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:29 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-40330863-70f7-4023-8e63-3fb0808f5467.info Nov 03 20:37:29 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:29 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-626f4655-fcee-46e4-a6df-3cd56bfe8054 tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-40330863-70f7-4023-8e63-3fb0808f5467.info" returned: 0 in 0.237s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-626f4655-fcee-46e4-a6df-3cd56bfe8054 tempest-ProjectMemberTests-196532882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.309s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.687s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:29 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10e3de3b-5dbc-48ff-8685-244727465b0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a5eda781fb043d0b402e2e533fc7fc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:37:26Z,use_quota=True,user_id='0a627e9219334675886cbf2d69f3c220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:37:29 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Creating volume 10e3de3b-5dbc-48ff-8685-244727465b0e {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:37:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:29 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:37:29 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:37:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:29 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:37:29 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:37:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-10e3de3b-5dbc-48ff-8685-244727465b0e 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:29 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-10e3de3b-5dbc-48ff-8685-244727465b0e 1073741824 Nov 03 20:37:29 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:30 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-626f4655-fcee-46e4-a6df-3cd56bfe8054 tempest-ProjectMemberTests-196532882 None] Create snapshot completed successfully Nov 03 20:37:30 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2326dacb-53e3-4060-bf04-e626a7a2c17a tempest-ProjectMemberTests-196532882 None] Acquiring lock "cinder-41da624f-4275-4dd8-8218-8b82e6523764-delete_snapshot" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:30 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2326dacb-53e3-4060-bf04-e626a7a2c17a tempest-ProjectMemberTests-196532882 None] Lock "cinder-41da624f-4275-4dd8-8218-8b82e6523764-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:30 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2326dacb-53e3-4060-bf04-e626a7a2c17a tempest-ProjectMemberTests-196532882 None] Acquiring lock "cinder-quobyte-40330863-70f7-4023-8e63-3fb0808f5467" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:30 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2326dacb-53e3-4060-bf04-e626a7a2c17a tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-40330863-70f7-4023-8e63-3fb0808f5467" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:30 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2326dacb-53e3-4060-bf04-e626a7a2c17a tempest-ProjectMemberTests-196532882 None] Acquiring lock "cinder-quobyte-41da624f-4275-4dd8-8218-8b82e6523764" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:30 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2326dacb-53e3-4060-bf04-e626a7a2c17a tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-41da624f-4275-4dd8-8218-8b82e6523764" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:30 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-2326dacb-53e3-4060-bf04-e626a7a2c17a tempest-ProjectMemberTests-196532882 None] Deleting offline snapshot 41da624f-4275-4dd8-8218-8b82e6523764 of volume 40330863-70f7-4023-8e63-3fb0808f5467 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:37:30 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-2326dacb-53e3-4060-bf04-e626a7a2c17a tempest-ProjectMemberTests-196532882 None] snapshot_file for this snap is: volume-40330863-70f7-4023-8e63-3fb0808f5467.41da624f-4275-4dd8-8218-8b82e6523764 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:37:30 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3289390-05a4-4b4e-818f-64333615643b]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2326dacb-53e3-4060-bf04-e626a7a2c17a tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-40330863-70f7-4023-8e63-3fb0808f5467.41da624f-4275-4dd8-8218-8b82e6523764 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:30 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-10e3de3b-5dbc-48ff-8685-244727465b0e 1073741824" returned: 0 in 0.485s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:30 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:SELECT=213,cinder:UPDATE=303,cinder:DELETE=30,cinder:INSERT=86 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:37:30 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:SELECT=230,cinder:UPDATE=295,cinder:INSERT=68,cinder:DELETE=24 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:37:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-10e3de3b-5dbc-48ff-8685-244727465b0e {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:30 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-40330863-70f7-4023-8e63-3fb0808f5467.41da624f-4275-4dd8-8218-8b82e6523764 Nov 03 20:37:30 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:30 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-10e3de3b-5dbc-48ff-8685-244727465b0e Nov 03 20:37:30 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:30 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-10e3de3b-5dbc-48ff-8685-244727465b0e" returned: 0 in 0.254s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:30 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:37:30 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8361fbde-7435-47d0-84ef-d496cf9b27e2 tempest-ProjectReaderTests-433089253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.469s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:30 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8361fbde-7435-47d0-84ef-d496cf9b27e2 tempest-ProjectReaderTests-433089253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-887287334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b196d98-3ea4-4ab8-9f4d-401f3adae0e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c44365c19f64452a4ca43ddbc83b98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:37:29Z,use_quota=True,user_id='b4a43cba6ec642509e771e8a42d91883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:37:30 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-8361fbde-7435-47d0-84ef-d496cf9b27e2 tempest-ProjectReaderTests-433089253 None] Creating volume 1b196d98-3ea4-4ab8-9f4d-401f3adae0e4 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:37:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8361fbde-7435-47d0-84ef-d496cf9b27e2 tempest-ProjectReaderTests-433089253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8361fbde-7435-47d0-84ef-d496cf9b27e2 tempest-ProjectReaderTests-433089253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:30 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8361fbde-7435-47d0-84ef-d496cf9b27e2 tempest-ProjectReaderTests-433089253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:37:30 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8361fbde-7435-47d0-84ef-d496cf9b27e2 tempest-ProjectReaderTests-433089253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:37:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8361fbde-7435-47d0-84ef-d496cf9b27e2 tempest-ProjectReaderTests-433089253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:30 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8361fbde-7435-47d0-84ef-d496cf9b27e2 tempest-ProjectReaderTests-433089253 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:37:30 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-8361fbde-7435-47d0-84ef-d496cf9b27e2 tempest-ProjectReaderTests-433089253 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:37:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8361fbde-7435-47d0-84ef-d496cf9b27e2 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2326dacb-53e3-4060-bf04-e626a7a2c17a tempest-ProjectMemberTests-196532882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-40330863-70f7-4023-8e63-3fb0808f5467.41da624f-4275-4dd8-8218-8b82e6523764" returned: 0 in 0.385s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:30 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-2326dacb-53e3-4060-bf04-e626a7a2c17a tempest-ProjectMemberTests-196532882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40330863-70f7-4023-8e63-3fb0808f5467(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:37:30 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4 1073741824 Nov 03 20:37:30 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:30 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2474f6-9e10-454f-96df-2063c527d8dc]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2326dacb-53e3-4060-bf04-e626a7a2c17a tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-40330863-70f7-4023-8e63-3fb0808f5467 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:30 devstack cinder-volume[87248]: DEBUG cinder.volume.volume_utils [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Attempting download of dab5c70b-bdd0-4988-98b9-4b60a944614c ((None, [{'url': 'file:///opt/stack/data/glance/images/dab5c70b-bdd0-4988-98b9-4b60a944614c', 'metadata': {}}])) to volume 10e3de3b-5dbc-48ff-8685-244727465b0e. {{(pid=87248) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 20:37:30 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d9884c-e297-4c0d-b326-0bfe67579d5c]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dab5c70b-bdd0-4988-98b9-4b60a944614c_l8ikurot {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:30 devstack sudo[107030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-40330863-70f7-4023-8e63-3fb0808f5467 Nov 03 20:37:30 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:31 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dab5c70b-bdd0-4988-98b9-4b60a944614c_l8ikurot Nov 03 20:37:31 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:31 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:31 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dab5c70b-bdd0-4988-98b9-4b60a944614c_l8ikurot" returned: 0 in 0.351s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dab5c70b-bdd0-4988-98b9-4b60a944614c_l8ikurot {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2326dacb-53e3-4060-bf04-e626a7a2c17a tempest-ProjectMemberTests-196532882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-40330863-70f7-4023-8e63-3fb0808f5467" returned: 0 in 0.429s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2326dacb-53e3-4060-bf04-e626a7a2c17a tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-40330863-70f7-4023-8e63-3fb0808f5467.41da624f-4275-4dd8-8218-8b82e6523764 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:31 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8361fbde-7435-47d0-84ef-d496cf9b27e2 tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4 1073741824" returned: 0 in 0.499s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:31 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-40330863-70f7-4023-8e63-3fb0808f5467.41da624f-4275-4dd8-8218-8b82e6523764 Nov 03 20:37:31 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8361fbde-7435-47d0-84ef-d496cf9b27e2 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:31 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4 Nov 03 20:37:31 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:31 devstack sudo[107042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dab5c70b-bdd0-4988-98b9-4b60a944614c_l8ikurot Nov 03 20:37:31 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:31 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8361fbde-7435-47d0-84ef-d496cf9b27e2 tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4" returned: 0 in 0.259s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:31 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8361fbde-7435-47d0-84ef-d496cf9b27e2 tempest-ProjectReaderTests-433089253 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:37:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8361fbde-7435-47d0-84ef-d496cf9b27e2 tempest-ProjectReaderTests-433089253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a5093154-b82c-4f3f-ac01-e758e17d9dea tempest-CinderUnicodeTest-2050519788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.145s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:31 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a5093154-b82c-4f3f-ac01-e758e17d9dea tempest-CinderUnicodeTest-2050519788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:37:29Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-779704229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63fb2197-1296-427b-93f7-a6b4c9236a4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6700f71251074c67b31f1812d2a253d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:37:29Z,use_quota=True,user_id='fa398cab549c455686350ea0af161bcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:37:31 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-a5093154-b82c-4f3f-ac01-e758e17d9dea tempest-CinderUnicodeTest-2050519788 None] Creating volume 63fb2197-1296-427b-93f7-a6b4c9236a4f {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:37:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a5093154-b82c-4f3f-ac01-e758e17d9dea tempest-CinderUnicodeTest-2050519788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a5093154-b82c-4f3f-ac01-e758e17d9dea tempest-CinderUnicodeTest-2050519788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:31 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a5093154-b82c-4f3f-ac01-e758e17d9dea tempest-CinderUnicodeTest-2050519788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:37:31 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a5093154-b82c-4f3f-ac01-e758e17d9dea tempest-CinderUnicodeTest-2050519788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:37:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a5093154-b82c-4f3f-ac01-e758e17d9dea tempest-CinderUnicodeTest-2050519788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:31 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a5093154-b82c-4f3f-ac01-e758e17d9dea tempest-CinderUnicodeTest-2050519788 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:37:31 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-a5093154-b82c-4f3f-ac01-e758e17d9dea tempest-CinderUnicodeTest-2050519788 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:37:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a5093154-b82c-4f3f-ac01-e758e17d9dea tempest-CinderUnicodeTest-2050519788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63fb2197-1296-427b-93f7-a6b4c9236a4f 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:31 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dab5c70b-bdd0-4988-98b9-4b60a944614c_l8ikurot" returned: 1 in 0.368s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dab5c70b-bdd0-4988-98b9-4b60a944614c_l8ikurot' failed. Not Retrying. {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 20:37:31 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[f087e20b-ecfc-431a-bef4-484ef5b97cf9]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:31 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63fb2197-1296-427b-93f7-a6b4c9236a4f 1073741824 Nov 03 20:37:31 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:31 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:31 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8361fbde-7435-47d0-84ef-d496cf9b27e2 tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df840780-95ed-4260-b9d0-f49845028a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:31 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8361fbde-7435-47d0-84ef-d496cf9b27e2 tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eee3633c-d7a1-41e8-9413-ac5748a3f7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dab5c70b-bdd0-4988-98b9-4b60a944614c_0xwv4_cadevstack@QuobyteHD {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2326dacb-53e3-4060-bf04-e626a7a2c17a tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-40330863-70f7-4023-8e63-3fb0808f5467.41da624f-4275-4dd8-8218-8b82e6523764" returned: 0 in 0.395s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2326dacb-53e3-4060-bf04-e626a7a2c17a tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-40330863-70f7-4023-8e63-3fb0808f5467.41da624f-4275-4dd8-8218-8b82e6523764 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:31 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-8361fbde-7435-47d0-84ef-d496cf9b27e2 tempest-ProjectReaderTests-433089253 None] Volume volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4 (1b196d98-3ea4-4ab8-9f4d-401f3adae0e4): created successfully Nov 03 20:37:31 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8361fbde-7435-47d0-84ef-d496cf9b27e2 tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eee3633c-d7a1-41e8-9413-ac5748a3f7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:31 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-8361fbde-7435-47d0-84ef-d496cf9b27e2 tempest-ProjectReaderTests-433089253 None] Flow 'volume_create_manager' (5568acc9-5fde-422d-94db-6ffee90df120) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:37:31 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-40330863-70f7-4023-8e63-3fb0808f5467.41da624f-4275-4dd8-8218-8b82e6523764 Nov 03 20:37:31 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:31 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-8361fbde-7435-47d0-84ef-d496cf9b27e2 tempest-ProjectReaderTests-433089253 None] Created volume successfully. Nov 03 20:37:31 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dab5c70b-bdd0-4988-98b9-4b60a944614c_0xwv4_cadevstack@QuobyteHD Nov 03 20:37:31 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:31 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2326dacb-53e3-4060-bf04-e626a7a2c17a tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-40330863-70f7-4023-8e63-3fb0808f5467.41da624f-4275-4dd8-8218-8b82e6523764" returned: 0 in 0.296s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:31 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2326dacb-53e3-4060-bf04-e626a7a2c17a tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-41da624f-4275-4dd8-8218-8b82e6523764" released by "_delete_snapshot" :: held 1.623s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:32 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2326dacb-53e3-4060-bf04-e626a7a2c17a tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-40330863-70f7-4023-8e63-3fb0808f5467" released by "delete_snapshot" :: held 1.651s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:32 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dab5c70b-bdd0-4988-98b9-4b60a944614c_0xwv4_cadevstack@QuobyteHD" returned: 0 in 0.367s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dab5c70b-bdd0-4988-98b9-4b60a944614c_0xwv4_cadevstack@QuobyteHD {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:32 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a5093154-b82c-4f3f-ac01-e758e17d9dea tempest-CinderUnicodeTest-2050519788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63fb2197-1296-427b-93f7-a6b4c9236a4f 1073741824" returned: 0 in 0.451s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:32 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-2326dacb-53e3-4060-bf04-e626a7a2c17a tempest-ProjectMemberTests-196532882 None] Created reservations ['4c439244-53b8-46e2-89f3-3380b29ac612', 'ef056e54-ff6d-4311-a2ec-4acf3cf862fa', '6e6de04d-1273-48e4-be5d-ad2e9b734ba9', '03f080d3-ea81-4f4c-a06d-f1c914a7abf1'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:37:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a5093154-b82c-4f3f-ac01-e758e17d9dea tempest-CinderUnicodeTest-2050519788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63fb2197-1296-427b-93f7-a6b4c9236a4f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:32 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63fb2197-1296-427b-93f7-a6b4c9236a4f Nov 03 20:37:32 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:32 devstack sudo[107068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dab5c70b-bdd0-4988-98b9-4b60a944614c_0xwv4_cadevstack@QuobyteHD Nov 03 20:37:32 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:32 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-2326dacb-53e3-4060-bf04-e626a7a2c17a tempest-ProjectMemberTests-196532882 None] Delete snapshot completed successfully. Nov 03 20:37:32 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2326dacb-53e3-4060-bf04-e626a7a2c17a tempest-ProjectMemberTests-196532882 None] Lock "cinder-41da624f-4275-4dd8-8218-8b82e6523764-delete_snapshot" released by "delete_snapshot" :: held 1.859s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dab5c70b-bdd0-4988-98b9-4b60a944614c_0xwv4_cadevstack@QuobyteHD" returned: 1 in 0.376s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dab5c70b-bdd0-4988-98b9-4b60a944614c_0xwv4_cadevstack@QuobyteHD' failed. Not Retrying. {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 20:37:32 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:32 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] dab5c70b-bdd0-4988-98b9-4b60a944614c was raw, converting to qcow2 {{(pid=87248) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 20:37:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_dab5c70b-bdd0-4988-98b9-4b60a944614c_0xwv4_cadevstack@QuobyteHD /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-10e3de3b-5dbc-48ff-8685-244727465b0e {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-40d96f1c-12ae-4b84-8c96-23eb9f854781 tempest-ProjectReaderTests-433089253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:32 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_dab5c70b-bdd0-4988-98b9-4b60a944614c_0xwv4_cadevstack@QuobyteHD /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-10e3de3b-5dbc-48ff-8685-244727465b0e Nov 03 20:37:32 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:32 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a5093154-b82c-4f3f-ac01-e758e17d9dea tempest-CinderUnicodeTest-2050519788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63fb2197-1296-427b-93f7-a6b4c9236a4f" returned: 0 in 0.349s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:32 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a5093154-b82c-4f3f-ac01-e758e17d9dea tempest-CinderUnicodeTest-2050519788 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:37:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a5093154-b82c-4f3f-ac01-e758e17d9dea tempest-CinderUnicodeTest-2050519788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-40d96f1c-12ae-4b84-8c96-23eb9f854781 tempest-ProjectReaderTests-433089253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.036s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:32 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a5093154-b82c-4f3f-ac01-e758e17d9dea tempest-CinderUnicodeTest-2050519788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (110c1b84-c24c-4c47-8e52-8c6347346c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63fb2197-1296-427b-93f7-a6b4c9236a4f', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:32 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a5093154-b82c-4f3f-ac01-e758e17d9dea tempest-CinderUnicodeTest-2050519788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (127476e6-703e-41f8-9d51-dc077f5a3042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:32 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-40d96f1c-12ae-4b84-8c96-23eb9f854781 tempest-ProjectReaderTests-433089253 None] Creating offline snapshot dc0c7295-37ec-46d3-bfc2-0bdd68d523a1 of volume 1b196d98-3ea4-4ab8-9f4d-401f3adae0e4 {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:37:32 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-78da0456-19bf-4d23-a9eb-615f28716b78 tempest-ProjectMemberTests-196532882 None] Acquiring lock "cinder-40330863-70f7-4023-8e63-3fb0808f5467-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:32 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-a5093154-b82c-4f3f-ac01-e758e17d9dea tempest-CinderUnicodeTest-2050519788 None] Volume volume-63fb2197-1296-427b-93f7-a6b4c9236a4f (63fb2197-1296-427b-93f7-a6b4c9236a4f): created successfully Nov 03 20:37:32 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a5093154-b82c-4f3f-ac01-e758e17d9dea tempest-CinderUnicodeTest-2050519788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (127476e6-703e-41f8-9d51-dc077f5a3042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:32 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a5093154-b82c-4f3f-ac01-e758e17d9dea tempest-CinderUnicodeTest-2050519788 None] Flow 'volume_create_manager' (cb26d6bd-d7c7-4691-92c0-9e0b0ba60f9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:37:32 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[08542ce2-a0c9-46e8-9f83-b017054a640e]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-40d96f1c-12ae-4b84-8c96-23eb9f854781 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:32 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-78da0456-19bf-4d23-a9eb-615f28716b78 tempest-ProjectMemberTests-196532882 None] Lock "cinder-40330863-70f7-4023-8e63-3fb0808f5467-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:32 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-a5093154-b82c-4f3f-ac01-e758e17d9dea tempest-CinderUnicodeTest-2050519788 None] Created volume successfully. Nov 03 20:37:32 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-78da0456-19bf-4d23-a9eb-615f28716b78 tempest-ProjectMemberTests-196532882 None] Acquiring lock "cinder-quobyte-40330863-70f7-4023-8e63-3fb0808f5467" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:32 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-78da0456-19bf-4d23-a9eb-615f28716b78 tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-40330863-70f7-4023-8e63-3fb0808f5467" acquired by "delete_volume" :: waited 0.017s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:32 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c3457c-9df2-4e75-a7be-fe539f14d93d]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-78da0456-19bf-4d23-a9eb-615f28716b78 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-40330863-70f7-4023-8e63-3fb0808f5467 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:32 devstack sudo[107079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4 Nov 03 20:37:32 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:32 devstack sudo[107084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-40330863-70f7-4023-8e63-3fb0808f5467 Nov 03 20:37:32 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:32 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_dab5c70b-bdd0-4988-98b9-4b60a944614c_0xwv4_cadevstack@QuobyteHD /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-10e3de3b-5dbc-48ff-8685-244727465b0e" returned: 0 in 0.502s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:32 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dab5c70b-bdd0-4988-98b9-4b60a944614c_0xwv4_cadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-10e3de3b-5dbc-48ff-8685-244727465b0e {{(pid=87248) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:37:32 devstack cinder-volume[87248]: INFO cinder.image.image_utils [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 20:37:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-10e3de3b-5dbc-48ff-8685-244727465b0e 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:32 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-10e3de3b-5dbc-48ff-8685-244727465b0e 1G Nov 03 20:37:32 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:32 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-40d96f1c-12ae-4b84-8c96-23eb9f854781 tempest-ProjectReaderTests-433089253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4" returned: 0 in 0.440s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-40d96f1c-12ae-4b84-8c96-23eb9f854781 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4.dc0c7295-37ec-46d3-bfc2-0bdd68d523a1 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:33 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4.dc0c7295-37ec-46d3-bfc2-0bdd68d523a1 1G Nov 03 20:37:33 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:33 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-78da0456-19bf-4d23-a9eb-615f28716b78 tempest-ProjectMemberTests-196532882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-40330863-70f7-4023-8e63-3fb0808f5467" returned: 0 in 0.419s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-78da0456-19bf-4d23-a9eb-615f28716b78 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-40330863-70f7-4023-8e63-3fb0808f5467 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:33 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-40330863-70f7-4023-8e63-3fb0808f5467 Nov 03 20:37:33 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:33 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-10e3de3b-5dbc-48ff-8685-244727465b0e 1G" returned: 0 in 0.396s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:33 devstack cinder-volume[87248]: DEBUG cinder.volume.volume_utils [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Downloaded image dab5c70b-bdd0-4988-98b9-4b60a944614c ((None, [{'url': 'file:///opt/stack/data/glance/images/dab5c70b-bdd0-4988-98b9-4b60a944614c', 'metadata': {}}])) to volume 10e3de3b-5dbc-48ff-8685-244727465b0e successfully. {{(pid=87248) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 20:37:33 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Temporary image dab5c70b-bdd0-4988-98b9-4b60a944614c for user 0a627e9219334675886cbf2d69f3c220 is deleted. {{(pid=87248) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 20:37:33 devstack cinder-volume[87248]: DEBUG cinder.volume.volume_utils [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Marking volume 10e3de3b-5dbc-48ff-8685-244727465b0e as bootable. {{(pid=87248) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 20:37:33 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Copying metadata from image dab5c70b-bdd0-4988-98b9-4b60a944614c to 10e3de3b-5dbc-48ff-8685-244727465b0e. {{(pid=87248) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 20:37:33 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Creating volume glance metadata for volume 10e3de3b-5dbc-48ff-8685-244727465b0e backed by image dab5c70b-bdd0-4988-98b9-4b60a944614c with: {'image_id': 'dab5c70b-bdd0-4988-98b9-4b60a944614c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '60c01d258c0917d34ecd6ad1ebecd06d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87248) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 20:37:33 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88f901ad-3e1b-404c-bf5f-ed5faf86b9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10e3de3b-5dbc-48ff-8685-244727465b0e', 'volume_size': 1, 'image_id': 'dab5c70b-bdd0-4988-98b9-4b60a944614c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dab5c70b-bdd0-4988-98b9-4b60a944614c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '60c01d258c0917d34ecd6ad1ebecd06d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7a5eda781fb043d0b402e2e533fc7fc7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1b291eba01710ef329b699dddc4749046dcd6f3bd25caa089b99c966a05712314036ca07a01e86854399780e0adb9b076b8f7d417244df35806c63562fb88cfd', 'id': 'dab5c70b-bdd0-4988-98b9-4b60a944614c', 'created_at': datetime.datetime(2026, 11, 3, 19, 37, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 19, 37, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dab5c70b-bdd0-4988-98b9-4b60a944614c/file', 'properties': {}}, 'image_service': }' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:33 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0553f047-73f4-4fb2-956c-bd982ac21934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:33 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Volume volume-10e3de3b-5dbc-48ff-8685-244727465b0e (10e3de3b-5dbc-48ff-8685-244727465b0e): created successfully Nov 03 20:37:33 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0553f047-73f4-4fb2-956c-bd982ac21934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:33 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Flow 'volume_create_manager' (e83e73d7-5802-41b3-9e9f-ebc85a62645c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:37:33 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-152f4bf0-6e2e-4f68-b6ab-fb7907b2ee3d tempest-VolumeImageDependencyTests-289811101 None] Created volume successfully. Nov 03 20:37:33 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-78da0456-19bf-4d23-a9eb-615f28716b78 tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-40330863-70f7-4023-8e63-3fb0808f5467" returned: 0 in 0.429s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:33 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-78da0456-19bf-4d23-a9eb-615f28716b78 tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-40330863-70f7-4023-8e63-3fb0808f5467" released by "delete_volume" :: held 0.927s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:33 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-40d96f1c-12ae-4b84-8c96-23eb9f854781 tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4.dc0c7295-37ec-46d3-bfc2-0bdd68d523a1 1G" returned: 0 in 0.619s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-40d96f1c-12ae-4b84-8c96-23eb9f854781 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4.dc0c7295-37ec-46d3-bfc2-0bdd68d523a1 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:33 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4.dc0c7295-37ec-46d3-bfc2-0bdd68d523a1 Nov 03 20:37:33 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:33 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-78da0456-19bf-4d23-a9eb-615f28716b78 tempest-ProjectMemberTests-196532882 None] Created reservations ['6f63cf63-a170-451b-9fc3-fbf7a34685af', 'd376a248-d197-447b-89d4-2dc86523936c', 'afc1a4d8-7f7b-4280-95c4-ca0d2a491d23', '882dede8-2e43-4723-bc1b-7d54dd2066da'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:37:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-78da0456-19bf-4d23-a9eb-615f28716b78 tempest-ProjectMemberTests-196532882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-78da0456-19bf-4d23-a9eb-615f28716b78 tempest-ProjectMemberTests-196532882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:33 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-78da0456-19bf-4d23-a9eb-615f28716b78 tempest-ProjectMemberTests-196532882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:37:33 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-78da0456-19bf-4d23-a9eb-615f28716b78 tempest-ProjectMemberTests-196532882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:37:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-78da0456-19bf-4d23-a9eb-615f28716b78 tempest-ProjectMemberTests-196532882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-78da0456-19bf-4d23-a9eb-615f28716b78 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:33 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:37:33 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-cca8ae62-1562-4773-9372-2988af50e3ad tempest-CinderUnicodeTest-2050519788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:33 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-40d96f1c-12ae-4b84-8c96-23eb9f854781 tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4.dc0c7295-37ec-46d3-bfc2-0bdd68d523a1" returned: 0 in 0.371s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:33 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-40d96f1c-12ae-4b84-8c96-23eb9f854781 tempest-ProjectReaderTests-433089253 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4.dc0c7295-37ec-46d3-bfc2-0bdd68d523a1 is being set with open permissions: ugo+rw Nov 03 20:37:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-40d96f1c-12ae-4b84-8c96-23eb9f854781 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4.dc0c7295-37ec-46d3-bfc2-0bdd68d523a1 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:33 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4.dc0c7295-37ec-46d3-bfc2-0bdd68d523a1 Nov 03 20:37:33 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:34 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-78da0456-19bf-4d23-a9eb-615f28716b78 tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.312s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:34 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-78da0456-19bf-4d23-a9eb-615f28716b78 tempest-ProjectMemberTests-196532882 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:37:34 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-78da0456-19bf-4d23-a9eb-615f28716b78 tempest-ProjectMemberTests-196532882 None] Deleted volume successfully. Nov 03 20:37:34 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-78da0456-19bf-4d23-a9eb-615f28716b78 tempest-ProjectMemberTests-196532882 None] Lock "cinder-40330863-70f7-4023-8e63-3fb0808f5467-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:34 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-40d96f1c-12ae-4b84-8c96-23eb9f854781 tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4.dc0c7295-37ec-46d3-bfc2-0bdd68d523a1" returned: 0 in 0.251s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-40d96f1c-12ae-4b84-8c96-23eb9f854781 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:34 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4.info Nov 03 20:37:34 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:34 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-40d96f1c-12ae-4b84-8c96-23eb9f854781 tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4.info" returned: 0 in 0.272s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:34 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-40d96f1c-12ae-4b84-8c96-23eb9f854781 tempest-ProjectReaderTests-433089253 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4.info is being set with open permissions: ugo+rw Nov 03 20:37:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-40d96f1c-12ae-4b84-8c96-23eb9f854781 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:34 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4.info Nov 03 20:37:34 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:34 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-71f2b780-3827-4ec4-810f-dc1dc1670261 tempest-VolumeImageDependencyTests-289811101 None] Acquiring lock "cinder-10e3de3b-5dbc-48ff-8685-244727465b0e-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:34 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-71f2b780-3827-4ec4-810f-dc1dc1670261 tempest-VolumeImageDependencyTests-289811101 None] Lock "cinder-10e3de3b-5dbc-48ff-8685-244727465b0e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:34 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-71f2b780-3827-4ec4-810f-dc1dc1670261 tempest-VolumeImageDependencyTests-289811101 None] Acquiring lock "cinder-quobyte-10e3de3b-5dbc-48ff-8685-244727465b0e" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:34 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-71f2b780-3827-4ec4-810f-dc1dc1670261 tempest-VolumeImageDependencyTests-289811101 None] Lock "cinder-quobyte-10e3de3b-5dbc-48ff-8685-244727465b0e" acquired by "delete_volume" :: waited 0.024s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:34 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bd8dd0-adbf-4345-8b7e-b1958265a8f6]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-71f2b780-3827-4ec4-810f-dc1dc1670261 tempest-VolumeImageDependencyTests-289811101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-10e3de3b-5dbc-48ff-8685-244727465b0e {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:34 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-40d96f1c-12ae-4b84-8c96-23eb9f854781 tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4.info" returned: 0 in 0.305s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-40d96f1c-12ae-4b84-8c96-23eb9f854781 tempest-ProjectReaderTests-433089253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.384s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-cca8ae62-1562-4773-9372-2988af50e3ad tempest-CinderUnicodeTest-2050519788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.907s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:34 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-cca8ae62-1562-4773-9372-2988af50e3ad tempest-CinderUnicodeTest-2050519788 None] Creating offline snapshot cbabdc17-5843-4983-8f20-fe87b136f326 of volume 63fb2197-1296-427b-93f7-a6b4c9236a4f {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:37:34 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-40d96f1c-12ae-4b84-8c96-23eb9f854781 tempest-ProjectReaderTests-433089253 None] Create snapshot completed successfully Nov 03 20:37:34 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-10e3de3b-5dbc-48ff-8685-244727465b0e Nov 03 20:37:34 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:34 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[be895276-7bfb-4424-9565-7bf3cc4c8734]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:34 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cca8ae62-1562-4773-9372-2988af50e3ad tempest-CinderUnicodeTest-2050519788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63fb2197-1296-427b-93f7-a6b4c9236a4f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:35 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63fb2197-1296-427b-93f7-a6b4c9236a4f Nov 03 20:37:35 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:35 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-71f2b780-3827-4ec4-810f-dc1dc1670261 tempest-VolumeImageDependencyTests-289811101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-10e3de3b-5dbc-48ff-8685-244727465b0e" returned: 0 in 0.449s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-71f2b780-3827-4ec4-810f-dc1dc1670261 tempest-VolumeImageDependencyTests-289811101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-10e3de3b-5dbc-48ff-8685-244727465b0e {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:35 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-10e3de3b-5dbc-48ff-8685-244727465b0e Nov 03 20:37:35 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:35 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-937486b6-972a-42c2-9dc5-4252f3c9913b tempest-ProjectMemberTests-196532882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:37:35 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:35 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-937486b6-972a-42c2-9dc5-4252f3c9913b tempest-ProjectMemberTests-196532882 None] Flow 'volume_create_manager' (350edb8e-63ef-417c-a25b-5a69d98b1a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:37:35 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-937486b6-972a-42c2-9dc5-4252f3c9913b tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee09298e-e7f4-47a7-abdf-d5959ef1ed95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cca8ae62-1562-4773-9372-2988af50e3ad tempest-CinderUnicodeTest-2050519788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63fb2197-1296-427b-93f7-a6b4c9236a4f" returned: 0 in 0.466s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cca8ae62-1562-4773-9372-2988af50e3ad tempest-CinderUnicodeTest-2050519788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63fb2197-1296-427b-93f7-a6b4c9236a4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63fb2197-1296-427b-93f7-a6b4c9236a4f.cbabdc17-5843-4983-8f20-fe87b136f326 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:35 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-937486b6-972a-42c2-9dc5-4252f3c9913b tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee09298e-e7f4-47a7-abdf-d5959ef1ed95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1240392548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84c6129d-f999-4e87-b972-8b8ffc8f6c94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd20413f6d5649da828c1f0bf51455d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:37:35Z,use_quota=True,user_id='595eaffd7e764ae6b07e6aba8405d447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:35 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-937486b6-972a-42c2-9dc5-4252f3c9913b tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9067ce54-6b82-48e4-844a-63645ae369c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:35 devstack sudo[107138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63fb2197-1296-427b-93f7-a6b4c9236a4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63fb2197-1296-427b-93f7-a6b4c9236a4f.cbabdc17-5843-4983-8f20-fe87b136f326 1G Nov 03 20:37:35 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:35 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-937486b6-972a-42c2-9dc5-4252f3c9913b tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9067ce54-6b82-48e4-844a-63645ae369c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:35 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-937486b6-972a-42c2-9dc5-4252f3c9913b tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6a765cd-bf20-4edc-9737-aa7532eaea94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:35 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-937486b6-972a-42c2-9dc5-4252f3c9913b tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6a765cd-bf20-4edc-9737-aa7532eaea94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84c6129d-f999-4e87-b972-8b8ffc8f6c94', 'volume_name': 'volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:35 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-937486b6-972a-42c2-9dc5-4252f3c9913b tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54311741-a6a1-4fb4-8527-b23275b835f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:35 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-937486b6-972a-42c2-9dc5-4252f3c9913b tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54311741-a6a1-4fb4-8527-b23275b835f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:35 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-937486b6-972a-42c2-9dc5-4252f3c9913b tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (821b2d71-7bfe-4f12-8252-5ca84c5f592e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:35 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-937486b6-972a-42c2-9dc5-4252f3c9913b tempest-ProjectMemberTests-196532882 None] Volume 84c6129d-f999-4e87-b972-8b8ffc8f6c94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94', 'volume_size': 1} Nov 03 20:37:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-937486b6-972a-42c2-9dc5-4252f3c9913b tempest-ProjectMemberTests-196532882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:35 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-71f2b780-3827-4ec4-810f-dc1dc1670261 tempest-VolumeImageDependencyTests-289811101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-10e3de3b-5dbc-48ff-8685-244727465b0e" returned: 0 in 0.283s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:35 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-71f2b780-3827-4ec4-810f-dc1dc1670261 tempest-VolumeImageDependencyTests-289811101 None] Lock "cinder-quobyte-10e3de3b-5dbc-48ff-8685-244727465b0e" released by "delete_volume" :: held 0.800s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:35 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-71f2b780-3827-4ec4-810f-dc1dc1670261 tempest-VolumeImageDependencyTests-289811101 None] Created reservations ['7661c11c-f092-4bfe-b8ae-e6ec49dae74d', '21e3b5bc-1184-4d09-8df0-8cb46b878b77', 'b08d7aee-778d-4f06-8542-f0776569d5d2', '3295ef14-7cc9-4326-8718-9c5d6a664e58'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:37:35 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-652a1848-7689-4c28-b9a0-cdbca0f9894e tempest-ProjectReaderTests-433089253 None] Acquiring lock "cinder-dc0c7295-37ec-46d3-bfc2-0bdd68d523a1-delete_snapshot" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-71f2b780-3827-4ec4-810f-dc1dc1670261 tempest-VolumeImageDependencyTests-289811101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-71f2b780-3827-4ec4-810f-dc1dc1670261 tempest-VolumeImageDependencyTests-289811101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:35 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-71f2b780-3827-4ec4-810f-dc1dc1670261 tempest-VolumeImageDependencyTests-289811101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:37:35 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-71f2b780-3827-4ec4-810f-dc1dc1670261 tempest-VolumeImageDependencyTests-289811101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:37:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-71f2b780-3827-4ec4-810f-dc1dc1670261 tempest-VolumeImageDependencyTests-289811101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-71f2b780-3827-4ec4-810f-dc1dc1670261 tempest-VolumeImageDependencyTests-289811101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:35 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-652a1848-7689-4c28-b9a0-cdbca0f9894e tempest-ProjectReaderTests-433089253 None] Lock "cinder-dc0c7295-37ec-46d3-bfc2-0bdd68d523a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:35 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-652a1848-7689-4c28-b9a0-cdbca0f9894e tempest-ProjectReaderTests-433089253 None] Acquiring lock "cinder-quobyte-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:35 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:37:35 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:35 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-652a1848-7689-4c28-b9a0-cdbca0f9894e tempest-ProjectReaderTests-433089253 None] Lock "cinder-quobyte-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:35 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-652a1848-7689-4c28-b9a0-cdbca0f9894e tempest-ProjectReaderTests-433089253 None] Acquiring lock "cinder-quobyte-dc0c7295-37ec-46d3-bfc2-0bdd68d523a1" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:35 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-652a1848-7689-4c28-b9a0-cdbca0f9894e tempest-ProjectReaderTests-433089253 None] Lock "cinder-quobyte-dc0c7295-37ec-46d3-bfc2-0bdd68d523a1" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:35 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-652a1848-7689-4c28-b9a0-cdbca0f9894e tempest-ProjectReaderTests-433089253 None] Deleting offline snapshot dc0c7295-37ec-46d3-bfc2-0bdd68d523a1 of volume 1b196d98-3ea4-4ab8-9f4d-401f3adae0e4 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:37:35 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-652a1848-7689-4c28-b9a0-cdbca0f9894e tempest-ProjectReaderTests-433089253 None] snapshot_file for this snap is: volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4.dc0c7295-37ec-46d3-bfc2-0bdd68d523a1 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:37:35 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08d316d-bfd6-4740-b644-cedec2f28917]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-652a1848-7689-4c28-b9a0-cdbca0f9894e tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4.dc0c7295-37ec-46d3-bfc2-0bdd68d523a1 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:35 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cca8ae62-1562-4773-9372-2988af50e3ad tempest-CinderUnicodeTest-2050519788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63fb2197-1296-427b-93f7-a6b4c9236a4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63fb2197-1296-427b-93f7-a6b4c9236a4f.cbabdc17-5843-4983-8f20-fe87b136f326 1G" returned: 0 in 0.506s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cca8ae62-1562-4773-9372-2988af50e3ad tempest-CinderUnicodeTest-2050519788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63fb2197-1296-427b-93f7-a6b4c9236a4f -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63fb2197-1296-427b-93f7-a6b4c9236a4f.cbabdc17-5843-4983-8f20-fe87b136f326 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:35 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63fb2197-1296-427b-93f7-a6b4c9236a4f -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63fb2197-1296-427b-93f7-a6b4c9236a4f.cbabdc17-5843-4983-8f20-fe87b136f326 Nov 03 20:37:35 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:35 devstack sudo[107147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4.dc0c7295-37ec-46d3-bfc2-0bdd68d523a1 Nov 03 20:37:35 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:36 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-71f2b780-3827-4ec4-810f-dc1dc1670261 tempest-VolumeImageDependencyTests-289811101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.342s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:36 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-71f2b780-3827-4ec4-810f-dc1dc1670261 tempest-VolumeImageDependencyTests-289811101 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:37:36 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-71f2b780-3827-4ec4-810f-dc1dc1670261 tempest-VolumeImageDependencyTests-289811101 None] Deleted volume successfully. Nov 03 20:37:36 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-71f2b780-3827-4ec4-810f-dc1dc1670261 tempest-VolumeImageDependencyTests-289811101 None] Lock "cinder-10e3de3b-5dbc-48ff-8685-244727465b0e-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:36 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cca8ae62-1562-4773-9372-2988af50e3ad tempest-CinderUnicodeTest-2050519788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63fb2197-1296-427b-93f7-a6b4c9236a4f -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63fb2197-1296-427b-93f7-a6b4c9236a4f.cbabdc17-5843-4983-8f20-fe87b136f326" returned: 0 in 0.395s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:36 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-cca8ae62-1562-4773-9372-2988af50e3ad tempest-CinderUnicodeTest-2050519788 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63fb2197-1296-427b-93f7-a6b4c9236a4f.cbabdc17-5843-4983-8f20-fe87b136f326 is being set with open permissions: ugo+rw Nov 03 20:37:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cca8ae62-1562-4773-9372-2988af50e3ad tempest-CinderUnicodeTest-2050519788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63fb2197-1296-427b-93f7-a6b4c9236a4f.cbabdc17-5843-4983-8f20-fe87b136f326 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:36 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-652a1848-7689-4c28-b9a0-cdbca0f9894e tempest-ProjectReaderTests-433089253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4.dc0c7295-37ec-46d3-bfc2-0bdd68d523a1" returned: 0 in 0.465s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:36 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-652a1848-7689-4c28-b9a0-cdbca0f9894e tempest-ProjectReaderTests-433089253 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:37:36 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63fb2197-1296-427b-93f7-a6b4c9236a4f.cbabdc17-5843-4983-8f20-fe87b136f326 Nov 03 20:37:36 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:36 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a707634-4899-443d-ad1f-b67bb245199e]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-652a1848-7689-4c28-b9a0-cdbca0f9894e tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:36 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4 Nov 03 20:37:36 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:36 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cca8ae62-1562-4773-9372-2988af50e3ad tempest-CinderUnicodeTest-2050519788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63fb2197-1296-427b-93f7-a6b4c9236a4f.cbabdc17-5843-4983-8f20-fe87b136f326" returned: 0 in 0.274s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cca8ae62-1562-4773-9372-2988af50e3ad tempest-CinderUnicodeTest-2050519788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63fb2197-1296-427b-93f7-a6b4c9236a4f.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:36 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63fb2197-1296-427b-93f7-a6b4c9236a4f.info Nov 03 20:37:36 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:36 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-652a1848-7689-4c28-b9a0-cdbca0f9894e tempest-ProjectReaderTests-433089253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4" returned: 0 in 0.412s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-652a1848-7689-4c28-b9a0-cdbca0f9894e tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4.dc0c7295-37ec-46d3-bfc2-0bdd68d523a1 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:36 devstack sudo[107168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4.dc0c7295-37ec-46d3-bfc2-0bdd68d523a1 Nov 03 20:37:36 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:36 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cca8ae62-1562-4773-9372-2988af50e3ad tempest-CinderUnicodeTest-2050519788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63fb2197-1296-427b-93f7-a6b4c9236a4f.info" returned: 0 in 0.317s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:36 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-cca8ae62-1562-4773-9372-2988af50e3ad tempest-CinderUnicodeTest-2050519788 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63fb2197-1296-427b-93f7-a6b4c9236a4f.info is being set with open permissions: ugo+rw Nov 03 20:37:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cca8ae62-1562-4773-9372-2988af50e3ad tempest-CinderUnicodeTest-2050519788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63fb2197-1296-427b-93f7-a6b4c9236a4f.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:36 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63fb2197-1296-427b-93f7-a6b4c9236a4f.info Nov 03 20:37:36 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:37 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-652a1848-7689-4c28-b9a0-cdbca0f9894e tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4.dc0c7295-37ec-46d3-bfc2-0bdd68d523a1" returned: 0 in 0.386s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-652a1848-7689-4c28-b9a0-cdbca0f9894e tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4.dc0c7295-37ec-46d3-bfc2-0bdd68d523a1 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:37 devstack sudo[107178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4.dc0c7295-37ec-46d3-bfc2-0bdd68d523a1 Nov 03 20:37:37 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:37 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-cca8ae62-1562-4773-9372-2988af50e3ad tempest-CinderUnicodeTest-2050519788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63fb2197-1296-427b-93f7-a6b4c9236a4f.info" returned: 0 in 0.287s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-cca8ae62-1562-4773-9372-2988af50e3ad tempest-CinderUnicodeTest-2050519788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.360s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-937486b6-972a-42c2-9dc5-4252f3c9913b tempest-ProjectMemberTests-196532882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.787s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:37 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-937486b6-972a-42c2-9dc5-4252f3c9913b tempest-ProjectMemberTests-196532882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1240392548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84c6129d-f999-4e87-b972-8b8ffc8f6c94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd20413f6d5649da828c1f0bf51455d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:37:35Z,use_quota=True,user_id='595eaffd7e764ae6b07e6aba8405d447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:37:37 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-937486b6-972a-42c2-9dc5-4252f3c9913b tempest-ProjectMemberTests-196532882 None] Creating volume 84c6129d-f999-4e87-b972-8b8ffc8f6c94 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:37:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-937486b6-972a-42c2-9dc5-4252f3c9913b tempest-ProjectMemberTests-196532882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-937486b6-972a-42c2-9dc5-4252f3c9913b tempest-ProjectMemberTests-196532882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:37 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-937486b6-972a-42c2-9dc5-4252f3c9913b tempest-ProjectMemberTests-196532882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:37:37 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-937486b6-972a-42c2-9dc5-4252f3c9913b tempest-ProjectMemberTests-196532882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:37:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-937486b6-972a-42c2-9dc5-4252f3c9913b tempest-ProjectMemberTests-196532882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:37 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-937486b6-972a-42c2-9dc5-4252f3c9913b tempest-ProjectMemberTests-196532882 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:37:37 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-937486b6-972a-42c2-9dc5-4252f3c9913b tempest-ProjectMemberTests-196532882 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:37:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-937486b6-972a-42c2-9dc5-4252f3c9913b tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:37 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94 1073741824 Nov 03 20:37:37 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:37 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-cca8ae62-1562-4773-9372-2988af50e3ad tempest-CinderUnicodeTest-2050519788 None] Create snapshot completed successfully Nov 03 20:37:37 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-652a1848-7689-4c28-b9a0-cdbca0f9894e tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4.dc0c7295-37ec-46d3-bfc2-0bdd68d523a1" returned: 0 in 0.321s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:37 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-652a1848-7689-4c28-b9a0-cdbca0f9894e tempest-ProjectReaderTests-433089253 None] Lock "cinder-quobyte-dc0c7295-37ec-46d3-bfc2-0bdd68d523a1" released by "_delete_snapshot" :: held 1.729s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:37 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-652a1848-7689-4c28-b9a0-cdbca0f9894e tempest-ProjectReaderTests-433089253 None] Lock "cinder-quobyte-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4" released by "delete_snapshot" :: held 1.756s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:37 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-652a1848-7689-4c28-b9a0-cdbca0f9894e tempest-ProjectReaderTests-433089253 None] Created reservations ['3e8b099f-7338-444f-a2b9-4921f110d836', '3436d433-84a2-42f4-bd31-f588a45199fd', '264eeea6-63b0-4eeb-80f8-7b086531990b', 'ee227d8f-cc31-4f87-8811-1ef9c6bc9c7a'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:37:37 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-652a1848-7689-4c28-b9a0-cdbca0f9894e tempest-ProjectReaderTests-433089253 None] Delete snapshot completed successfully. Nov 03 20:37:37 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-652a1848-7689-4c28-b9a0-cdbca0f9894e tempest-ProjectReaderTests-433089253 None] Lock "cinder-dc0c7295-37ec-46d3-bfc2-0bdd68d523a1-delete_snapshot" released by "delete_snapshot" :: held 1.943s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:37 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-937486b6-972a-42c2-9dc5-4252f3c9913b tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94 1073741824" returned: 0 in 0.556s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:37 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-937486b6-972a-42c2-9dc5-4252f3c9913b tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:37 devstack sudo[107187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94 Nov 03 20:37:37 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:37 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-3cc7665b-a8d4-4212-be33-31475e3ec192 tempest-ProjectReaderTests-433089253 None] Acquiring lock "cinder-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:37 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-3cc7665b-a8d4-4212-be33-31475e3ec192 tempest-ProjectReaderTests-433089253 None] Lock "cinder-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:37 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-3cc7665b-a8d4-4212-be33-31475e3ec192 tempest-ProjectReaderTests-433089253 None] Acquiring lock "cinder-quobyte-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:37 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-3cc7665b-a8d4-4212-be33-31475e3ec192 tempest-ProjectReaderTests-433089253 None] Lock "cinder-quobyte-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4" acquired by "delete_volume" :: waited 0.016s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:38 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[741aa50d-576a-4dc9-ad11-180f6f55fc67]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3cc7665b-a8d4-4212-be33-31475e3ec192 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:38 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-937486b6-972a-42c2-9dc5-4252f3c9913b tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94" returned: 0 in 0.297s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:38 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-937486b6-972a-42c2-9dc5-4252f3c9913b tempest-ProjectMemberTests-196532882 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:37:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-937486b6-972a-42c2-9dc5-4252f3c9913b tempest-ProjectMemberTests-196532882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-937486b6-972a-42c2-9dc5-4252f3c9913b tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (821b2d71-7bfe-4f12-8252-5ca84c5f592e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-937486b6-972a-42c2-9dc5-4252f3c9913b tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (852d4894-89f3-4956-a671-acaaf8e05aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:38 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4 Nov 03 20:37:38 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:38 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-937486b6-972a-42c2-9dc5-4252f3c9913b tempest-ProjectMemberTests-196532882 None] Volume volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94 (84c6129d-f999-4e87-b972-8b8ffc8f6c94): created successfully Nov 03 20:37:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-937486b6-972a-42c2-9dc5-4252f3c9913b tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (852d4894-89f3-4956-a671-acaaf8e05aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:38 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-937486b6-972a-42c2-9dc5-4252f3c9913b tempest-ProjectMemberTests-196532882 None] Flow 'volume_create_manager' (350edb8e-63ef-417c-a25b-5a69d98b1a54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:37:38 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-937486b6-972a-42c2-9dc5-4252f3c9913b tempest-ProjectMemberTests-196532882 None] Created volume successfully. Nov 03 20:37:38 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-04c42540-6b45-4a08-a69b-3aed0fd3a503 tempest-CinderUnicodeTest-2050519788 None] Acquiring lock "cinder-cbabdc17-5843-4983-8f20-fe87b136f326-delete_snapshot" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:38 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-04c42540-6b45-4a08-a69b-3aed0fd3a503 tempest-CinderUnicodeTest-2050519788 None] Lock "cinder-cbabdc17-5843-4983-8f20-fe87b136f326-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:38 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-04c42540-6b45-4a08-a69b-3aed0fd3a503 tempest-CinderUnicodeTest-2050519788 None] Acquiring lock "cinder-quobyte-63fb2197-1296-427b-93f7-a6b4c9236a4f" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:38 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-04c42540-6b45-4a08-a69b-3aed0fd3a503 tempest-CinderUnicodeTest-2050519788 None] Lock "cinder-quobyte-63fb2197-1296-427b-93f7-a6b4c9236a4f" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:38 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-04c42540-6b45-4a08-a69b-3aed0fd3a503 tempest-CinderUnicodeTest-2050519788 None] Acquiring lock "cinder-quobyte-cbabdc17-5843-4983-8f20-fe87b136f326" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:38 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-04c42540-6b45-4a08-a69b-3aed0fd3a503 tempest-CinderUnicodeTest-2050519788 None] Lock "cinder-quobyte-cbabdc17-5843-4983-8f20-fe87b136f326" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:38 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-04c42540-6b45-4a08-a69b-3aed0fd3a503 tempest-CinderUnicodeTest-2050519788 None] Deleting offline snapshot cbabdc17-5843-4983-8f20-fe87b136f326 of volume 63fb2197-1296-427b-93f7-a6b4c9236a4f {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:37:38 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-04c42540-6b45-4a08-a69b-3aed0fd3a503 tempest-CinderUnicodeTest-2050519788 None] snapshot_file for this snap is: volume-63fb2197-1296-427b-93f7-a6b4c9236a4f.cbabdc17-5843-4983-8f20-fe87b136f326 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:37:38 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7dd3e0-945c-4c22-8e61-f1ea582a2fd1]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-04c42540-6b45-4a08-a69b-3aed0fd3a503 tempest-CinderUnicodeTest-2050519788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63fb2197-1296-427b-93f7-a6b4c9236a4f.cbabdc17-5843-4983-8f20-fe87b136f326 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:38 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63fb2197-1296-427b-93f7-a6b4c9236a4f.cbabdc17-5843-4983-8f20-fe87b136f326 Nov 03 20:37:38 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:38 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3cc7665b-a8d4-4212-be33-31475e3ec192 tempest-ProjectReaderTests-433089253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4" returned: 0 in 0.459s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3cc7665b-a8d4-4212-be33-31475e3ec192 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:38 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4 Nov 03 20:37:38 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-044fef45-bf3e-46cb-b5cc-ca3f5941bbde tempest-ProjectMemberTests-196532882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-044fef45-bf3e-46cb-b5cc-ca3f5941bbde tempest-ProjectMemberTests-196532882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:38 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-044fef45-bf3e-46cb-b5cc-ca3f5941bbde tempest-ProjectMemberTests-196532882 None] Creating offline snapshot df15e990-086f-46a5-b055-8da54174946f of volume 84c6129d-f999-4e87-b972-8b8ffc8f6c94 {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:37:38 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ebbbf3-e30e-4ac0-9a37-efc00ad452dc]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-044fef45-bf3e-46cb-b5cc-ca3f5941bbde tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:38 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-04c42540-6b45-4a08-a69b-3aed0fd3a503 tempest-CinderUnicodeTest-2050519788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63fb2197-1296-427b-93f7-a6b4c9236a4f.cbabdc17-5843-4983-8f20-fe87b136f326" returned: 0 in 0.490s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:38 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-04c42540-6b45-4a08-a69b-3aed0fd3a503 tempest-CinderUnicodeTest-2050519788 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63fb2197-1296-427b-93f7-a6b4c9236a4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:37:38 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3cc7665b-a8d4-4212-be33-31475e3ec192 tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4" returned: 0 in 0.356s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:38 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[30101be4-d8f1-4f63-9ba8-48e1a39691f8]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:38 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-04c42540-6b45-4a08-a69b-3aed0fd3a503 tempest-CinderUnicodeTest-2050519788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63fb2197-1296-427b-93f7-a6b4c9236a4f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:38 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-3cc7665b-a8d4-4212-be33-31475e3ec192 tempest-ProjectReaderTests-433089253 None] Lock "cinder-quobyte-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4" released by "delete_volume" :: held 0.915s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:38 devstack sudo[107203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94 Nov 03 20:37:38 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:38 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-3cc7665b-a8d4-4212-be33-31475e3ec192 tempest-ProjectReaderTests-433089253 None] Created reservations ['89bea980-45a8-495d-a5fc-a699fa8a302f', '04601a6e-6a08-4b78-b4c6-cd5808636f00', '5c16a087-093f-402b-b148-e2a732129160', '1c670fd4-f3e0-4a39-93d4-ebdf84f178ca'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:37:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-3cc7665b-a8d4-4212-be33-31475e3ec192 tempest-ProjectReaderTests-433089253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-3cc7665b-a8d4-4212-be33-31475e3ec192 tempest-ProjectReaderTests-433089253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:39 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-3cc7665b-a8d4-4212-be33-31475e3ec192 tempest-ProjectReaderTests-433089253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:37:39 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63fb2197-1296-427b-93f7-a6b4c9236a4f Nov 03 20:37:39 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-3cc7665b-a8d4-4212-be33-31475e3ec192 tempest-ProjectReaderTests-433089253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:37:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-3cc7665b-a8d4-4212-be33-31475e3ec192 tempest-ProjectReaderTests-433089253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3cc7665b-a8d4-4212-be33-31475e3ec192 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:39 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:39 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:37:39 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:39 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-044fef45-bf3e-46cb-b5cc-ca3f5941bbde tempest-ProjectMemberTests-196532882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94" returned: 0 in 0.585s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-044fef45-bf3e-46cb-b5cc-ca3f5941bbde tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94.df15e990-086f-46a5-b055-8da54174946f 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:39 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-3cc7665b-a8d4-4212-be33-31475e3ec192 tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.335s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:39 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-3cc7665b-a8d4-4212-be33-31475e3ec192 tempest-ProjectReaderTests-433089253 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:37:39 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94.df15e990-086f-46a5-b055-8da54174946f 1G Nov 03 20:37:39 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:39 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-3cc7665b-a8d4-4212-be33-31475e3ec192 tempest-ProjectReaderTests-433089253 None] Deleted volume successfully. Nov 03 20:37:39 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-3cc7665b-a8d4-4212-be33-31475e3ec192 tempest-ProjectReaderTests-433089253 None] Lock "cinder-1b196d98-3ea4-4ab8-9f4d-401f3adae0e4-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:39 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-04c42540-6b45-4a08-a69b-3aed0fd3a503 tempest-CinderUnicodeTest-2050519788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63fb2197-1296-427b-93f7-a6b4c9236a4f" returned: 0 in 0.590s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-04c42540-6b45-4a08-a69b-3aed0fd3a503 tempest-CinderUnicodeTest-2050519788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63fb2197-1296-427b-93f7-a6b4c9236a4f.cbabdc17-5843-4983-8f20-fe87b136f326 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:39 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63fb2197-1296-427b-93f7-a6b4c9236a4f.cbabdc17-5843-4983-8f20-fe87b136f326 Nov 03 20:37:39 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:39 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-b37910f7-b58b-4a17-83ef-bb587a1f666a tempest-ProjectReaderTests-433089253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:37:39 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b37910f7-b58b-4a17-83ef-bb587a1f666a tempest-ProjectReaderTests-433089253 None] Flow 'volume_create_manager' (b1a8853b-0d95-4416-aef5-b8d348d87311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:37:39 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b37910f7-b58b-4a17-83ef-bb587a1f666a tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22130d0f-f129-45c3-aa63-3ce8ae5032a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:39 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b37910f7-b58b-4a17-83ef-bb587a1f666a tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22130d0f-f129-45c3-aa63-3ce8ae5032a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-750983879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0179f6d3-7a27-4ae2-be6b-b6b808ed3756,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c44365c19f64452a4ca43ddbc83b98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:37:40Z,use_quota=True,user_id='b4a43cba6ec642509e771e8a42d91883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:39 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b37910f7-b58b-4a17-83ef-bb587a1f666a tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0e21f5d-1659-49b6-b42f-aa1fdda53107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:39 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b37910f7-b58b-4a17-83ef-bb587a1f666a tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0e21f5d-1659-49b6-b42f-aa1fdda53107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:39 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:39 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b37910f7-b58b-4a17-83ef-bb587a1f666a tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d983a46f-6e9c-4ed9-a9ad-09212ef57219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:39 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b37910f7-b58b-4a17-83ef-bb587a1f666a tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d983a46f-6e9c-4ed9-a9ad-09212ef57219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0179f6d3-7a27-4ae2-be6b-b6b808ed3756', 'volume_name': 'volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:39 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b37910f7-b58b-4a17-83ef-bb587a1f666a tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca0bd017-5069-4a02-b5c2-3c48bd922d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:39 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b37910f7-b58b-4a17-83ef-bb587a1f666a tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca0bd017-5069-4a02-b5c2-3c48bd922d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:39 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b37910f7-b58b-4a17-83ef-bb587a1f666a tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6901263-dbe6-4fff-aa50-0e6618c2a891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:39 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-b37910f7-b58b-4a17-83ef-bb587a1f666a tempest-ProjectReaderTests-433089253 None] Volume 0179f6d3-7a27-4ae2-be6b-b6b808ed3756: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756', 'volume_size': 1} Nov 03 20:37:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b37910f7-b58b-4a17-83ef-bb587a1f666a tempest-ProjectReaderTests-433089253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-044fef45-bf3e-46cb-b5cc-ca3f5941bbde tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94.df15e990-086f-46a5-b055-8da54174946f 1G" returned: 0 in 0.626s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-044fef45-bf3e-46cb-b5cc-ca3f5941bbde tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94.df15e990-086f-46a5-b055-8da54174946f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:39 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-04c42540-6b45-4a08-a69b-3aed0fd3a503 tempest-CinderUnicodeTest-2050519788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63fb2197-1296-427b-93f7-a6b4c9236a4f.cbabdc17-5843-4983-8f20-fe87b136f326" returned: 0 in 0.535s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:39 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-04c42540-6b45-4a08-a69b-3aed0fd3a503 tempest-CinderUnicodeTest-2050519788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63fb2197-1296-427b-93f7-a6b4c9236a4f.cbabdc17-5843-4983-8f20-fe87b136f326 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:40 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94.df15e990-086f-46a5-b055-8da54174946f Nov 03 20:37:40 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:40 devstack sudo[107229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63fb2197-1296-427b-93f7-a6b4c9236a4f.cbabdc17-5843-4983-8f20-fe87b136f326 Nov 03 20:37:40 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:40 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-04c42540-6b45-4a08-a69b-3aed0fd3a503 tempest-CinderUnicodeTest-2050519788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63fb2197-1296-427b-93f7-a6b4c9236a4f.cbabdc17-5843-4983-8f20-fe87b136f326" returned: 0 in 0.271s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:40 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-044fef45-bf3e-46cb-b5cc-ca3f5941bbde tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94.df15e990-086f-46a5-b055-8da54174946f" returned: 0 in 0.324s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:40 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-044fef45-bf3e-46cb-b5cc-ca3f5941bbde tempest-ProjectMemberTests-196532882 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94.df15e990-086f-46a5-b055-8da54174946f is being set with open permissions: ugo+rw Nov 03 20:37:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-044fef45-bf3e-46cb-b5cc-ca3f5941bbde tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94.df15e990-086f-46a5-b055-8da54174946f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:40 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-04c42540-6b45-4a08-a69b-3aed0fd3a503 tempest-CinderUnicodeTest-2050519788 None] Lock "cinder-quobyte-cbabdc17-5843-4983-8f20-fe87b136f326" released by "_delete_snapshot" :: held 2.032s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:40 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-04c42540-6b45-4a08-a69b-3aed0fd3a503 tempest-CinderUnicodeTest-2050519788 None] Lock "cinder-quobyte-63fb2197-1296-427b-93f7-a6b4c9236a4f" released by "delete_snapshot" :: held 2.057s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:40 devstack sudo[107236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94.df15e990-086f-46a5-b055-8da54174946f Nov 03 20:37:40 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:40 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-04c42540-6b45-4a08-a69b-3aed0fd3a503 tempest-CinderUnicodeTest-2050519788 None] Created reservations ['b564a60d-66e1-47b1-b506-62352dcf3351', '60c5f24b-6f47-45ed-baaf-d7586c336341', '8b0e5a18-5f7c-4098-b145-474a66508e3f', '1c062b3a-e3f5-46d7-bb24-855823023bc9'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:37:40 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-04c42540-6b45-4a08-a69b-3aed0fd3a503 tempest-CinderUnicodeTest-2050519788 None] Delete snapshot completed successfully. Nov 03 20:37:40 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-04c42540-6b45-4a08-a69b-3aed0fd3a503 tempest-CinderUnicodeTest-2050519788 None] Lock "cinder-cbabdc17-5843-4983-8f20-fe87b136f326-delete_snapshot" released by "delete_snapshot" :: held 2.196s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:40 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8e9e1f69-3f5e-48d0-9200-969af998fe41 tempest-CinderUnicodeTest-2050519788 None] Acquiring lock "cinder-63fb2197-1296-427b-93f7-a6b4c9236a4f-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:40 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8e9e1f69-3f5e-48d0-9200-969af998fe41 tempest-CinderUnicodeTest-2050519788 None] Lock "cinder-63fb2197-1296-427b-93f7-a6b4c9236a4f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:40 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-044fef45-bf3e-46cb-b5cc-ca3f5941bbde tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94.df15e990-086f-46a5-b055-8da54174946f" returned: 0 in 0.280s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:40 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8e9e1f69-3f5e-48d0-9200-969af998fe41 tempest-CinderUnicodeTest-2050519788 None] Acquiring lock "cinder-quobyte-63fb2197-1296-427b-93f7-a6b4c9236a4f" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:40 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8e9e1f69-3f5e-48d0-9200-969af998fe41 tempest-CinderUnicodeTest-2050519788 None] Lock "cinder-quobyte-63fb2197-1296-427b-93f7-a6b4c9236a4f" acquired by "delete_volume" :: waited 0.021s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-044fef45-bf3e-46cb-b5cc-ca3f5941bbde tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:40 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7fe9e1-ab57-48a8-b4b2-f249bc964798]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8e9e1f69-3f5e-48d0-9200-969af998fe41 tempest-CinderUnicodeTest-2050519788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63fb2197-1296-427b-93f7-a6b4c9236a4f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:40 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94.info Nov 03 20:37:40 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:40 devstack sudo[107240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63fb2197-1296-427b-93f7-a6b4c9236a4f Nov 03 20:37:40 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:40 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-044fef45-bf3e-46cb-b5cc-ca3f5941bbde tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94.info" returned: 0 in 0.289s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:40 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-044fef45-bf3e-46cb-b5cc-ca3f5941bbde tempest-ProjectMemberTests-196532882 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94.info is being set with open permissions: ugo+rw Nov 03 20:37:40 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-044fef45-bf3e-46cb-b5cc-ca3f5941bbde tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:40 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94.info Nov 03 20:37:40 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:41 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8e9e1f69-3f5e-48d0-9200-969af998fe41 tempest-CinderUnicodeTest-2050519788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63fb2197-1296-427b-93f7-a6b4c9236a4f" returned: 0 in 0.377s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8e9e1f69-3f5e-48d0-9200-969af998fe41 tempest-CinderUnicodeTest-2050519788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63fb2197-1296-427b-93f7-a6b4c9236a4f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:41 devstack sudo[107249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63fb2197-1296-427b-93f7-a6b4c9236a4f Nov 03 20:37:41 devstack sudo[107249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:41 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-044fef45-bf3e-46cb-b5cc-ca3f5941bbde tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94.info" returned: 0 in 0.268s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-044fef45-bf3e-46cb-b5cc-ca3f5941bbde tempest-ProjectMemberTests-196532882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.508s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b37910f7-b58b-4a17-83ef-bb587a1f666a tempest-ProjectReaderTests-433089253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.257s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:41 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-b37910f7-b58b-4a17-83ef-bb587a1f666a tempest-ProjectReaderTests-433089253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-750983879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0179f6d3-7a27-4ae2-be6b-b6b808ed3756,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c44365c19f64452a4ca43ddbc83b98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:37:40Z,use_quota=True,user_id='b4a43cba6ec642509e771e8a42d91883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:37:41 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-b37910f7-b58b-4a17-83ef-bb587a1f666a tempest-ProjectReaderTests-433089253 None] Creating volume 0179f6d3-7a27-4ae2-be6b-b6b808ed3756 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:37:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b37910f7-b58b-4a17-83ef-bb587a1f666a tempest-ProjectReaderTests-433089253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b37910f7-b58b-4a17-83ef-bb587a1f666a tempest-ProjectReaderTests-433089253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:41 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-b37910f7-b58b-4a17-83ef-bb587a1f666a tempest-ProjectReaderTests-433089253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:37:41 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-b37910f7-b58b-4a17-83ef-bb587a1f666a tempest-ProjectReaderTests-433089253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:37:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b37910f7-b58b-4a17-83ef-bb587a1f666a tempest-ProjectReaderTests-433089253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:41 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-b37910f7-b58b-4a17-83ef-bb587a1f666a tempest-ProjectReaderTests-433089253 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:37:41 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-b37910f7-b58b-4a17-83ef-bb587a1f666a tempest-ProjectReaderTests-433089253 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:37:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b37910f7-b58b-4a17-83ef-bb587a1f666a tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:41 devstack sudo[107252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756 1073741824 Nov 03 20:37:41 devstack sudo[107252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:41 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-044fef45-bf3e-46cb-b5cc-ca3f5941bbde tempest-ProjectMemberTests-196532882 None] Create snapshot completed successfully Nov 03 20:37:41 devstack sudo[107249]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8e9e1f69-3f5e-48d0-9200-969af998fe41 tempest-CinderUnicodeTest-2050519788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-63fb2197-1296-427b-93f7-a6b4c9236a4f" returned: 0 in 0.310s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:41 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8e9e1f69-3f5e-48d0-9200-969af998fe41 tempest-CinderUnicodeTest-2050519788 None] Lock "cinder-quobyte-63fb2197-1296-427b-93f7-a6b4c9236a4f" released by "delete_volume" :: held 0.764s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:41 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-8e9e1f69-3f5e-48d0-9200-969af998fe41 tempest-CinderUnicodeTest-2050519788 None] Created reservations ['b7216e2c-4a59-4b96-a9f2-8e08575aa901', 'f9286729-9a96-4611-8697-12bf346987c7', '8fd81384-e3e1-4b59-a18f-4b860086a46b', '834a33ef-a35b-46b6-833f-633bc95687d9'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:37:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8e9e1f69-3f5e-48d0-9200-969af998fe41 tempest-CinderUnicodeTest-2050519788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8e9e1f69-3f5e-48d0-9200-969af998fe41 tempest-CinderUnicodeTest-2050519788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:41 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8e9e1f69-3f5e-48d0-9200-969af998fe41 tempest-CinderUnicodeTest-2050519788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:37:41 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8e9e1f69-3f5e-48d0-9200-969af998fe41 tempest-CinderUnicodeTest-2050519788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:37:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8e9e1f69-3f5e-48d0-9200-969af998fe41 tempest-CinderUnicodeTest-2050519788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8e9e1f69-3f5e-48d0-9200-969af998fe41 tempest-CinderUnicodeTest-2050519788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:41 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:37:41 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:41 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e41e38e1-857d-4f00-a9b5-24adc6a775d4 tempest-CinderUnicodeTest-2050519788 None] Acquiring lock "cinder-2252b121-dce5-49bf-beca-4a60be3e7340-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:41 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e41e38e1-857d-4f00-a9b5-24adc6a775d4 tempest-CinderUnicodeTest-2050519788 None] Lock "cinder-2252b121-dce5-49bf-beca-4a60be3e7340-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:41 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8e9e1f69-3f5e-48d0-9200-969af998fe41 tempest-CinderUnicodeTest-2050519788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.296s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:41 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-8e9e1f69-3f5e-48d0-9200-969af998fe41 tempest-CinderUnicodeTest-2050519788 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:37:41 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-8e9e1f69-3f5e-48d0-9200-969af998fe41 tempest-CinderUnicodeTest-2050519788 None] Deleted volume successfully. Nov 03 20:37:41 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e41e38e1-857d-4f00-a9b5-24adc6a775d4 tempest-CinderUnicodeTest-2050519788 None] Acquiring lock "cinder-quobyte-2252b121-dce5-49bf-beca-4a60be3e7340" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:41 devstack sudo[107252]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b37910f7-b58b-4a17-83ef-bb587a1f666a tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756 1073741824" returned: 0 in 0.607s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:41 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8e9e1f69-3f5e-48d0-9200-969af998fe41 tempest-CinderUnicodeTest-2050519788 None] Lock "cinder-63fb2197-1296-427b-93f7-a6b4c9236a4f-delete_volume" released by "delete_volume" :: held 1.322s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:41 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e41e38e1-857d-4f00-a9b5-24adc6a775d4 tempest-CinderUnicodeTest-2050519788 None] Lock "cinder-quobyte-2252b121-dce5-49bf-beca-4a60be3e7340" acquired by "delete_volume" :: waited 0.035s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:41 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f428b9-81a3-4999-976d-84459dd2b23a]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e41e38e1-857d-4f00-a9b5-24adc6a775d4 tempest-CinderUnicodeTest-2050519788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2252b121-dce5-49bf-beca-4a60be3e7340 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:41 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b37910f7-b58b-4a17-83ef-bb587a1f666a tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:41 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756 Nov 03 20:37:41 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:42 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a0a6692e-1322-4a13-8f81-cf0530b2de99 tempest-ProjectMemberTests-196532882 None] Acquiring lock "cinder-df15e990-086f-46a5-b055-8da54174946f-delete_snapshot" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:42 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a0a6692e-1322-4a13-8f81-cf0530b2de99 tempest-ProjectMemberTests-196532882 None] Lock "cinder-df15e990-086f-46a5-b055-8da54174946f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:42 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a0a6692e-1322-4a13-8f81-cf0530b2de99 tempest-ProjectMemberTests-196532882 None] Acquiring lock "cinder-quobyte-84c6129d-f999-4e87-b972-8b8ffc8f6c94" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:42 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a0a6692e-1322-4a13-8f81-cf0530b2de99 tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-84c6129d-f999-4e87-b972-8b8ffc8f6c94" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:42 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a0a6692e-1322-4a13-8f81-cf0530b2de99 tempest-ProjectMemberTests-196532882 None] Acquiring lock "cinder-quobyte-df15e990-086f-46a5-b055-8da54174946f" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:42 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a0a6692e-1322-4a13-8f81-cf0530b2de99 tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-df15e990-086f-46a5-b055-8da54174946f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:42 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-a0a6692e-1322-4a13-8f81-cf0530b2de99 tempest-ProjectMemberTests-196532882 None] Deleting offline snapshot df15e990-086f-46a5-b055-8da54174946f of volume 84c6129d-f999-4e87-b972-8b8ffc8f6c94 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:37:42 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2252b121-dce5-49bf-beca-4a60be3e7340 Nov 03 20:37:42 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:42 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-a0a6692e-1322-4a13-8f81-cf0530b2de99 tempest-ProjectMemberTests-196532882 None] snapshot_file for this snap is: volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94.df15e990-086f-46a5-b055-8da54174946f {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:37:42 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca835c7-c6ad-4ab1-acdc-6ddd02dff59d]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a0a6692e-1322-4a13-8f81-cf0530b2de99 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94.df15e990-086f-46a5-b055-8da54174946f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:42 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b37910f7-b58b-4a17-83ef-bb587a1f666a tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756" returned: 0 in 0.334s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:42 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-b37910f7-b58b-4a17-83ef-bb587a1f666a tempest-ProjectReaderTests-433089253 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:37:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b37910f7-b58b-4a17-83ef-bb587a1f666a tempest-ProjectReaderTests-433089253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:42 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b37910f7-b58b-4a17-83ef-bb587a1f666a tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6901263-dbe6-4fff-aa50-0e6618c2a891) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:42 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94.df15e990-086f-46a5-b055-8da54174946f Nov 03 20:37:42 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:42 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b37910f7-b58b-4a17-83ef-bb587a1f666a tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a353fdc8-21eb-4882-a910-d8b76d2224b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:42 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-b37910f7-b58b-4a17-83ef-bb587a1f666a tempest-ProjectReaderTests-433089253 None] Volume volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756 (0179f6d3-7a27-4ae2-be6b-b6b808ed3756): created successfully Nov 03 20:37:42 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b37910f7-b58b-4a17-83ef-bb587a1f666a tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a353fdc8-21eb-4882-a910-d8b76d2224b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:42 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-b37910f7-b58b-4a17-83ef-bb587a1f666a tempest-ProjectReaderTests-433089253 None] Flow 'volume_create_manager' (b1a8853b-0d95-4416-aef5-b8d348d87311) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:37:42 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-b37910f7-b58b-4a17-83ef-bb587a1f666a tempest-ProjectReaderTests-433089253 None] Created volume successfully. Nov 03 20:37:42 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e41e38e1-857d-4f00-a9b5-24adc6a775d4 tempest-CinderUnicodeTest-2050519788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2252b121-dce5-49bf-beca-4a60be3e7340" returned: 0 in 0.481s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e41e38e1-857d-4f00-a9b5-24adc6a775d4 tempest-CinderUnicodeTest-2050519788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2252b121-dce5-49bf-beca-4a60be3e7340 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:42 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2252b121-dce5-49bf-beca-4a60be3e7340 Nov 03 20:37:42 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:42 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a0a6692e-1322-4a13-8f81-cf0530b2de99 tempest-ProjectMemberTests-196532882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94.df15e990-086f-46a5-b055-8da54174946f" returned: 0 in 0.415s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:42 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-a0a6692e-1322-4a13-8f81-cf0530b2de99 tempest-ProjectMemberTests-196532882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:37:42 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb477b1-b573-4dc1-8afe-5261eb7d641e]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a0a6692e-1322-4a13-8f81-cf0530b2de99 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:42 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e41e38e1-857d-4f00-a9b5-24adc6a775d4 tempest-CinderUnicodeTest-2050519788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2252b121-dce5-49bf-beca-4a60be3e7340" returned: 0 in 0.269s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:42 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e41e38e1-857d-4f00-a9b5-24adc6a775d4 tempest-CinderUnicodeTest-2050519788 None] Lock "cinder-quobyte-2252b121-dce5-49bf-beca-4a60be3e7340" released by "delete_volume" :: held 0.803s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:42 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94 Nov 03 20:37:42 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-e41e38e1-857d-4f00-a9b5-24adc6a775d4 tempest-CinderUnicodeTest-2050519788 None] Created reservations ['95f0e25b-8f13-4901-9463-dd9419cdc8ac', 'e2301721-ae51-4fe9-bf53-fb82c853a9a7', 'fb4117eb-cc1b-46fc-bb64-dd82170ad375', '8d512322-c75e-401a-97cb-370f2395742d'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:37:42 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e41e38e1-857d-4f00-a9b5-24adc6a775d4 tempest-CinderUnicodeTest-2050519788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e41e38e1-857d-4f00-a9b5-24adc6a775d4 tempest-CinderUnicodeTest-2050519788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:42 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e41e38e1-857d-4f00-a9b5-24adc6a775d4 tempest-CinderUnicodeTest-2050519788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:37:42 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e41e38e1-857d-4f00-a9b5-24adc6a775d4 tempest-CinderUnicodeTest-2050519788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:37:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e41e38e1-857d-4f00-a9b5-24adc6a775d4 tempest-CinderUnicodeTest-2050519788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:42 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e41e38e1-857d-4f00-a9b5-24adc6a775d4 tempest-CinderUnicodeTest-2050519788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:42 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:37:42 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:43 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a0a6692e-1322-4a13-8f81-cf0530b2de99 tempest-ProjectMemberTests-196532882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94" returned: 0 in 0.403s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a0a6692e-1322-4a13-8f81-cf0530b2de99 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94.df15e990-086f-46a5-b055-8da54174946f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:43 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94.df15e990-086f-46a5-b055-8da54174946f Nov 03 20:37:43 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:43 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e41e38e1-857d-4f00-a9b5-24adc6a775d4 tempest-CinderUnicodeTest-2050519788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.266s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:43 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-e41e38e1-857d-4f00-a9b5-24adc6a775d4 tempest-CinderUnicodeTest-2050519788 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:37:43 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-e41e38e1-857d-4f00-a9b5-24adc6a775d4 tempest-CinderUnicodeTest-2050519788 None] Deleted volume successfully. Nov 03 20:37:43 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e41e38e1-857d-4f00-a9b5-24adc6a775d4 tempest-CinderUnicodeTest-2050519788 None] Lock "cinder-2252b121-dce5-49bf-beca-4a60be3e7340-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d415aacb-2205-4de4-991f-1b7b07edc40d tempest-ProjectReaderTests-433089253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d415aacb-2205-4de4-991f-1b7b07edc40d tempest-ProjectReaderTests-433089253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:43 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-d415aacb-2205-4de4-991f-1b7b07edc40d tempest-ProjectReaderTests-433089253 None] Creating offline snapshot 3fd25d9b-caf3-4f65-be71-882ce3928427 of volume 0179f6d3-7a27-4ae2-be6b-b6b808ed3756 {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:37:43 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a0a6692e-1322-4a13-8f81-cf0530b2de99 tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94.df15e990-086f-46a5-b055-8da54174946f" returned: 0 in 0.532s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a0a6692e-1322-4a13-8f81-cf0530b2de99 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94.df15e990-086f-46a5-b055-8da54174946f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:43 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[5919107c-0cbd-4ce2-8dd5-86eee2320348]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d415aacb-2205-4de4-991f-1b7b07edc40d tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:43 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94.df15e990-086f-46a5-b055-8da54174946f Nov 03 20:37:43 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:43 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756 Nov 03 20:37:43 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:43 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:43 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a0a6692e-1322-4a13-8f81-cf0530b2de99 tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94.df15e990-086f-46a5-b055-8da54174946f" returned: 0 in 0.346s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:43 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a0a6692e-1322-4a13-8f81-cf0530b2de99 tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-df15e990-086f-46a5-b055-8da54174946f" released by "_delete_snapshot" :: held 1.856s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:43 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a0a6692e-1322-4a13-8f81-cf0530b2de99 tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-84c6129d-f999-4e87-b972-8b8ffc8f6c94" released by "delete_snapshot" :: held 1.892s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:44 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-a0a6692e-1322-4a13-8f81-cf0530b2de99 tempest-ProjectMemberTests-196532882 None] Created reservations ['039ba3e7-b2ce-453f-9d77-55f044c850b6', '39482d75-5a78-4eb1-ab1a-7f8b8c6c2068', '3bf55656-af4d-40eb-868e-d8c4ec776aef', '33a302ef-985c-46cb-80cb-be0581d5af4e'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:37:44 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d415aacb-2205-4de4-991f-1b7b07edc40d tempest-ProjectReaderTests-433089253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756" returned: 0 in 0.550s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d415aacb-2205-4de4-991f-1b7b07edc40d tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756.3fd25d9b-caf3-4f65-be71-882ce3928427 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:44 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756.3fd25d9b-caf3-4f65-be71-882ce3928427 1G Nov 03 20:37:44 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:44 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-a0a6692e-1322-4a13-8f81-cf0530b2de99 tempest-ProjectMemberTests-196532882 None] Delete snapshot completed successfully. Nov 03 20:37:44 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a0a6692e-1322-4a13-8f81-cf0530b2de99 tempest-ProjectMemberTests-196532882 None] Lock "cinder-df15e990-086f-46a5-b055-8da54174946f-delete_snapshot" released by "delete_snapshot" :: held 2.181s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:44 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e4837fbb-a011-4a9b-9108-73864efdbdab tempest-ProjectMemberTests-196532882 None] Acquiring lock "cinder-84c6129d-f999-4e87-b972-8b8ffc8f6c94-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:44 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e4837fbb-a011-4a9b-9108-73864efdbdab tempest-ProjectMemberTests-196532882 None] Lock "cinder-84c6129d-f999-4e87-b972-8b8ffc8f6c94-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:44 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e4837fbb-a011-4a9b-9108-73864efdbdab tempest-ProjectMemberTests-196532882 None] Acquiring lock "cinder-quobyte-84c6129d-f999-4e87-b972-8b8ffc8f6c94" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:44 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e4837fbb-a011-4a9b-9108-73864efdbdab tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-84c6129d-f999-4e87-b972-8b8ffc8f6c94" acquired by "delete_volume" :: waited 0.021s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:44 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e81969e-518a-4a3b-81f5-513be2b6432d]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e4837fbb-a011-4a9b-9108-73864efdbdab tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:44 devstack sudo[107303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94 Nov 03 20:37:44 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:44 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d415aacb-2205-4de4-991f-1b7b07edc40d tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756.3fd25d9b-caf3-4f65-be71-882ce3928427 1G" returned: 0 in 0.586s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d415aacb-2205-4de4-991f-1b7b07edc40d tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756.3fd25d9b-caf3-4f65-be71-882ce3928427 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:44 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756.3fd25d9b-caf3-4f65-be71-882ce3928427 Nov 03 20:37:44 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:44 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e4837fbb-a011-4a9b-9108-73864efdbdab tempest-ProjectMemberTests-196532882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94" returned: 0 in 0.454s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:44 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e4837fbb-a011-4a9b-9108-73864efdbdab tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:44 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94 Nov 03 20:37:44 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:45 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d415aacb-2205-4de4-991f-1b7b07edc40d tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756.3fd25d9b-caf3-4f65-be71-882ce3928427" returned: 0 in 0.317s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:45 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-d415aacb-2205-4de4-991f-1b7b07edc40d tempest-ProjectReaderTests-433089253 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756.3fd25d9b-caf3-4f65-be71-882ce3928427 is being set with open permissions: ugo+rw Nov 03 20:37:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d415aacb-2205-4de4-991f-1b7b07edc40d tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756.3fd25d9b-caf3-4f65-be71-882ce3928427 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:45 devstack sudo[107319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756.3fd25d9b-caf3-4f65-be71-882ce3928427 Nov 03 20:37:45 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:45 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e4837fbb-a011-4a9b-9108-73864efdbdab tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-84c6129d-f999-4e87-b972-8b8ffc8f6c94" returned: 0 in 0.272s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:45 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e4837fbb-a011-4a9b-9108-73864efdbdab tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-84c6129d-f999-4e87-b972-8b8ffc8f6c94" released by "delete_volume" :: held 0.823s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:45 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-e4837fbb-a011-4a9b-9108-73864efdbdab tempest-ProjectMemberTests-196532882 None] Created reservations ['e9e7a50a-d37e-4ac1-9b54-2063934976a4', '87e1fb1d-2e61-4472-bd03-4e166af30ac2', 'c7596e7d-2381-476c-a8bf-1ce4d26adb31', 'b39a824c-2c88-43ca-ab0f-90da0f47d65d'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:37:45 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d415aacb-2205-4de4-991f-1b7b07edc40d tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756.3fd25d9b-caf3-4f65-be71-882ce3928427" returned: 0 in 0.297s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d415aacb-2205-4de4-991f-1b7b07edc40d tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e4837fbb-a011-4a9b-9108-73864efdbdab tempest-ProjectMemberTests-196532882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e4837fbb-a011-4a9b-9108-73864efdbdab tempest-ProjectMemberTests-196532882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:45 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e4837fbb-a011-4a9b-9108-73864efdbdab tempest-ProjectMemberTests-196532882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:37:45 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-e4837fbb-a011-4a9b-9108-73864efdbdab tempest-ProjectMemberTests-196532882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:37:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-e4837fbb-a011-4a9b-9108-73864efdbdab tempest-ProjectMemberTests-196532882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e4837fbb-a011-4a9b-9108-73864efdbdab tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:45 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756.info Nov 03 20:37:45 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:45 devstack sudo[107325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:37:45 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:45 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:45 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-e4837fbb-a011-4a9b-9108-73864efdbdab tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.365s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d415aacb-2205-4de4-991f-1b7b07edc40d tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756.info" returned: 0 in 0.398s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:45 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-e4837fbb-a011-4a9b-9108-73864efdbdab tempest-ProjectMemberTests-196532882 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:37:45 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-d415aacb-2205-4de4-991f-1b7b07edc40d tempest-ProjectReaderTests-433089253 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756.info is being set with open permissions: ugo+rw Nov 03 20:37:45 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d415aacb-2205-4de4-991f-1b7b07edc40d tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:45 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-e4837fbb-a011-4a9b-9108-73864efdbdab tempest-ProjectMemberTests-196532882 None] Deleted volume successfully. Nov 03 20:37:45 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756.info Nov 03 20:37:45 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:45 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-e4837fbb-a011-4a9b-9108-73864efdbdab tempest-ProjectMemberTests-196532882 None] Lock "cinder-84c6129d-f999-4e87-b972-8b8ffc8f6c94-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:46 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d415aacb-2205-4de4-991f-1b7b07edc40d tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756.info" returned: 0 in 0.324s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d415aacb-2205-4de4-991f-1b7b07edc40d tempest-ProjectReaderTests-433089253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.616s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:46 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-d415aacb-2205-4de4-991f-1b7b07edc40d tempest-ProjectReaderTests-433089253 None] Create snapshot completed successfully Nov 03 20:37:46 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-076fe8f6-893d-4ff6-96bc-697bd2459c85 tempest-ProjectMemberTests-196532882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:37:46 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-076fe8f6-893d-4ff6-96bc-697bd2459c85 tempest-ProjectMemberTests-196532882 None] Flow 'volume_create_manager' (f148f5ad-6179-4fe4-979d-62659c1564c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:37:46 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-076fe8f6-893d-4ff6-96bc-697bd2459c85 tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1933c265-fdb3-405f-9ed3-35f623f429ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:46 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-076fe8f6-893d-4ff6-96bc-697bd2459c85 tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1933c265-fdb3-405f-9ed3-35f623f429ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1567885592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2edec92f-2349-4c01-8ffd-78fe41859982,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd20413f6d5649da828c1f0bf51455d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:37:46Z,use_quota=True,user_id='595eaffd7e764ae6b07e6aba8405d447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:46 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-076fe8f6-893d-4ff6-96bc-697bd2459c85 tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5235686b-bc63-46fb-960f-114efb9330b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:46 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-076fe8f6-893d-4ff6-96bc-697bd2459c85 tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5235686b-bc63-46fb-960f-114efb9330b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:46 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-076fe8f6-893d-4ff6-96bc-697bd2459c85 tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fd5030f-c775-4420-b475-44aa201ac706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:46 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-076fe8f6-893d-4ff6-96bc-697bd2459c85 tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fd5030f-c775-4420-b475-44aa201ac706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2edec92f-2349-4c01-8ffd-78fe41859982', 'volume_name': 'volume-2edec92f-2349-4c01-8ffd-78fe41859982', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:46 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-076fe8f6-893d-4ff6-96bc-697bd2459c85 tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2a2e613-ddaf-41bd-92ca-e81c824027f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:46 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-076fe8f6-893d-4ff6-96bc-697bd2459c85 tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2a2e613-ddaf-41bd-92ca-e81c824027f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:46 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-076fe8f6-893d-4ff6-96bc-697bd2459c85 tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e21f4ad-a9fa-4559-8f8b-c11b68232347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:46 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-076fe8f6-893d-4ff6-96bc-697bd2459c85 tempest-ProjectMemberTests-196532882 None] Volume 2edec92f-2349-4c01-8ffd-78fe41859982: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2edec92f-2349-4c01-8ffd-78fe41859982', 'volume_size': 1} Nov 03 20:37:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-076fe8f6-893d-4ff6-96bc-697bd2459c85 tempest-ProjectMemberTests-196532882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-076fe8f6-893d-4ff6-96bc-697bd2459c85 tempest-ProjectMemberTests-196532882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:46 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-076fe8f6-893d-4ff6-96bc-697bd2459c85 tempest-ProjectMemberTests-196532882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1567885592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2edec92f-2349-4c01-8ffd-78fe41859982,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd20413f6d5649da828c1f0bf51455d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:37:46Z,use_quota=True,user_id='595eaffd7e764ae6b07e6aba8405d447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:37:46 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-076fe8f6-893d-4ff6-96bc-697bd2459c85 tempest-ProjectMemberTests-196532882 None] Creating volume 2edec92f-2349-4c01-8ffd-78fe41859982 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:37:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-076fe8f6-893d-4ff6-96bc-697bd2459c85 tempest-ProjectMemberTests-196532882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-076fe8f6-893d-4ff6-96bc-697bd2459c85 tempest-ProjectMemberTests-196532882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:46 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-076fe8f6-893d-4ff6-96bc-697bd2459c85 tempest-ProjectMemberTests-196532882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:37:46 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-076fe8f6-893d-4ff6-96bc-697bd2459c85 tempest-ProjectMemberTests-196532882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:37:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-076fe8f6-893d-4ff6-96bc-697bd2459c85 tempest-ProjectMemberTests-196532882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:46 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-076fe8f6-893d-4ff6-96bc-697bd2459c85 tempest-ProjectMemberTests-196532882 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:37:46 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-076fe8f6-893d-4ff6-96bc-697bd2459c85 tempest-ProjectMemberTests-196532882 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:37:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-076fe8f6-893d-4ff6-96bc-697bd2459c85 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2edec92f-2349-4c01-8ffd-78fe41859982 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:46 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2edec92f-2349-4c01-8ffd-78fe41859982 1073741824 Nov 03 20:37:46 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:46 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-33cb783d-430e-4c0c-8e6d-412332ccb609 tempest-ProjectReaderTests-433089253 None] Acquiring lock "cinder-3fd25d9b-caf3-4f65-be71-882ce3928427-delete_snapshot" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:46 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-33cb783d-430e-4c0c-8e6d-412332ccb609 tempest-ProjectReaderTests-433089253 None] Lock "cinder-3fd25d9b-caf3-4f65-be71-882ce3928427-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:46 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-33cb783d-430e-4c0c-8e6d-412332ccb609 tempest-ProjectReaderTests-433089253 None] Acquiring lock "cinder-quobyte-0179f6d3-7a27-4ae2-be6b-b6b808ed3756" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:46 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-33cb783d-430e-4c0c-8e6d-412332ccb609 tempest-ProjectReaderTests-433089253 None] Lock "cinder-quobyte-0179f6d3-7a27-4ae2-be6b-b6b808ed3756" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:46 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-33cb783d-430e-4c0c-8e6d-412332ccb609 tempest-ProjectReaderTests-433089253 None] Acquiring lock "cinder-quobyte-3fd25d9b-caf3-4f65-be71-882ce3928427" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:46 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-33cb783d-430e-4c0c-8e6d-412332ccb609 tempest-ProjectReaderTests-433089253 None] Lock "cinder-quobyte-3fd25d9b-caf3-4f65-be71-882ce3928427" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:46 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-33cb783d-430e-4c0c-8e6d-412332ccb609 tempest-ProjectReaderTests-433089253 None] Deleting offline snapshot 3fd25d9b-caf3-4f65-be71-882ce3928427 of volume 0179f6d3-7a27-4ae2-be6b-b6b808ed3756 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:37:46 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-33cb783d-430e-4c0c-8e6d-412332ccb609 tempest-ProjectReaderTests-433089253 None] snapshot_file for this snap is: volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756.3fd25d9b-caf3-4f65-be71-882ce3928427 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:37:46 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67a0b51-7d8f-4a07-be14-cab273097415]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-33cb783d-430e-4c0c-8e6d-412332ccb609 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756.3fd25d9b-caf3-4f65-be71-882ce3928427 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:46 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:46 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-076fe8f6-893d-4ff6-96bc-697bd2459c85 tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2edec92f-2349-4c01-8ffd-78fe41859982 1073741824" returned: 0 in 0.608s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-076fe8f6-893d-4ff6-96bc-697bd2459c85 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2edec92f-2349-4c01-8ffd-78fe41859982 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:47 devstack sudo[107339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2edec92f-2349-4c01-8ffd-78fe41859982 Nov 03 20:37:47 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:47 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756.3fd25d9b-caf3-4f65-be71-882ce3928427 Nov 03 20:37:47 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:47 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-076fe8f6-893d-4ff6-96bc-697bd2459c85 tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2edec92f-2349-4c01-8ffd-78fe41859982" returned: 0 in 0.305s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:47 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-076fe8f6-893d-4ff6-96bc-697bd2459c85 tempest-ProjectMemberTests-196532882 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:37:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-076fe8f6-893d-4ff6-96bc-697bd2459c85 tempest-ProjectMemberTests-196532882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:47 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-076fe8f6-893d-4ff6-96bc-697bd2459c85 tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e21f4ad-a9fa-4559-8f8b-c11b68232347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2edec92f-2349-4c01-8ffd-78fe41859982', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:47 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-076fe8f6-893d-4ff6-96bc-697bd2459c85 tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e973ac9-ebcf-4ed1-84c9-0bcebd93f94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:47 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-076fe8f6-893d-4ff6-96bc-697bd2459c85 tempest-ProjectMemberTests-196532882 None] Volume volume-2edec92f-2349-4c01-8ffd-78fe41859982 (2edec92f-2349-4c01-8ffd-78fe41859982): created successfully Nov 03 20:37:47 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-076fe8f6-893d-4ff6-96bc-697bd2459c85 tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e973ac9-ebcf-4ed1-84c9-0bcebd93f94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:47 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-076fe8f6-893d-4ff6-96bc-697bd2459c85 tempest-ProjectMemberTests-196532882 None] Flow 'volume_create_manager' (f148f5ad-6179-4fe4-979d-62659c1564c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:37:47 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-076fe8f6-893d-4ff6-96bc-697bd2459c85 tempest-ProjectMemberTests-196532882 None] Created volume successfully. Nov 03 20:37:47 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-33cb783d-430e-4c0c-8e6d-412332ccb609 tempest-ProjectReaderTests-433089253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756.3fd25d9b-caf3-4f65-be71-882ce3928427" returned: 0 in 0.522s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:47 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-33cb783d-430e-4c0c-8e6d-412332ccb609 tempest-ProjectReaderTests-433089253 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:37:47 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c34f20-5ce0-4645-8834-a3e21229ef85]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-33cb783d-430e-4c0c-8e6d-412332ccb609 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:47 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756 Nov 03 20:37:47 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:47 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-33cb783d-430e-4c0c-8e6d-412332ccb609 tempest-ProjectReaderTests-433089253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756" returned: 0 in 0.375s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:47 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-33cb783d-430e-4c0c-8e6d-412332ccb609 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756.3fd25d9b-caf3-4f65-be71-882ce3928427 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:47 devstack sudo[107352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756.3fd25d9b-caf3-4f65-be71-882ce3928427 Nov 03 20:37:47 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:48 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-33cb783d-430e-4c0c-8e6d-412332ccb609 tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756.3fd25d9b-caf3-4f65-be71-882ce3928427" returned: 0 in 0.347s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-33cb783d-430e-4c0c-8e6d-412332ccb609 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756.3fd25d9b-caf3-4f65-be71-882ce3928427 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:48 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756.3fd25d9b-caf3-4f65-be71-882ce3928427 Nov 03 20:37:48 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:48 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-33cb783d-430e-4c0c-8e6d-412332ccb609 tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756.3fd25d9b-caf3-4f65-be71-882ce3928427" returned: 0 in 0.275s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:48 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-33cb783d-430e-4c0c-8e6d-412332ccb609 tempest-ProjectReaderTests-433089253 None] Lock "cinder-quobyte-3fd25d9b-caf3-4f65-be71-882ce3928427" released by "_delete_snapshot" :: held 1.675s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:48 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-33cb783d-430e-4c0c-8e6d-412332ccb609 tempest-ProjectReaderTests-433089253 None] Lock "cinder-quobyte-0179f6d3-7a27-4ae2-be6b-b6b808ed3756" released by "delete_snapshot" :: held 1.701s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-16e73d9f-8cee-4ca0-8542-ce4b8de2edba tempest-ProjectMemberTests-196532882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-16e73d9f-8cee-4ca0-8542-ce4b8de2edba tempest-ProjectMemberTests-196532882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:48 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-16e73d9f-8cee-4ca0-8542-ce4b8de2edba tempest-ProjectMemberTests-196532882 None] Creating offline snapshot 745d2043-c730-4b34-a25a-4ec615581bb3 of volume 2edec92f-2349-4c01-8ffd-78fe41859982 {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:37:48 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c57271-59f3-4616-a7b3-3d672767dbc7]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:48 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-16e73d9f-8cee-4ca0-8542-ce4b8de2edba tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2edec92f-2349-4c01-8ffd-78fe41859982 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:48 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-33cb783d-430e-4c0c-8e6d-412332ccb609 tempest-ProjectReaderTests-433089253 None] Created reservations ['0ad3187d-3aa4-4ff0-b2d6-654f4ad7f263', '7757c8c2-bffc-4600-9db2-4e3d9eb7070d', '4f16d4c4-6ae5-4e05-9bce-332777d3e039', 'f4570cbf-afbd-4d43-8b1f-d0f00f013356'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:37:48 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-33cb783d-430e-4c0c-8e6d-412332ccb609 tempest-ProjectReaderTests-433089253 None] Delete snapshot completed successfully. Nov 03 20:37:48 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-33cb783d-430e-4c0c-8e6d-412332ccb609 tempest-ProjectReaderTests-433089253 None] Lock "cinder-3fd25d9b-caf3-4f65-be71-882ce3928427-delete_snapshot" released by "delete_snapshot" :: held 1.906s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:48 devstack sudo[107361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2edec92f-2349-4c01-8ffd-78fe41859982 Nov 03 20:37:48 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:49 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-f0203a61-d46a-463d-ac20-b1a5b58a33d8 tempest-ProjectReaderTests-433089253 None] Acquiring lock "cinder-0179f6d3-7a27-4ae2-be6b-b6b808ed3756-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:49 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-f0203a61-d46a-463d-ac20-b1a5b58a33d8 tempest-ProjectReaderTests-433089253 None] Lock "cinder-0179f6d3-7a27-4ae2-be6b-b6b808ed3756-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:49 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-f0203a61-d46a-463d-ac20-b1a5b58a33d8 tempest-ProjectReaderTests-433089253 None] Acquiring lock "cinder-quobyte-0179f6d3-7a27-4ae2-be6b-b6b808ed3756" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:49 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-f0203a61-d46a-463d-ac20-b1a5b58a33d8 tempest-ProjectReaderTests-433089253 None] Lock "cinder-quobyte-0179f6d3-7a27-4ae2-be6b-b6b808ed3756" acquired by "delete_volume" :: waited 0.017s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:49 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-16e73d9f-8cee-4ca0-8542-ce4b8de2edba tempest-ProjectMemberTests-196532882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2edec92f-2349-4c01-8ffd-78fe41859982" returned: 0 in 0.457s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-16e73d9f-8cee-4ca0-8542-ce4b8de2edba tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2edec92f-2349-4c01-8ffd-78fe41859982,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2edec92f-2349-4c01-8ffd-78fe41859982.745d2043-c730-4b34-a25a-4ec615581bb3 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:49 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0f61c7-4c13-4f73-a9fc-1544e9376412]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f0203a61-d46a-463d-ac20-b1a5b58a33d8 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:49 devstack sudo[107366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2edec92f-2349-4c01-8ffd-78fe41859982,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2edec92f-2349-4c01-8ffd-78fe41859982.745d2043-c730-4b34-a25a-4ec615581bb3 1G Nov 03 20:37:49 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:49 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756 Nov 03 20:37:49 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:49 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f0203a61-d46a-463d-ac20-b1a5b58a33d8 tempest-ProjectReaderTests-433089253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756" returned: 0 in 0.412s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f0203a61-d46a-463d-ac20-b1a5b58a33d8 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:49 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-16e73d9f-8cee-4ca0-8542-ce4b8de2edba tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2edec92f-2349-4c01-8ffd-78fe41859982,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2edec92f-2349-4c01-8ffd-78fe41859982.745d2043-c730-4b34-a25a-4ec615581bb3 1G" returned: 0 in 0.454s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-16e73d9f-8cee-4ca0-8542-ce4b8de2edba tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2edec92f-2349-4c01-8ffd-78fe41859982 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2edec92f-2349-4c01-8ffd-78fe41859982.745d2043-c730-4b34-a25a-4ec615581bb3 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:49 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756 Nov 03 20:37:49 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:49 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2edec92f-2349-4c01-8ffd-78fe41859982 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2edec92f-2349-4c01-8ffd-78fe41859982.745d2043-c730-4b34-a25a-4ec615581bb3 Nov 03 20:37:49 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:49 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f0203a61-d46a-463d-ac20-b1a5b58a33d8 tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-0179f6d3-7a27-4ae2-be6b-b6b808ed3756" returned: 0 in 0.282s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:49 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-f0203a61-d46a-463d-ac20-b1a5b58a33d8 tempest-ProjectReaderTests-433089253 None] Lock "cinder-quobyte-0179f6d3-7a27-4ae2-be6b-b6b808ed3756" released by "delete_volume" :: held 0.766s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:49 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-f0203a61-d46a-463d-ac20-b1a5b58a33d8 tempest-ProjectReaderTests-433089253 None] Created reservations ['f6aff312-7f90-4db7-a42e-24acb5d6aa18', '6eb3aa6f-72a9-4aad-bff8-2e7362a25538', '20420dae-5d12-4559-b3fd-4acb1871b389', '8b16e584-95d5-422e-9995-3b6e7044f940'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:37:49 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-16e73d9f-8cee-4ca0-8542-ce4b8de2edba tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2edec92f-2349-4c01-8ffd-78fe41859982 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2edec92f-2349-4c01-8ffd-78fe41859982.745d2043-c730-4b34-a25a-4ec615581bb3" returned: 0 in 0.336s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:49 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-16e73d9f-8cee-4ca0-8542-ce4b8de2edba tempest-ProjectMemberTests-196532882 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2edec92f-2349-4c01-8ffd-78fe41859982.745d2043-c730-4b34-a25a-4ec615581bb3 is being set with open permissions: ugo+rw Nov 03 20:37:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-16e73d9f-8cee-4ca0-8542-ce4b8de2edba tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2edec92f-2349-4c01-8ffd-78fe41859982.745d2043-c730-4b34-a25a-4ec615581bb3 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:49 devstack sudo[107386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2edec92f-2349-4c01-8ffd-78fe41859982.745d2043-c730-4b34-a25a-4ec615581bb3 Nov 03 20:37:49 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f0203a61-d46a-463d-ac20-b1a5b58a33d8 tempest-ProjectReaderTests-433089253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f0203a61-d46a-463d-ac20-b1a5b58a33d8 tempest-ProjectReaderTests-433089253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:49 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-f0203a61-d46a-463d-ac20-b1a5b58a33d8 tempest-ProjectReaderTests-433089253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:37:49 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-f0203a61-d46a-463d-ac20-b1a5b58a33d8 tempest-ProjectReaderTests-433089253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:37:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f0203a61-d46a-463d-ac20-b1a5b58a33d8 tempest-ProjectReaderTests-433089253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:49 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f0203a61-d46a-463d-ac20-b1a5b58a33d8 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:50 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:37:50 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:50 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-16e73d9f-8cee-4ca0-8542-ce4b8de2edba tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2edec92f-2349-4c01-8ffd-78fe41859982.745d2043-c730-4b34-a25a-4ec615581bb3" returned: 0 in 0.307s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-16e73d9f-8cee-4ca0-8542-ce4b8de2edba tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2edec92f-2349-4c01-8ffd-78fe41859982.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:50 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2edec92f-2349-4c01-8ffd-78fe41859982.info Nov 03 20:37:50 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:50 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f0203a61-d46a-463d-ac20-b1a5b58a33d8 tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.319s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:50 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-f0203a61-d46a-463d-ac20-b1a5b58a33d8 tempest-ProjectReaderTests-433089253 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:37:50 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-f0203a61-d46a-463d-ac20-b1a5b58a33d8 tempest-ProjectReaderTests-433089253 None] Deleted volume successfully. Nov 03 20:37:50 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-f0203a61-d46a-463d-ac20-b1a5b58a33d8 tempest-ProjectReaderTests-433089253 None] Lock "cinder-0179f6d3-7a27-4ae2-be6b-b6b808ed3756-delete_volume" released by "delete_volume" :: held 1.340s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:50 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-16e73d9f-8cee-4ca0-8542-ce4b8de2edba tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2edec92f-2349-4c01-8ffd-78fe41859982.info" returned: 0 in 0.303s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:50 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-16e73d9f-8cee-4ca0-8542-ce4b8de2edba tempest-ProjectMemberTests-196532882 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2edec92f-2349-4c01-8ffd-78fe41859982.info is being set with open permissions: ugo+rw Nov 03 20:37:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-16e73d9f-8cee-4ca0-8542-ce4b8de2edba tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2edec92f-2349-4c01-8ffd-78fe41859982.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:50 devstack sudo[107395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2edec92f-2349-4c01-8ffd-78fe41859982.info Nov 03 20:37:50 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:50 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-361cb1e9-a140-4e85-9d1f-e32bf3dd4344 tempest-ProjectReaderTests-433089253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:37:50 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-361cb1e9-a140-4e85-9d1f-e32bf3dd4344 tempest-ProjectReaderTests-433089253 None] Flow 'volume_create_manager' (0701017d-8df0-402b-abbb-b1803cd72542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:37:50 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-361cb1e9-a140-4e85-9d1f-e32bf3dd4344 tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9fa7928-57a8-41d8-b6c2-d99af1263462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:50 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-361cb1e9-a140-4e85-9d1f-e32bf3dd4344 tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9fa7928-57a8-41d8-b6c2-d99af1263462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:37:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1795997056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de24f2a0-c84a-4268-ab71-ddb6486fba3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c44365c19f64452a4ca43ddbc83b98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:37:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:37:51Z,use_quota=True,user_id='b4a43cba6ec642509e771e8a42d91883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:50 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-361cb1e9-a140-4e85-9d1f-e32bf3dd4344 tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d6aac04-73b7-4937-ba2f-df51463d8479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:50 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:50 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-361cb1e9-a140-4e85-9d1f-e32bf3dd4344 tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d6aac04-73b7-4937-ba2f-df51463d8479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:50 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-361cb1e9-a140-4e85-9d1f-e32bf3dd4344 tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1cd484b-0d0e-469b-9194-ef47115f9c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:50 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-361cb1e9-a140-4e85-9d1f-e32bf3dd4344 tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1cd484b-0d0e-469b-9194-ef47115f9c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de24f2a0-c84a-4268-ab71-ddb6486fba3d', 'volume_name': 'volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:50 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-361cb1e9-a140-4e85-9d1f-e32bf3dd4344 tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eea2cc28-e4e7-4935-8d30-a1ec2119e926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:50 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-361cb1e9-a140-4e85-9d1f-e32bf3dd4344 tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eea2cc28-e4e7-4935-8d30-a1ec2119e926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:50 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-361cb1e9-a140-4e85-9d1f-e32bf3dd4344 tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce097f9f-9178-4fbc-9937-fd6014a90fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:50 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-361cb1e9-a140-4e85-9d1f-e32bf3dd4344 tempest-ProjectReaderTests-433089253 None] Volume de24f2a0-c84a-4268-ab71-ddb6486fba3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d', 'volume_size': 1} Nov 03 20:37:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-361cb1e9-a140-4e85-9d1f-e32bf3dd4344 tempest-ProjectReaderTests-433089253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-16e73d9f-8cee-4ca0-8542-ce4b8de2edba tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2edec92f-2349-4c01-8ffd-78fe41859982.info" returned: 0 in 0.323s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-16e73d9f-8cee-4ca0-8542-ce4b8de2edba tempest-ProjectMemberTests-196532882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.286s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-361cb1e9-a140-4e85-9d1f-e32bf3dd4344 tempest-ProjectReaderTests-433089253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.022s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:50 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-361cb1e9-a140-4e85-9d1f-e32bf3dd4344 tempest-ProjectReaderTests-433089253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:37:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1795997056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de24f2a0-c84a-4268-ab71-ddb6486fba3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c44365c19f64452a4ca43ddbc83b98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:37:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:37:51Z,use_quota=True,user_id='b4a43cba6ec642509e771e8a42d91883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:37:50 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-361cb1e9-a140-4e85-9d1f-e32bf3dd4344 tempest-ProjectReaderTests-433089253 None] Creating volume de24f2a0-c84a-4268-ab71-ddb6486fba3d {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:37:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-361cb1e9-a140-4e85-9d1f-e32bf3dd4344 tempest-ProjectReaderTests-433089253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-361cb1e9-a140-4e85-9d1f-e32bf3dd4344 tempest-ProjectReaderTests-433089253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:50 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-361cb1e9-a140-4e85-9d1f-e32bf3dd4344 tempest-ProjectReaderTests-433089253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:37:50 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-361cb1e9-a140-4e85-9d1f-e32bf3dd4344 tempest-ProjectReaderTests-433089253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:37:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-361cb1e9-a140-4e85-9d1f-e32bf3dd4344 tempest-ProjectReaderTests-433089253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:50 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-361cb1e9-a140-4e85-9d1f-e32bf3dd4344 tempest-ProjectReaderTests-433089253 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:37:50 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-361cb1e9-a140-4e85-9d1f-e32bf3dd4344 tempest-ProjectReaderTests-433089253 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:37:50 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-361cb1e9-a140-4e85-9d1f-e32bf3dd4344 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:50 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d 1073741824 Nov 03 20:37:50 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:50 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-16e73d9f-8cee-4ca0-8542-ce4b8de2edba tempest-ProjectMemberTests-196532882 None] Create snapshot completed successfully Nov 03 20:37:51 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-361cb1e9-a140-4e85-9d1f-e32bf3dd4344 tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d 1073741824" returned: 0 in 0.467s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-361cb1e9-a140-4e85-9d1f-e32bf3dd4344 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:51 devstack sudo[107404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d Nov 03 20:37:51 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:51 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-361cb1e9-a140-4e85-9d1f-e32bf3dd4344 tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d" returned: 0 in 0.258s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:51 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-361cb1e9-a140-4e85-9d1f-e32bf3dd4344 tempest-ProjectReaderTests-433089253 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:37:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-361cb1e9-a140-4e85-9d1f-e32bf3dd4344 tempest-ProjectReaderTests-433089253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:51 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-361cb1e9-a140-4e85-9d1f-e32bf3dd4344 tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce097f9f-9178-4fbc-9937-fd6014a90fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:51 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-361cb1e9-a140-4e85-9d1f-e32bf3dd4344 tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (293941fc-6a20-40b6-8ebc-517a99601c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:51 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-361cb1e9-a140-4e85-9d1f-e32bf3dd4344 tempest-ProjectReaderTests-433089253 None] Volume volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d (de24f2a0-c84a-4268-ab71-ddb6486fba3d): created successfully Nov 03 20:37:51 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-361cb1e9-a140-4e85-9d1f-e32bf3dd4344 tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (293941fc-6a20-40b6-8ebc-517a99601c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:51 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-361cb1e9-a140-4e85-9d1f-e32bf3dd4344 tempest-ProjectReaderTests-433089253 None] Flow 'volume_create_manager' (0701017d-8df0-402b-abbb-b1803cd72542) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:37:51 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-361cb1e9-a140-4e85-9d1f-e32bf3dd4344 tempest-ProjectReaderTests-433089253 None] Created volume successfully. Nov 03 20:37:51 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8caedf87-2fd4-4233-b7f1-fe6b7b03450e tempest-ProjectMemberTests-196532882 None] Acquiring lock "cinder-745d2043-c730-4b34-a25a-4ec615581bb3-delete_snapshot" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:51 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8caedf87-2fd4-4233-b7f1-fe6b7b03450e tempest-ProjectMemberTests-196532882 None] Lock "cinder-745d2043-c730-4b34-a25a-4ec615581bb3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:51 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8caedf87-2fd4-4233-b7f1-fe6b7b03450e tempest-ProjectMemberTests-196532882 None] Acquiring lock "cinder-quobyte-2edec92f-2349-4c01-8ffd-78fe41859982" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:51 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8caedf87-2fd4-4233-b7f1-fe6b7b03450e tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-2edec92f-2349-4c01-8ffd-78fe41859982" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:51 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8caedf87-2fd4-4233-b7f1-fe6b7b03450e tempest-ProjectMemberTests-196532882 None] Acquiring lock "cinder-quobyte-745d2043-c730-4b34-a25a-4ec615581bb3" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:51 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8caedf87-2fd4-4233-b7f1-fe6b7b03450e tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-745d2043-c730-4b34-a25a-4ec615581bb3" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:51 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-8caedf87-2fd4-4233-b7f1-fe6b7b03450e tempest-ProjectMemberTests-196532882 None] Deleting offline snapshot 745d2043-c730-4b34-a25a-4ec615581bb3 of volume 2edec92f-2349-4c01-8ffd-78fe41859982 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:37:51 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-8caedf87-2fd4-4233-b7f1-fe6b7b03450e tempest-ProjectMemberTests-196532882 None] snapshot_file for this snap is: volume-2edec92f-2349-4c01-8ffd-78fe41859982.745d2043-c730-4b34-a25a-4ec615581bb3 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:37:51 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a81c79-b176-4696-952b-4355b8474894]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:51 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8caedf87-2fd4-4233-b7f1-fe6b7b03450e tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2edec92f-2349-4c01-8ffd-78fe41859982.745d2043-c730-4b34-a25a-4ec615581bb3 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:51 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2edec92f-2349-4c01-8ffd-78fe41859982.745d2043-c730-4b34-a25a-4ec615581bb3 Nov 03 20:37:51 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:52 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8caedf87-2fd4-4233-b7f1-fe6b7b03450e tempest-ProjectMemberTests-196532882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2edec92f-2349-4c01-8ffd-78fe41859982.745d2043-c730-4b34-a25a-4ec615581bb3" returned: 0 in 0.363s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:52 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-8caedf87-2fd4-4233-b7f1-fe6b7b03450e tempest-ProjectMemberTests-196532882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2edec92f-2349-4c01-8ffd-78fe41859982(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:37:52 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[02335aa2-ce37-4e5e-a11d-af37c4581157]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8caedf87-2fd4-4233-b7f1-fe6b7b03450e tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2edec92f-2349-4c01-8ffd-78fe41859982 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:52 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2edec92f-2349-4c01-8ffd-78fe41859982 Nov 03 20:37:52 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:52 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8caedf87-2fd4-4233-b7f1-fe6b7b03450e tempest-ProjectMemberTests-196532882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2edec92f-2349-4c01-8ffd-78fe41859982" returned: 0 in 0.378s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8caedf87-2fd4-4233-b7f1-fe6b7b03450e tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2edec92f-2349-4c01-8ffd-78fe41859982.745d2043-c730-4b34-a25a-4ec615581bb3 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:52 devstack sudo[107419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2edec92f-2349-4c01-8ffd-78fe41859982.745d2043-c730-4b34-a25a-4ec615581bb3 Nov 03 20:37:52 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-fc7c8dbb-a4b8-48e7-b2d5-2d31bc747ba3 tempest-ProjectReaderTests-433089253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:52 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-fc7c8dbb-a4b8-48e7-b2d5-2d31bc747ba3 tempest-ProjectReaderTests-433089253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:52 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-fc7c8dbb-a4b8-48e7-b2d5-2d31bc747ba3 tempest-ProjectReaderTests-433089253 None] Creating offline snapshot 0b45e3ec-d1d4-4487-9904-271fdc80f016 of volume de24f2a0-c84a-4268-ab71-ddb6486fba3d {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:37:53 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4564367-8580-44e9-a123-6721c00f563b]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fc7c8dbb-a4b8-48e7-b2d5-2d31bc747ba3 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:53 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8caedf87-2fd4-4233-b7f1-fe6b7b03450e tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2edec92f-2349-4c01-8ffd-78fe41859982.745d2043-c730-4b34-a25a-4ec615581bb3" returned: 0 in 0.380s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8caedf87-2fd4-4233-b7f1-fe6b7b03450e tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2edec92f-2349-4c01-8ffd-78fe41859982.745d2043-c730-4b34-a25a-4ec615581bb3 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:53 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2edec92f-2349-4c01-8ffd-78fe41859982.745d2043-c730-4b34-a25a-4ec615581bb3 Nov 03 20:37:53 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:53 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d Nov 03 20:37:53 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:53 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8caedf87-2fd4-4233-b7f1-fe6b7b03450e tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2edec92f-2349-4c01-8ffd-78fe41859982.745d2043-c730-4b34-a25a-4ec615581bb3" returned: 0 in 0.255s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:53 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8caedf87-2fd4-4233-b7f1-fe6b7b03450e tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-745d2043-c730-4b34-a25a-4ec615581bb3" released by "_delete_snapshot" :: held 1.491s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:53 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8caedf87-2fd4-4233-b7f1-fe6b7b03450e tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-2edec92f-2349-4c01-8ffd-78fe41859982" released by "delete_snapshot" :: held 1.518s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:53 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fc7c8dbb-a4b8-48e7-b2d5-2d31bc747ba3 tempest-ProjectReaderTests-433089253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d" returned: 0 in 0.369s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fc7c8dbb-a4b8-48e7-b2d5-2d31bc747ba3 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d.0b45e3ec-d1d4-4487-9904-271fdc80f016 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:53 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d.0b45e3ec-d1d4-4487-9904-271fdc80f016 1G Nov 03 20:37:53 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:53 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-8caedf87-2fd4-4233-b7f1-fe6b7b03450e tempest-ProjectMemberTests-196532882 None] Created reservations ['679619ee-e720-4437-a120-311008c6957d', 'd7ccc1cc-66e1-497b-9202-aa0799f3314d', '39c02390-bfb1-4dc1-989d-b592e7ae8df0', '357d4512-aa86-473e-9314-acbaaf8b4c7a'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:37:53 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-8caedf87-2fd4-4233-b7f1-fe6b7b03450e tempest-ProjectMemberTests-196532882 None] Delete snapshot completed successfully. Nov 03 20:37:53 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8caedf87-2fd4-4233-b7f1-fe6b7b03450e tempest-ProjectMemberTests-196532882 None] Lock "cinder-745d2043-c730-4b34-a25a-4ec615581bb3-delete_snapshot" released by "delete_snapshot" :: held 1.668s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:53 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fc7c8dbb-a4b8-48e7-b2d5-2d31bc747ba3 tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d.0b45e3ec-d1d4-4487-9904-271fdc80f016 1G" returned: 0 in 0.432s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:53 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fc7c8dbb-a4b8-48e7-b2d5-2d31bc747ba3 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d.0b45e3ec-d1d4-4487-9904-271fdc80f016 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:53 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d.0b45e3ec-d1d4-4487-9904-271fdc80f016 Nov 03 20:37:53 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:53 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-54538e4a-deae-4417-a8ad-25007fe79c8b tempest-ProjectMemberTests-196532882 None] Acquiring lock "cinder-2edec92f-2349-4c01-8ffd-78fe41859982-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:54 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-54538e4a-deae-4417-a8ad-25007fe79c8b tempest-ProjectMemberTests-196532882 None] Lock "cinder-2edec92f-2349-4c01-8ffd-78fe41859982-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:54 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-54538e4a-deae-4417-a8ad-25007fe79c8b tempest-ProjectMemberTests-196532882 None] Acquiring lock "cinder-quobyte-2edec92f-2349-4c01-8ffd-78fe41859982" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:54 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-54538e4a-deae-4417-a8ad-25007fe79c8b tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-2edec92f-2349-4c01-8ffd-78fe41859982" acquired by "delete_volume" :: waited 0.016s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:54 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7b4efe-0731-4cb9-acc3-f4c11adcdddc]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-54538e4a-deae-4417-a8ad-25007fe79c8b tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2edec92f-2349-4c01-8ffd-78fe41859982 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:54 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fc7c8dbb-a4b8-48e7-b2d5-2d31bc747ba3 tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d.0b45e3ec-d1d4-4487-9904-271fdc80f016" returned: 0 in 0.343s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:54 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-fc7c8dbb-a4b8-48e7-b2d5-2d31bc747ba3 tempest-ProjectReaderTests-433089253 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d.0b45e3ec-d1d4-4487-9904-271fdc80f016 is being set with open permissions: ugo+rw Nov 03 20:37:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fc7c8dbb-a4b8-48e7-b2d5-2d31bc747ba3 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d.0b45e3ec-d1d4-4487-9904-271fdc80f016 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:54 devstack sudo[107444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d.0b45e3ec-d1d4-4487-9904-271fdc80f016 Nov 03 20:37:54 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:54 devstack sudo[107443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2edec92f-2349-4c01-8ffd-78fe41859982 Nov 03 20:37:54 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:54 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fc7c8dbb-a4b8-48e7-b2d5-2d31bc747ba3 tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d.0b45e3ec-d1d4-4487-9904-271fdc80f016" returned: 0 in 0.273s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fc7c8dbb-a4b8-48e7-b2d5-2d31bc747ba3 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:54 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d.info Nov 03 20:37:54 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:54 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-54538e4a-deae-4417-a8ad-25007fe79c8b tempest-ProjectMemberTests-196532882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2edec92f-2349-4c01-8ffd-78fe41859982" returned: 0 in 0.395s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-54538e4a-deae-4417-a8ad-25007fe79c8b tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2edec92f-2349-4c01-8ffd-78fe41859982 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:54 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2edec92f-2349-4c01-8ffd-78fe41859982 Nov 03 20:37:54 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:54 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fc7c8dbb-a4b8-48e7-b2d5-2d31bc747ba3 tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d.info" returned: 0 in 0.286s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:54 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-fc7c8dbb-a4b8-48e7-b2d5-2d31bc747ba3 tempest-ProjectReaderTests-433089253 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d.info is being set with open permissions: ugo+rw Nov 03 20:37:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fc7c8dbb-a4b8-48e7-b2d5-2d31bc747ba3 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:54 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d.info Nov 03 20:37:54 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:54 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-54538e4a-deae-4417-a8ad-25007fe79c8b tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2edec92f-2349-4c01-8ffd-78fe41859982" returned: 0 in 0.291s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:54 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-54538e4a-deae-4417-a8ad-25007fe79c8b tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-2edec92f-2349-4c01-8ffd-78fe41859982" released by "delete_volume" :: held 0.764s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:54 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-54538e4a-deae-4417-a8ad-25007fe79c8b tempest-ProjectMemberTests-196532882 None] Created reservations ['1baec803-e417-4674-aca9-7199029bf1d8', '7eb5e437-0972-4d8f-bb35-e685acf3a09f', '7048daa8-3e33-4690-b73f-e1bcd9c80ab0', 'ef9a8294-0e59-46b6-bfc0-c849f2ac552c'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:37:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-54538e4a-deae-4417-a8ad-25007fe79c8b tempest-ProjectMemberTests-196532882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-54538e4a-deae-4417-a8ad-25007fe79c8b tempest-ProjectMemberTests-196532882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:54 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-54538e4a-deae-4417-a8ad-25007fe79c8b tempest-ProjectMemberTests-196532882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:37:54 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-54538e4a-deae-4417-a8ad-25007fe79c8b tempest-ProjectMemberTests-196532882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:37:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-54538e4a-deae-4417-a8ad-25007fe79c8b tempest-ProjectMemberTests-196532882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-54538e4a-deae-4417-a8ad-25007fe79c8b tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:54 devstack sudo[107459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:37:54 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:54 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:54 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fc7c8dbb-a4b8-48e7-b2d5-2d31bc747ba3 tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d.info" returned: 0 in 0.254s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-fc7c8dbb-a4b8-48e7-b2d5-2d31bc747ba3 tempest-ProjectReaderTests-433089253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.064s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:55 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-fc7c8dbb-a4b8-48e7-b2d5-2d31bc747ba3 tempest-ProjectReaderTests-433089253 None] Create snapshot completed successfully Nov 03 20:37:55 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-54538e4a-deae-4417-a8ad-25007fe79c8b tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.264s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:55 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-54538e4a-deae-4417-a8ad-25007fe79c8b tempest-ProjectMemberTests-196532882 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:37:55 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-54538e4a-deae-4417-a8ad-25007fe79c8b tempest-ProjectMemberTests-196532882 None] Deleted volume successfully. Nov 03 20:37:55 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-54538e4a-deae-4417-a8ad-25007fe79c8b tempest-ProjectMemberTests-196532882 None] Lock "cinder-2edec92f-2349-4c01-8ffd-78fe41859982-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:55 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8924d78-84dd-473c-ae7c-12fc047fc6db tempest-ProjectMemberTests-196532882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:37:55 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a8924d78-84dd-473c-ae7c-12fc047fc6db tempest-ProjectMemberTests-196532882 None] Flow 'volume_create_manager' (101da687-a454-4b25-996d-fba12fb198bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:37:55 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a8924d78-84dd-473c-ae7c-12fc047fc6db tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d88c51c6-cbb0-41d1-95a3-6b1aae6de229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:55 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a8924d78-84dd-473c-ae7c-12fc047fc6db tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d88c51c6-cbb0-41d1-95a3-6b1aae6de229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1552149206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2b175b5-7d90-4ddc-9ede-1f5a9129fa53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd20413f6d5649da828c1f0bf51455d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:37:56Z,use_quota=True,user_id='595eaffd7e764ae6b07e6aba8405d447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:55 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a8924d78-84dd-473c-ae7c-12fc047fc6db tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e049491-7d82-44ec-bf54-f13b99e0b32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:55 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a8924d78-84dd-473c-ae7c-12fc047fc6db tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e049491-7d82-44ec-bf54-f13b99e0b32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:55 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a8924d78-84dd-473c-ae7c-12fc047fc6db tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0b23d21-aa10-479b-a9a6-49e26ef23359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:55 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a8924d78-84dd-473c-ae7c-12fc047fc6db tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0b23d21-aa10-479b-a9a6-49e26ef23359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2b175b5-7d90-4ddc-9ede-1f5a9129fa53', 'volume_name': 'volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:55 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a8924d78-84dd-473c-ae7c-12fc047fc6db tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (179660d5-1290-4ad5-9d16-6b6fcbd2c097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:55 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a8924d78-84dd-473c-ae7c-12fc047fc6db tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (179660d5-1290-4ad5-9d16-6b6fcbd2c097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:55 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a8924d78-84dd-473c-ae7c-12fc047fc6db tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fd73366-d877-463a-9a2e-50d49e039160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:55 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-a8924d78-84dd-473c-ae7c-12fc047fc6db tempest-ProjectMemberTests-196532882 None] Volume f2b175b5-7d90-4ddc-9ede-1f5a9129fa53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53', 'volume_size': 1} Nov 03 20:37:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a8924d78-84dd-473c-ae7c-12fc047fc6db tempest-ProjectMemberTests-196532882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a8924d78-84dd-473c-ae7c-12fc047fc6db tempest-ProjectMemberTests-196532882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:55 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a8924d78-84dd-473c-ae7c-12fc047fc6db tempest-ProjectMemberTests-196532882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1552149206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2b175b5-7d90-4ddc-9ede-1f5a9129fa53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd20413f6d5649da828c1f0bf51455d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:37:56Z,use_quota=True,user_id='595eaffd7e764ae6b07e6aba8405d447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:37:55 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-a8924d78-84dd-473c-ae7c-12fc047fc6db tempest-ProjectMemberTests-196532882 None] Creating volume f2b175b5-7d90-4ddc-9ede-1f5a9129fa53 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:37:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a8924d78-84dd-473c-ae7c-12fc047fc6db tempest-ProjectMemberTests-196532882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a8924d78-84dd-473c-ae7c-12fc047fc6db tempest-ProjectMemberTests-196532882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:55 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a8924d78-84dd-473c-ae7c-12fc047fc6db tempest-ProjectMemberTests-196532882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:37:55 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a8924d78-84dd-473c-ae7c-12fc047fc6db tempest-ProjectMemberTests-196532882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:37:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a8924d78-84dd-473c-ae7c-12fc047fc6db tempest-ProjectMemberTests-196532882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:55 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a8924d78-84dd-473c-ae7c-12fc047fc6db tempest-ProjectMemberTests-196532882 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:37:55 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-a8924d78-84dd-473c-ae7c-12fc047fc6db tempest-ProjectMemberTests-196532882 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:37:55 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a8924d78-84dd-473c-ae7c-12fc047fc6db tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:55 devstack sudo[107463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53 1073741824 Nov 03 20:37:55 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:56 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-226f9375-ed57-404f-be6f-8bba8fb23395 tempest-ProjectReaderTests-433089253 None] Acquiring lock "cinder-0b45e3ec-d1d4-4487-9904-271fdc80f016-delete_snapshot" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:56 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a8924d78-84dd-473c-ae7c-12fc047fc6db tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53 1073741824" returned: 0 in 0.516s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:56 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-226f9375-ed57-404f-be6f-8bba8fb23395 tempest-ProjectReaderTests-433089253 None] Lock "cinder-0b45e3ec-d1d4-4487-9904-271fdc80f016-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:56 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-226f9375-ed57-404f-be6f-8bba8fb23395 tempest-ProjectReaderTests-433089253 None] Acquiring lock "cinder-quobyte-de24f2a0-c84a-4268-ab71-ddb6486fba3d" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:56 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-226f9375-ed57-404f-be6f-8bba8fb23395 tempest-ProjectReaderTests-433089253 None] Lock "cinder-quobyte-de24f2a0-c84a-4268-ab71-ddb6486fba3d" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:56 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-226f9375-ed57-404f-be6f-8bba8fb23395 tempest-ProjectReaderTests-433089253 None] Acquiring lock "cinder-quobyte-0b45e3ec-d1d4-4487-9904-271fdc80f016" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a8924d78-84dd-473c-ae7c-12fc047fc6db tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:56 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-226f9375-ed57-404f-be6f-8bba8fb23395 tempest-ProjectReaderTests-433089253 None] Lock "cinder-quobyte-0b45e3ec-d1d4-4487-9904-271fdc80f016" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:56 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-226f9375-ed57-404f-be6f-8bba8fb23395 tempest-ProjectReaderTests-433089253 None] Deleting offline snapshot 0b45e3ec-d1d4-4487-9904-271fdc80f016 of volume de24f2a0-c84a-4268-ab71-ddb6486fba3d {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:37:56 devstack sudo[107469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53 Nov 03 20:37:56 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:56 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-226f9375-ed57-404f-be6f-8bba8fb23395 tempest-ProjectReaderTests-433089253 None] snapshot_file for this snap is: volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d.0b45e3ec-d1d4-4487-9904-271fdc80f016 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:37:56 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[d282eb18-e6cd-4850-938a-69394e854c15]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-226f9375-ed57-404f-be6f-8bba8fb23395 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d.0b45e3ec-d1d4-4487-9904-271fdc80f016 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:56 devstack sudo[107471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d.0b45e3ec-d1d4-4487-9904-271fdc80f016 Nov 03 20:37:56 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:56 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a8924d78-84dd-473c-ae7c-12fc047fc6db tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53" returned: 0 in 0.308s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:56 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a8924d78-84dd-473c-ae7c-12fc047fc6db tempest-ProjectMemberTests-196532882 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:37:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a8924d78-84dd-473c-ae7c-12fc047fc6db tempest-ProjectMemberTests-196532882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a8924d78-84dd-473c-ae7c-12fc047fc6db tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fd73366-d877-463a-9a2e-50d49e039160) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a8924d78-84dd-473c-ae7c-12fc047fc6db tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6439c4df-8b30-48f6-9964-f0ce8d4bc949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:37:56 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-a8924d78-84dd-473c-ae7c-12fc047fc6db tempest-ProjectMemberTests-196532882 None] Volume volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53 (f2b175b5-7d90-4ddc-9ede-1f5a9129fa53): created successfully Nov 03 20:37:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a8924d78-84dd-473c-ae7c-12fc047fc6db tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6439c4df-8b30-48f6-9964-f0ce8d4bc949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:37:56 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-a8924d78-84dd-473c-ae7c-12fc047fc6db tempest-ProjectMemberTests-196532882 None] Flow 'volume_create_manager' (101da687-a454-4b25-996d-fba12fb198bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:37:56 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-a8924d78-84dd-473c-ae7c-12fc047fc6db tempest-ProjectMemberTests-196532882 None] Created volume successfully. Nov 03 20:37:56 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-226f9375-ed57-404f-be6f-8bba8fb23395 tempest-ProjectReaderTests-433089253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d.0b45e3ec-d1d4-4487-9904-271fdc80f016" returned: 0 in 0.436s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:56 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-226f9375-ed57-404f-be6f-8bba8fb23395 tempest-ProjectReaderTests-433089253 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:37:56 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c74519a-259d-476d-aadd-16bed9e5e268]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:56 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-226f9375-ed57-404f-be6f-8bba8fb23395 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:56 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d Nov 03 20:37:56 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:57 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-226f9375-ed57-404f-be6f-8bba8fb23395 tempest-ProjectReaderTests-433089253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d" returned: 0 in 0.351s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-226f9375-ed57-404f-be6f-8bba8fb23395 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d.0b45e3ec-d1d4-4487-9904-271fdc80f016 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:57 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d.0b45e3ec-d1d4-4487-9904-271fdc80f016 Nov 03 20:37:57 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:57 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-226f9375-ed57-404f-be6f-8bba8fb23395 tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d.0b45e3ec-d1d4-4487-9904-271fdc80f016" returned: 0 in 0.322s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-226f9375-ed57-404f-be6f-8bba8fb23395 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d.0b45e3ec-d1d4-4487-9904-271fdc80f016 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:57 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d.0b45e3ec-d1d4-4487-9904-271fdc80f016 Nov 03 20:37:57 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:57 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-226f9375-ed57-404f-be6f-8bba8fb23395 tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d.0b45e3ec-d1d4-4487-9904-271fdc80f016" returned: 0 in 0.265s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:57 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-226f9375-ed57-404f-be6f-8bba8fb23395 tempest-ProjectReaderTests-433089253 None] Lock "cinder-quobyte-0b45e3ec-d1d4-4487-9904-271fdc80f016" released by "_delete_snapshot" :: held 1.502s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:57 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-226f9375-ed57-404f-be6f-8bba8fb23395 tempest-ProjectReaderTests-433089253 None] Lock "cinder-quobyte-de24f2a0-c84a-4268-ab71-ddb6486fba3d" released by "delete_snapshot" :: held 1.545s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:57 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-226f9375-ed57-404f-be6f-8bba8fb23395 tempest-ProjectReaderTests-433089253 None] Created reservations ['3e026cbe-b0b3-48f5-8841-45b2c96f77b8', '0bfac5fd-c030-446b-a2de-b273c3591a4a', '35f4144b-803c-459a-b43b-733babaa3a87', 'a8686185-2b4c-473b-a5fc-d5d1428c1797'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:37:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7988b4cf-ce41-4f23-afec-dfbab98bbdbd tempest-ProjectMemberTests-196532882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7988b4cf-ce41-4f23-afec-dfbab98bbdbd tempest-ProjectMemberTests-196532882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:57 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-7988b4cf-ce41-4f23-afec-dfbab98bbdbd tempest-ProjectMemberTests-196532882 None] Creating offline snapshot 2a050121-5a8c-4885-ad4b-a9165d97f115 of volume f2b175b5-7d90-4ddc-9ede-1f5a9129fa53 {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:37:57 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[498b4788-3f74-456a-b799-83e23096d84d]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:57 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7988b4cf-ce41-4f23-afec-dfbab98bbdbd tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:57 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-226f9375-ed57-404f-be6f-8bba8fb23395 tempest-ProjectReaderTests-433089253 None] Delete snapshot completed successfully. Nov 03 20:37:57 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-226f9375-ed57-404f-be6f-8bba8fb23395 tempest-ProjectReaderTests-433089253 None] Lock "cinder-0b45e3ec-d1d4-4487-9904-271fdc80f016-delete_snapshot" released by "delete_snapshot" :: held 1.776s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:58 devstack sudo[107490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53 Nov 03 20:37:58 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:58 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7988b4cf-ce41-4f23-afec-dfbab98bbdbd tempest-ProjectMemberTests-196532882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53" returned: 0 in 0.402s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7988b4cf-ce41-4f23-afec-dfbab98bbdbd tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53.2a050121-5a8c-4885-ad4b-a9165d97f115 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:58 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9492ba59-5b3c-49db-8276-80c0503ce347 tempest-ProjectReaderTests-433089253 None] Acquiring lock "cinder-de24f2a0-c84a-4268-ab71-ddb6486fba3d-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:58 devstack sudo[107495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53.2a050121-5a8c-4885-ad4b-a9165d97f115 1G Nov 03 20:37:58 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:58 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9492ba59-5b3c-49db-8276-80c0503ce347 tempest-ProjectReaderTests-433089253 None] Lock "cinder-de24f2a0-c84a-4268-ab71-ddb6486fba3d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:58 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9492ba59-5b3c-49db-8276-80c0503ce347 tempest-ProjectReaderTests-433089253 None] Acquiring lock "cinder-quobyte-de24f2a0-c84a-4268-ab71-ddb6486fba3d" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:37:58 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9492ba59-5b3c-49db-8276-80c0503ce347 tempest-ProjectReaderTests-433089253 None] Lock "cinder-quobyte-de24f2a0-c84a-4268-ab71-ddb6486fba3d" acquired by "delete_volume" :: waited 0.023s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:37:58 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5c6815-8f6b-4218-bccb-0c5b7cb7fd62]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:37:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9492ba59-5b3c-49db-8276-80c0503ce347 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:58 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d Nov 03 20:37:58 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:58 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7988b4cf-ce41-4f23-afec-dfbab98bbdbd tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53.2a050121-5a8c-4885-ad4b-a9165d97f115 1G" returned: 0 in 0.494s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7988b4cf-ce41-4f23-afec-dfbab98bbdbd tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53.2a050121-5a8c-4885-ad4b-a9165d97f115 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:58 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53.2a050121-5a8c-4885-ad4b-a9165d97f115 Nov 03 20:37:58 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:58 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9492ba59-5b3c-49db-8276-80c0503ce347 tempest-ProjectReaderTests-433089253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d" returned: 0 in 0.415s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:58 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9492ba59-5b3c-49db-8276-80c0503ce347 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:58 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d Nov 03 20:37:58 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:59 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7988b4cf-ce41-4f23-afec-dfbab98bbdbd tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53.2a050121-5a8c-4885-ad4b-a9165d97f115" returned: 0 in 0.340s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:59 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-7988b4cf-ce41-4f23-afec-dfbab98bbdbd tempest-ProjectMemberTests-196532882 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53.2a050121-5a8c-4885-ad4b-a9165d97f115 is being set with open permissions: ugo+rw Nov 03 20:37:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7988b4cf-ce41-4f23-afec-dfbab98bbdbd tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53.2a050121-5a8c-4885-ad4b-a9165d97f115 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:59 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:59 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53.2a050121-5a8c-4885-ad4b-a9165d97f115 Nov 03 20:37:59 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9492ba59-5b3c-49db-8276-80c0503ce347 tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-de24f2a0-c84a-4268-ab71-ddb6486fba3d" returned: 0 in 0.292s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:59 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9492ba59-5b3c-49db-8276-80c0503ce347 tempest-ProjectReaderTests-433089253 None] Lock "cinder-quobyte-de24f2a0-c84a-4268-ab71-ddb6486fba3d" released by "delete_volume" :: held 0.789s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:59 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-9492ba59-5b3c-49db-8276-80c0503ce347 tempest-ProjectReaderTests-433089253 None] Created reservations ['4fbdc566-fbdb-4f36-8b9a-bb33475d5e1b', 'cff34e7c-6254-40df-af40-6e294cd47c5f', '20829908-4aa7-4b81-ad97-dac04727db46', 'fb6f49b2-13ab-4e83-a019-8c1e72c554fc'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:37:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-9492ba59-5b3c-49db-8276-80c0503ce347 tempest-ProjectReaderTests-433089253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:37:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-9492ba59-5b3c-49db-8276-80c0503ce347 tempest-ProjectReaderTests-433089253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:37:59 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-9492ba59-5b3c-49db-8276-80c0503ce347 tempest-ProjectReaderTests-433089253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:37:59 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-9492ba59-5b3c-49db-8276-80c0503ce347 tempest-ProjectReaderTests-433089253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:37:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-9492ba59-5b3c-49db-8276-80c0503ce347 tempest-ProjectReaderTests-433089253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:37:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9492ba59-5b3c-49db-8276-80c0503ce347 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:59 devstack sudo[107518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:37:59 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:59 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7988b4cf-ce41-4f23-afec-dfbab98bbdbd tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53.2a050121-5a8c-4885-ad4b-a9165d97f115" returned: 0 in 0.312s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7988b4cf-ce41-4f23-afec-dfbab98bbdbd tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:59 devstack sudo[107521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53.info Nov 03 20:37:59 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:37:59 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-9492ba59-5b3c-49db-8276-80c0503ce347 tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.293s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:59 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-9492ba59-5b3c-49db-8276-80c0503ce347 tempest-ProjectReaderTests-433089253 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:37:59 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-9492ba59-5b3c-49db-8276-80c0503ce347 tempest-ProjectReaderTests-433089253 None] Deleted volume successfully. Nov 03 20:37:59 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-9492ba59-5b3c-49db-8276-80c0503ce347 tempest-ProjectReaderTests-433089253 None] Lock "cinder-de24f2a0-c84a-4268-ab71-ddb6486fba3d-delete_volume" released by "delete_volume" :: held 1.353s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:37:59 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root Nov 03 20:37:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7988b4cf-ce41-4f23-afec-dfbab98bbdbd tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53.info" returned: 0 in 0.370s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:37:59 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-7988b4cf-ce41-4f23-afec-dfbab98bbdbd tempest-ProjectMemberTests-196532882 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53.info is being set with open permissions: ugo+rw Nov 03 20:37:59 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7988b4cf-ce41-4f23-afec-dfbab98bbdbd tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:37:59 devstack sudo[107525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53.info Nov 03 20:37:59 devstack sudo[107525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:00 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-27d8ac13-c1a4-4380-bfd1-c928d416685d tempest-ProjectReaderTests-433089253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:38:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-27d8ac13-c1a4-4380-bfd1-c928d416685d tempest-ProjectReaderTests-433089253 None] Flow 'volume_create_manager' (dc95397d-306e-4726-9962-8ac41e94157b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:38:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-27d8ac13-c1a4-4380-bfd1-c928d416685d tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38dc3ea0-ffee-44df-bc6a-78d1c15ee317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-27d8ac13-c1a4-4380-bfd1-c928d416685d tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38dc3ea0-ffee-44df-bc6a-78d1c15ee317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:38:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-791215117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bb28d49-ac35-4834-963e-9e1baf088908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c44365c19f64452a4ca43ddbc83b98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:38:00Z,use_quota=True,user_id='b4a43cba6ec642509e771e8a42d91883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-27d8ac13-c1a4-4380-bfd1-c928d416685d tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27f907c2-ce7b-4250-96f5-f6c8e322c95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-27d8ac13-c1a4-4380-bfd1-c928d416685d tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27f907c2-ce7b-4250-96f5-f6c8e322c95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-27d8ac13-c1a4-4380-bfd1-c928d416685d tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5a9a25c-382f-4f8d-877d-c0018ab051b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-27d8ac13-c1a4-4380-bfd1-c928d416685d tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5a9a25c-382f-4f8d-877d-c0018ab051b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bb28d49-ac35-4834-963e-9e1baf088908', 'volume_name': 'volume-8bb28d49-ac35-4834-963e-9e1baf088908', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:00 devstack sudo[107525]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-27d8ac13-c1a4-4380-bfd1-c928d416685d tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d3139a9-78e3-47f0-9618-847e487b7caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-27d8ac13-c1a4-4380-bfd1-c928d416685d tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d3139a9-78e3-47f0-9618-847e487b7caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-27d8ac13-c1a4-4380-bfd1-c928d416685d tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (309f6abd-f2d3-4a56-9649-69862002ea23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:00 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-27d8ac13-c1a4-4380-bfd1-c928d416685d tempest-ProjectReaderTests-433089253 None] Volume 8bb28d49-ac35-4834-963e-9e1baf088908: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bb28d49-ac35-4834-963e-9e1baf088908', 'volume_size': 1} Nov 03 20:38:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-27d8ac13-c1a4-4380-bfd1-c928d416685d tempest-ProjectReaderTests-433089253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:38:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7988b4cf-ce41-4f23-afec-dfbab98bbdbd tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53.info" returned: 0 in 0.317s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7988b4cf-ce41-4f23-afec-dfbab98bbdbd tempest-ProjectMemberTests-196532882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.345s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:38:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-27d8ac13-c1a4-4380-bfd1-c928d416685d tempest-ProjectReaderTests-433089253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.029s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:38:00 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-27d8ac13-c1a4-4380-bfd1-c928d416685d tempest-ProjectReaderTests-433089253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:38:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-791215117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bb28d49-ac35-4834-963e-9e1baf088908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c44365c19f64452a4ca43ddbc83b98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:38:00Z,use_quota=True,user_id='b4a43cba6ec642509e771e8a42d91883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:38:00 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-27d8ac13-c1a4-4380-bfd1-c928d416685d tempest-ProjectReaderTests-433089253 None] Creating volume 8bb28d49-ac35-4834-963e-9e1baf088908 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:38:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-27d8ac13-c1a4-4380-bfd1-c928d416685d tempest-ProjectReaderTests-433089253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:38:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-27d8ac13-c1a4-4380-bfd1-c928d416685d tempest-ProjectReaderTests-433089253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:38:00 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-27d8ac13-c1a4-4380-bfd1-c928d416685d tempest-ProjectReaderTests-433089253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:38:00 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-27d8ac13-c1a4-4380-bfd1-c928d416685d tempest-ProjectReaderTests-433089253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:38:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-27d8ac13-c1a4-4380-bfd1-c928d416685d tempest-ProjectReaderTests-433089253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:38:00 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-27d8ac13-c1a4-4380-bfd1-c928d416685d tempest-ProjectReaderTests-433089253 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:38:00 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-27d8ac13-c1a4-4380-bfd1-c928d416685d tempest-ProjectReaderTests-433089253 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:38:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-27d8ac13-c1a4-4380-bfd1-c928d416685d tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8bb28d49-ac35-4834-963e-9e1baf088908 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:00 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8bb28d49-ac35-4834-963e-9e1baf088908 1073741824 Nov 03 20:38:00 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:00 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-7988b4cf-ce41-4f23-afec-dfbab98bbdbd tempest-ProjectMemberTests-196532882 None] Create snapshot completed successfully Nov 03 20:38:00 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-27d8ac13-c1a4-4380-bfd1-c928d416685d tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8bb28d49-ac35-4834-963e-9e1baf088908 1073741824" returned: 0 in 0.426s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-27d8ac13-c1a4-4380-bfd1-c928d416685d tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8bb28d49-ac35-4834-963e-9e1baf088908 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:00 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8bb28d49-ac35-4834-963e-9e1baf088908 Nov 03 20:38:00 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:00 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-27d8ac13-c1a4-4380-bfd1-c928d416685d tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8bb28d49-ac35-4834-963e-9e1baf088908" returned: 0 in 0.243s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:00 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-27d8ac13-c1a4-4380-bfd1-c928d416685d tempest-ProjectReaderTests-433089253 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:38:00 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-27d8ac13-c1a4-4380-bfd1-c928d416685d tempest-ProjectReaderTests-433089253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:38:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-27d8ac13-c1a4-4380-bfd1-c928d416685d tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (309f6abd-f2d3-4a56-9649-69862002ea23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bb28d49-ac35-4834-963e-9e1baf088908', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-27d8ac13-c1a4-4380-bfd1-c928d416685d tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed09786-cc31-486a-ac9f-78800bf0a1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:00 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-27d8ac13-c1a4-4380-bfd1-c928d416685d tempest-ProjectReaderTests-433089253 None] Volume volume-8bb28d49-ac35-4834-963e-9e1baf088908 (8bb28d49-ac35-4834-963e-9e1baf088908): created successfully Nov 03 20:38:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-27d8ac13-c1a4-4380-bfd1-c928d416685d tempest-ProjectReaderTests-433089253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed09786-cc31-486a-ac9f-78800bf0a1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:00 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-27d8ac13-c1a4-4380-bfd1-c928d416685d tempest-ProjectReaderTests-433089253 None] Flow 'volume_create_manager' (dc95397d-306e-4726-9962-8ac41e94157b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:38:01 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-27d8ac13-c1a4-4380-bfd1-c928d416685d tempest-ProjectReaderTests-433089253 None] Created volume successfully. Nov 03 20:38:01 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-5416afc9-8675-4edd-82f5-4801e6ffd1c0 tempest-ProjectMemberTests-196532882 None] Acquiring lock "cinder-2a050121-5a8c-4885-ad4b-a9165d97f115-delete_snapshot" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:38:01 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-5416afc9-8675-4edd-82f5-4801e6ffd1c0 tempest-ProjectMemberTests-196532882 None] Lock "cinder-2a050121-5a8c-4885-ad4b-a9165d97f115-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:38:01 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-5416afc9-8675-4edd-82f5-4801e6ffd1c0 tempest-ProjectMemberTests-196532882 None] Acquiring lock "cinder-quobyte-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:38:01 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-5416afc9-8675-4edd-82f5-4801e6ffd1c0 tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:38:01 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-5416afc9-8675-4edd-82f5-4801e6ffd1c0 tempest-ProjectMemberTests-196532882 None] Acquiring lock "cinder-quobyte-2a050121-5a8c-4885-ad4b-a9165d97f115" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:38:01 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-5416afc9-8675-4edd-82f5-4801e6ffd1c0 tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-2a050121-5a8c-4885-ad4b-a9165d97f115" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:38:01 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-5416afc9-8675-4edd-82f5-4801e6ffd1c0 tempest-ProjectMemberTests-196532882 None] Deleting offline snapshot 2a050121-5a8c-4885-ad4b-a9165d97f115 of volume f2b175b5-7d90-4ddc-9ede-1f5a9129fa53 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:38:01 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-5416afc9-8675-4edd-82f5-4801e6ffd1c0 tempest-ProjectMemberTests-196532882 None] snapshot_file for this snap is: volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53.2a050121-5a8c-4885-ad4b-a9165d97f115 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:38:01 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[15dc3f21-5f8b-43f6-8774-c271c0d03be4]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:38:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5416afc9-8675-4edd-82f5-4801e6ffd1c0 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53.2a050121-5a8c-4885-ad4b-a9165d97f115 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d531b153-ceb2-4132-a69b-6a085ca474e4 tempest-ProjectReaderTests-433089253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:38:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d531b153-ceb2-4132-a69b-6a085ca474e4 tempest-ProjectReaderTests-433089253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:38:01 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53.2a050121-5a8c-4885-ad4b-a9165d97f115 Nov 03 20:38:01 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:01 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-d531b153-ceb2-4132-a69b-6a085ca474e4 tempest-ProjectReaderTests-433089253 None] Creating offline snapshot 53c19666-a26d-496f-a728-074dd8c7d0ea of volume 8bb28d49-ac35-4834-963e-9e1baf088908 {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:38:01 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73778f2-77ee-4f42-a76b-cdf7ddb50610]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:38:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d531b153-ceb2-4132-a69b-6a085ca474e4 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8bb28d49-ac35-4834-963e-9e1baf088908 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:01 devstack sudo[107538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8bb28d49-ac35-4834-963e-9e1baf088908 Nov 03 20:38:01 devstack sudo[107538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:01 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5416afc9-8675-4edd-82f5-4801e6ffd1c0 tempest-ProjectMemberTests-196532882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53.2a050121-5a8c-4885-ad4b-a9165d97f115" returned: 0 in 0.376s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:01 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-5416afc9-8675-4edd-82f5-4801e6ffd1c0 tempest-ProjectMemberTests-196532882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:38:01 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f40bd5b-e388-435f-bd7c-eb3f0b95e7e5]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:38:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5416afc9-8675-4edd-82f5-4801e6ffd1c0 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:01 devstack sudo[107538]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d531b153-ceb2-4132-a69b-6a085ca474e4 tempest-ProjectReaderTests-433089253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8bb28d49-ac35-4834-963e-9e1baf088908" returned: 0 in 0.386s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d531b153-ceb2-4132-a69b-6a085ca474e4 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8bb28d49-ac35-4834-963e-9e1baf088908,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8bb28d49-ac35-4834-963e-9e1baf088908.53c19666-a26d-496f-a728-074dd8c7d0ea 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:01 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53 Nov 03 20:38:01 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:01 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8bb28d49-ac35-4834-963e-9e1baf088908,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8bb28d49-ac35-4834-963e-9e1baf088908.53c19666-a26d-496f-a728-074dd8c7d0ea 1G Nov 03 20:38:01 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:01 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5416afc9-8675-4edd-82f5-4801e6ffd1c0 tempest-ProjectMemberTests-196532882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53" returned: 0 in 0.407s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:01 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5416afc9-8675-4edd-82f5-4801e6ffd1c0 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53.2a050121-5a8c-4885-ad4b-a9165d97f115 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:02 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53.2a050121-5a8c-4885-ad4b-a9165d97f115 Nov 03 20:38:02 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:02 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d531b153-ceb2-4132-a69b-6a085ca474e4 tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8bb28d49-ac35-4834-963e-9e1baf088908,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8bb28d49-ac35-4834-963e-9e1baf088908.53c19666-a26d-496f-a728-074dd8c7d0ea 1G" returned: 0 in 0.461s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d531b153-ceb2-4132-a69b-6a085ca474e4 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bb28d49-ac35-4834-963e-9e1baf088908 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8bb28d49-ac35-4834-963e-9e1baf088908.53c19666-a26d-496f-a728-074dd8c7d0ea {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:02 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bb28d49-ac35-4834-963e-9e1baf088908 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8bb28d49-ac35-4834-963e-9e1baf088908.53c19666-a26d-496f-a728-074dd8c7d0ea Nov 03 20:38:02 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:02 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5416afc9-8675-4edd-82f5-4801e6ffd1c0 tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53.2a050121-5a8c-4885-ad4b-a9165d97f115" returned: 0 in 0.355s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5416afc9-8675-4edd-82f5-4801e6ffd1c0 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53.2a050121-5a8c-4885-ad4b-a9165d97f115 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:02 devstack sudo[107563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53.2a050121-5a8c-4885-ad4b-a9165d97f115 Nov 03 20:38:02 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:02 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d531b153-ceb2-4132-a69b-6a085ca474e4 tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bb28d49-ac35-4834-963e-9e1baf088908 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8bb28d49-ac35-4834-963e-9e1baf088908.53c19666-a26d-496f-a728-074dd8c7d0ea" returned: 0 in 0.318s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:02 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-d531b153-ceb2-4132-a69b-6a085ca474e4 tempest-ProjectReaderTests-433089253 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8bb28d49-ac35-4834-963e-9e1baf088908.53c19666-a26d-496f-a728-074dd8c7d0ea is being set with open permissions: ugo+rw Nov 03 20:38:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d531b153-ceb2-4132-a69b-6a085ca474e4 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8bb28d49-ac35-4834-963e-9e1baf088908.53c19666-a26d-496f-a728-074dd8c7d0ea {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:02 devstack sudo[107569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8bb28d49-ac35-4834-963e-9e1baf088908.53c19666-a26d-496f-a728-074dd8c7d0ea Nov 03 20:38:02 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:02 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5416afc9-8675-4edd-82f5-4801e6ffd1c0 tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53.2a050121-5a8c-4885-ad4b-a9165d97f115" returned: 0 in 0.261s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:02 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-5416afc9-8675-4edd-82f5-4801e6ffd1c0 tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-2a050121-5a8c-4885-ad4b-a9165d97f115" released by "_delete_snapshot" :: held 1.516s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:38:02 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-5416afc9-8675-4edd-82f5-4801e6ffd1c0 tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53" released by "delete_snapshot" :: held 1.545s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:38:02 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-5416afc9-8675-4edd-82f5-4801e6ffd1c0 tempest-ProjectMemberTests-196532882 None] Created reservations ['5b29073e-95d0-471c-8497-e81e9fbbcd78', 'a3bb5eb8-126a-4ecc-bfaf-c4ac940d8a9a', '194a47de-9dc7-4d57-8932-c0162e18ce0c', '6c5c521c-ae5c-42ba-b215-aee42dd22e8b'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:38:02 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d531b153-ceb2-4132-a69b-6a085ca474e4 tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8bb28d49-ac35-4834-963e-9e1baf088908.53c19666-a26d-496f-a728-074dd8c7d0ea" returned: 0 in 0.267s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:02 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-5416afc9-8675-4edd-82f5-4801e6ffd1c0 tempest-ProjectMemberTests-196532882 None] Delete snapshot completed successfully. Nov 03 20:38:02 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d531b153-ceb2-4132-a69b-6a085ca474e4 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8bb28d49-ac35-4834-963e-9e1baf088908.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:02 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-5416afc9-8675-4edd-82f5-4801e6ffd1c0 tempest-ProjectMemberTests-196532882 None] Lock "cinder-2a050121-5a8c-4885-ad4b-a9165d97f115-delete_snapshot" released by "delete_snapshot" :: held 1.707s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:38:02 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8bb28d49-ac35-4834-963e-9e1baf088908.info Nov 03 20:38:02 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:03 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d531b153-ceb2-4132-a69b-6a085ca474e4 tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8bb28d49-ac35-4834-963e-9e1baf088908.info" returned: 0 in 0.247s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:03 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-d531b153-ceb2-4132-a69b-6a085ca474e4 tempest-ProjectReaderTests-433089253 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8bb28d49-ac35-4834-963e-9e1baf088908.info is being set with open permissions: ugo+rw Nov 03 20:38:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d531b153-ceb2-4132-a69b-6a085ca474e4 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8bb28d49-ac35-4834-963e-9e1baf088908.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:03 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8bb28d49-ac35-4834-963e-9e1baf088908.info Nov 03 20:38:03 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:03 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-5a31382d-f258-48d6-a7e9-54f8beaad4fe tempest-ProjectMemberTests-196532882 None] Acquiring lock "cinder-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:38:03 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-5a31382d-f258-48d6-a7e9-54f8beaad4fe tempest-ProjectMemberTests-196532882 None] Lock "cinder-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:38:03 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-5a31382d-f258-48d6-a7e9-54f8beaad4fe tempest-ProjectMemberTests-196532882 None] Acquiring lock "cinder-quobyte-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:38:03 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-d531b153-ceb2-4132-a69b-6a085ca474e4 tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8bb28d49-ac35-4834-963e-9e1baf088908.info" returned: 0 in 0.280s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-d531b153-ceb2-4132-a69b-6a085ca474e4 tempest-ProjectReaderTests-433089253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.054s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:38:03 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-5a31382d-f258-48d6-a7e9-54f8beaad4fe tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53" acquired by "delete_volume" :: waited 0.044s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:38:03 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-d531b153-ceb2-4132-a69b-6a085ca474e4 tempest-ProjectReaderTests-433089253 None] Create snapshot completed successfully Nov 03 20:38:03 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[b542330b-2326-410f-a350-073de35247c4]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:38:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5a31382d-f258-48d6-a7e9-54f8beaad4fe tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:03 devstack sudo[107585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53 Nov 03 20:38:03 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:03 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5a31382d-f258-48d6-a7e9-54f8beaad4fe tempest-ProjectMemberTests-196532882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53" returned: 0 in 0.367s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:03 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5a31382d-f258-48d6-a7e9-54f8beaad4fe tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:03 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53 Nov 03 20:38:03 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:04 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5a31382d-f258-48d6-a7e9-54f8beaad4fe tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53" returned: 0 in 0.242s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:04 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-5a31382d-f258-48d6-a7e9-54f8beaad4fe tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53" released by "delete_volume" :: held 0.674s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:38:04 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-5a31382d-f258-48d6-a7e9-54f8beaad4fe tempest-ProjectMemberTests-196532882 None] Created reservations ['a5147790-9eb0-4a2c-9a53-ed09036bab12', '21ecc619-4d96-4127-aa7c-d759a9d65458', 'be4442a1-bb08-40cb-adaf-cdf2fab931d7', 'a6927d33-3455-4b27-9679-9deff921067e'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:38:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-5a31382d-f258-48d6-a7e9-54f8beaad4fe tempest-ProjectMemberTests-196532882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:38:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-5a31382d-f258-48d6-a7e9-54f8beaad4fe tempest-ProjectMemberTests-196532882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:38:04 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-5a31382d-f258-48d6-a7e9-54f8beaad4fe tempest-ProjectMemberTests-196532882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:38:04 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-5a31382d-f258-48d6-a7e9-54f8beaad4fe tempest-ProjectMemberTests-196532882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:38:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-5a31382d-f258-48d6-a7e9-54f8beaad4fe tempest-ProjectMemberTests-196532882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:38:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5a31382d-f258-48d6-a7e9-54f8beaad4fe tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:04 devstack sudo[107593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:38:04 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:04 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-5a31382d-f258-48d6-a7e9-54f8beaad4fe tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.259s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:04 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-5a31382d-f258-48d6-a7e9-54f8beaad4fe tempest-ProjectMemberTests-196532882 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:38:04 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-5a31382d-f258-48d6-a7e9-54f8beaad4fe tempest-ProjectMemberTests-196532882 None] Deleted volume successfully. Nov 03 20:38:04 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-5a31382d-f258-48d6-a7e9-54f8beaad4fe tempest-ProjectMemberTests-196532882 None] Lock "cinder-f2b175b5-7d90-4ddc-9ede-1f5a9129fa53-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:38:04 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fbf1e02a-3b96-4af5-ba74-ed306a7f2895 tempest-ProjectReaderTests-433089253 None] Acquiring lock "cinder-53c19666-a26d-496f-a728-074dd8c7d0ea-delete_snapshot" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:38:04 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fbf1e02a-3b96-4af5-ba74-ed306a7f2895 tempest-ProjectReaderTests-433089253 None] Lock "cinder-53c19666-a26d-496f-a728-074dd8c7d0ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:38:04 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fbf1e02a-3b96-4af5-ba74-ed306a7f2895 tempest-ProjectReaderTests-433089253 None] Acquiring lock "cinder-quobyte-8bb28d49-ac35-4834-963e-9e1baf088908" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:38:04 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fbf1e02a-3b96-4af5-ba74-ed306a7f2895 tempest-ProjectReaderTests-433089253 None] Lock "cinder-quobyte-8bb28d49-ac35-4834-963e-9e1baf088908" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:38:04 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fbf1e02a-3b96-4af5-ba74-ed306a7f2895 tempest-ProjectReaderTests-433089253 None] Acquiring lock "cinder-quobyte-53c19666-a26d-496f-a728-074dd8c7d0ea" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:38:04 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fbf1e02a-3b96-4af5-ba74-ed306a7f2895 tempest-ProjectReaderTests-433089253 None] Lock "cinder-quobyte-53c19666-a26d-496f-a728-074dd8c7d0ea" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:38:04 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-fbf1e02a-3b96-4af5-ba74-ed306a7f2895 tempest-ProjectReaderTests-433089253 None] Deleting offline snapshot 53c19666-a26d-496f-a728-074dd8c7d0ea of volume 8bb28d49-ac35-4834-963e-9e1baf088908 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:38:04 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-fbf1e02a-3b96-4af5-ba74-ed306a7f2895 tempest-ProjectReaderTests-433089253 None] snapshot_file for this snap is: volume-8bb28d49-ac35-4834-963e-9e1baf088908.53c19666-a26d-496f-a728-074dd8c7d0ea {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:38:04 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f47281c-cc41-45c2-90c6-b66bc5cd32c6]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:38:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fbf1e02a-3b96-4af5-ba74-ed306a7f2895 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8bb28d49-ac35-4834-963e-9e1baf088908.53c19666-a26d-496f-a728-074dd8c7d0ea {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:04 devstack sudo[107596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8bb28d49-ac35-4834-963e-9e1baf088908.53c19666-a26d-496f-a728-074dd8c7d0ea Nov 03 20:38:04 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:04 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e539056-4515-4357-a1ea-0b1d90827fcf tempest-ProjectMemberTests-196532882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:38:04 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7e539056-4515-4357-a1ea-0b1d90827fcf tempest-ProjectMemberTests-196532882 None] Flow 'volume_create_manager' (215dd427-2e2b-4622-a934-3aae90037137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:38:04 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7e539056-4515-4357-a1ea-0b1d90827fcf tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fc9ca0d-9dbf-4ce5-bd54-9c39ce16b70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:04 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7e539056-4515-4357-a1ea-0b1d90827fcf tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fc9ca0d-9dbf-4ce5-bd54-9c39ce16b70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1398528875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca449f68-dd83-4335-b6ba-ee845f4dadad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd20413f6d5649da828c1f0bf51455d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:38:05Z,use_quota=True,user_id='595eaffd7e764ae6b07e6aba8405d447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:04 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7e539056-4515-4357-a1ea-0b1d90827fcf tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa6e25d6-07c6-4c75-84e0-93a02121a2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:04 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7e539056-4515-4357-a1ea-0b1d90827fcf tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa6e25d6-07c6-4c75-84e0-93a02121a2b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:04 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7e539056-4515-4357-a1ea-0b1d90827fcf tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf07f1cb-452d-48a5-95b3-aa6ec207adb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:04 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7e539056-4515-4357-a1ea-0b1d90827fcf tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf07f1cb-452d-48a5-95b3-aa6ec207adb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca449f68-dd83-4335-b6ba-ee845f4dadad', 'volume_name': 'volume-ca449f68-dd83-4335-b6ba-ee845f4dadad', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:04 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7e539056-4515-4357-a1ea-0b1d90827fcf tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f9e7b36-e0b7-4d3c-b38c-fcff0ef572d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:04 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7e539056-4515-4357-a1ea-0b1d90827fcf tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f9e7b36-e0b7-4d3c-b38c-fcff0ef572d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:04 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:04 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7e539056-4515-4357-a1ea-0b1d90827fcf tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98a7df9a-3966-456d-91ea-386699ce5164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:04 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-7e539056-4515-4357-a1ea-0b1d90827fcf tempest-ProjectMemberTests-196532882 None] Volume ca449f68-dd83-4335-b6ba-ee845f4dadad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca449f68-dd83-4335-b6ba-ee845f4dadad', 'volume_size': 1} Nov 03 20:38:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7e539056-4515-4357-a1ea-0b1d90827fcf tempest-ProjectMemberTests-196532882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:38:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7e539056-4515-4357-a1ea-0b1d90827fcf tempest-ProjectMemberTests-196532882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:38:04 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-7e539056-4515-4357-a1ea-0b1d90827fcf tempest-ProjectMemberTests-196532882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1398528875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca449f68-dd83-4335-b6ba-ee845f4dadad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd20413f6d5649da828c1f0bf51455d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:38:05Z,use_quota=True,user_id='595eaffd7e764ae6b07e6aba8405d447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:38:04 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-7e539056-4515-4357-a1ea-0b1d90827fcf tempest-ProjectMemberTests-196532882 None] Creating volume ca449f68-dd83-4335-b6ba-ee845f4dadad {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:38:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7e539056-4515-4357-a1ea-0b1d90827fcf tempest-ProjectMemberTests-196532882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:38:04 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7e539056-4515-4357-a1ea-0b1d90827fcf tempest-ProjectMemberTests-196532882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:38:05 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-7e539056-4515-4357-a1ea-0b1d90827fcf tempest-ProjectMemberTests-196532882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:38:05 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-7e539056-4515-4357-a1ea-0b1d90827fcf tempest-ProjectMemberTests-196532882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:38:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7e539056-4515-4357-a1ea-0b1d90827fcf tempest-ProjectMemberTests-196532882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:38:05 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-7e539056-4515-4357-a1ea-0b1d90827fcf tempest-ProjectMemberTests-196532882 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:38:05 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-7e539056-4515-4357-a1ea-0b1d90827fcf tempest-ProjectMemberTests-196532882 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:38:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7e539056-4515-4357-a1ea-0b1d90827fcf tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ca449f68-dd83-4335-b6ba-ee845f4dadad 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fbf1e02a-3b96-4af5-ba74-ed306a7f2895 tempest-ProjectReaderTests-433089253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8bb28d49-ac35-4834-963e-9e1baf088908.53c19666-a26d-496f-a728-074dd8c7d0ea" returned: 0 in 0.435s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:05 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-fbf1e02a-3b96-4af5-ba74-ed306a7f2895 tempest-ProjectReaderTests-433089253 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8bb28d49-ac35-4834-963e-9e1baf088908(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:38:05 devstack sudo[107601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ca449f68-dd83-4335-b6ba-ee845f4dadad 1073741824 Nov 03 20:38:05 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:05 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb98c00f-e219-4686-b469-43a0f9c1ec3e]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:38:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fbf1e02a-3b96-4af5-ba74-ed306a7f2895 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8bb28d49-ac35-4834-963e-9e1baf088908 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:05 devstack sudo[107603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8bb28d49-ac35-4834-963e-9e1baf088908 Nov 03 20:38:05 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:05 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fbf1e02a-3b96-4af5-ba74-ed306a7f2895 tempest-ProjectReaderTests-433089253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8bb28d49-ac35-4834-963e-9e1baf088908" returned: 0 in 0.370s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fbf1e02a-3b96-4af5-ba74-ed306a7f2895 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8bb28d49-ac35-4834-963e-9e1baf088908.53c19666-a26d-496f-a728-074dd8c7d0ea {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:05 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7e539056-4515-4357-a1ea-0b1d90827fcf tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ca449f68-dd83-4335-b6ba-ee845f4dadad 1073741824" returned: 0 in 0.427s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:05 devstack sudo[107612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8bb28d49-ac35-4834-963e-9e1baf088908.53c19666-a26d-496f-a728-074dd8c7d0ea Nov 03 20:38:05 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7e539056-4515-4357-a1ea-0b1d90827fcf tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ca449f68-dd83-4335-b6ba-ee845f4dadad {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:05 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ca449f68-dd83-4335-b6ba-ee845f4dadad Nov 03 20:38:05 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:05 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7e539056-4515-4357-a1ea-0b1d90827fcf tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ca449f68-dd83-4335-b6ba-ee845f4dadad" returned: 0 in 0.261s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:05 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-7e539056-4515-4357-a1ea-0b1d90827fcf tempest-ProjectMemberTests-196532882 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:38:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7e539056-4515-4357-a1ea-0b1d90827fcf tempest-ProjectMemberTests-196532882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:38:05 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7e539056-4515-4357-a1ea-0b1d90827fcf tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98a7df9a-3966-456d-91ea-386699ce5164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca449f68-dd83-4335-b6ba-ee845f4dadad', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:05 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7e539056-4515-4357-a1ea-0b1d90827fcf tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a02952d-2768-4733-85df-ec924f43c650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:05 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fbf1e02a-3b96-4af5-ba74-ed306a7f2895 tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8bb28d49-ac35-4834-963e-9e1baf088908.53c19666-a26d-496f-a728-074dd8c7d0ea" returned: 0 in 0.339s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:05 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fbf1e02a-3b96-4af5-ba74-ed306a7f2895 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8bb28d49-ac35-4834-963e-9e1baf088908.53c19666-a26d-496f-a728-074dd8c7d0ea {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:05 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-7e539056-4515-4357-a1ea-0b1d90827fcf tempest-ProjectMemberTests-196532882 None] Volume volume-ca449f68-dd83-4335-b6ba-ee845f4dadad (ca449f68-dd83-4335-b6ba-ee845f4dadad): created successfully Nov 03 20:38:05 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7e539056-4515-4357-a1ea-0b1d90827fcf tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a02952d-2768-4733-85df-ec924f43c650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:05 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-7e539056-4515-4357-a1ea-0b1d90827fcf tempest-ProjectMemberTests-196532882 None] Flow 'volume_create_manager' (215dd427-2e2b-4622-a934-3aae90037137) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:38:05 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8bb28d49-ac35-4834-963e-9e1baf088908.53c19666-a26d-496f-a728-074dd8c7d0ea Nov 03 20:38:05 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:05 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-7e539056-4515-4357-a1ea-0b1d90827fcf tempest-ProjectMemberTests-196532882 None] Created volume successfully. Nov 03 20:38:06 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fbf1e02a-3b96-4af5-ba74-ed306a7f2895 tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8bb28d49-ac35-4834-963e-9e1baf088908.53c19666-a26d-496f-a728-074dd8c7d0ea" returned: 0 in 0.249s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:06 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fbf1e02a-3b96-4af5-ba74-ed306a7f2895 tempest-ProjectReaderTests-433089253 None] Lock "cinder-quobyte-53c19666-a26d-496f-a728-074dd8c7d0ea" released by "_delete_snapshot" :: held 1.509s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:38:06 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fbf1e02a-3b96-4af5-ba74-ed306a7f2895 tempest-ProjectReaderTests-433089253 None] Lock "cinder-quobyte-8bb28d49-ac35-4834-963e-9e1baf088908" released by "delete_snapshot" :: held 1.533s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:38:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-58ef8e99-d02c-4794-b8fd-ec21aa7e0cfd tempest-ProjectMemberTests-196532882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:38:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-58ef8e99-d02c-4794-b8fd-ec21aa7e0cfd tempest-ProjectMemberTests-196532882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:38:06 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-58ef8e99-d02c-4794-b8fd-ec21aa7e0cfd tempest-ProjectMemberTests-196532882 None] Creating offline snapshot c16d6a15-c20a-4c57-87aa-d983cc2499d5 of volume ca449f68-dd83-4335-b6ba-ee845f4dadad {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:38:06 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[e049fddf-6d24-4b3c-bc58-18c8951b53c1]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:38:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-58ef8e99-d02c-4794-b8fd-ec21aa7e0cfd tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ca449f68-dd83-4335-b6ba-ee845f4dadad {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:06 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-fbf1e02a-3b96-4af5-ba74-ed306a7f2895 tempest-ProjectReaderTests-433089253 None] Created reservations ['c2379910-ba7b-4c53-a9e9-81da482193c5', '37e3909f-6541-44b4-a368-fe01f7a62346', 'cd564b7d-6f59-492e-b170-88c8aed76f81', 'a06d92bc-f67d-4a41-8725-34330dfb96d9'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:38:06 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-fbf1e02a-3b96-4af5-ba74-ed306a7f2895 tempest-ProjectReaderTests-433089253 None] Delete snapshot completed successfully. Nov 03 20:38:06 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fbf1e02a-3b96-4af5-ba74-ed306a7f2895 tempest-ProjectReaderTests-433089253 None] Lock "cinder-53c19666-a26d-496f-a728-074dd8c7d0ea-delete_snapshot" released by "delete_snapshot" :: held 1.768s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:38:06 devstack sudo[107623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ca449f68-dd83-4335-b6ba-ee845f4dadad Nov 03 20:38:06 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:06 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-58ef8e99-d02c-4794-b8fd-ec21aa7e0cfd tempest-ProjectMemberTests-196532882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ca449f68-dd83-4335-b6ba-ee845f4dadad" returned: 0 in 0.358s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-58ef8e99-d02c-4794-b8fd-ec21aa7e0cfd tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ca449f68-dd83-4335-b6ba-ee845f4dadad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ca449f68-dd83-4335-b6ba-ee845f4dadad.c16d6a15-c20a-4c57-87aa-d983cc2499d5 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:06 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ca449f68-dd83-4335-b6ba-ee845f4dadad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ca449f68-dd83-4335-b6ba-ee845f4dadad.c16d6a15-c20a-4c57-87aa-d983cc2499d5 1G Nov 03 20:38:06 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:06 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-69a6d1ba-c0ca-4551-9ead-11c291c67304 tempest-ProjectReaderTests-433089253 None] Acquiring lock "cinder-8bb28d49-ac35-4834-963e-9e1baf088908-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:38:06 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-69a6d1ba-c0ca-4551-9ead-11c291c67304 tempest-ProjectReaderTests-433089253 None] Lock "cinder-8bb28d49-ac35-4834-963e-9e1baf088908-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:38:06 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-69a6d1ba-c0ca-4551-9ead-11c291c67304 tempest-ProjectReaderTests-433089253 None] Acquiring lock "cinder-quobyte-8bb28d49-ac35-4834-963e-9e1baf088908" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:38:06 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-69a6d1ba-c0ca-4551-9ead-11c291c67304 tempest-ProjectReaderTests-433089253 None] Lock "cinder-quobyte-8bb28d49-ac35-4834-963e-9e1baf088908" acquired by "delete_volume" :: waited 0.019s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:38:06 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[620d5768-539f-41a0-9ef5-990efcad7d91]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:38:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-69a6d1ba-c0ca-4551-9ead-11c291c67304 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8bb28d49-ac35-4834-963e-9e1baf088908 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:06 devstack sudo[107632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8bb28d49-ac35-4834-963e-9e1baf088908 Nov 03 20:38:06 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:06 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-58ef8e99-d02c-4794-b8fd-ec21aa7e0cfd tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ca449f68-dd83-4335-b6ba-ee845f4dadad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ca449f68-dd83-4335-b6ba-ee845f4dadad.c16d6a15-c20a-4c57-87aa-d983cc2499d5 1G" returned: 0 in 0.419s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:06 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-58ef8e99-d02c-4794-b8fd-ec21aa7e0cfd tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca449f68-dd83-4335-b6ba-ee845f4dadad -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ca449f68-dd83-4335-b6ba-ee845f4dadad.c16d6a15-c20a-4c57-87aa-d983cc2499d5 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:06 devstack sudo[107635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca449f68-dd83-4335-b6ba-ee845f4dadad -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ca449f68-dd83-4335-b6ba-ee845f4dadad.c16d6a15-c20a-4c57-87aa-d983cc2499d5 Nov 03 20:38:06 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:07 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-69a6d1ba-c0ca-4551-9ead-11c291c67304 tempest-ProjectReaderTests-433089253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8bb28d49-ac35-4834-963e-9e1baf088908" returned: 0 in 0.385s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-69a6d1ba-c0ca-4551-9ead-11c291c67304 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8bb28d49-ac35-4834-963e-9e1baf088908 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:07 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8bb28d49-ac35-4834-963e-9e1baf088908 Nov 03 20:38:07 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:07 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-58ef8e99-d02c-4794-b8fd-ec21aa7e0cfd tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca449f68-dd83-4335-b6ba-ee845f4dadad -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ca449f68-dd83-4335-b6ba-ee845f4dadad.c16d6a15-c20a-4c57-87aa-d983cc2499d5" returned: 0 in 0.308s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:07 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-58ef8e99-d02c-4794-b8fd-ec21aa7e0cfd tempest-ProjectMemberTests-196532882 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ca449f68-dd83-4335-b6ba-ee845f4dadad.c16d6a15-c20a-4c57-87aa-d983cc2499d5 is being set with open permissions: ugo+rw Nov 03 20:38:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-58ef8e99-d02c-4794-b8fd-ec21aa7e0cfd tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ca449f68-dd83-4335-b6ba-ee845f4dadad.c16d6a15-c20a-4c57-87aa-d983cc2499d5 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:07 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ca449f68-dd83-4335-b6ba-ee845f4dadad.c16d6a15-c20a-4c57-87aa-d983cc2499d5 Nov 03 20:38:07 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:07 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-69a6d1ba-c0ca-4551-9ead-11c291c67304 tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-8bb28d49-ac35-4834-963e-9e1baf088908" returned: 0 in 0.263s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:07 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-69a6d1ba-c0ca-4551-9ead-11c291c67304 tempest-ProjectReaderTests-433089253 None] Lock "cinder-quobyte-8bb28d49-ac35-4834-963e-9e1baf088908" released by "delete_volume" :: held 0.715s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:38:07 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-69a6d1ba-c0ca-4551-9ead-11c291c67304 tempest-ProjectReaderTests-433089253 None] Created reservations ['5aa256a8-d850-4952-88d9-93bc70a68862', '184bd443-eb98-4b37-817f-068dcab7f0b9', '9e187583-5fe1-491b-8b5c-3fe0347f3e93', '2291a2a5-dd4d-4556-b1e1-f5053f465f1e'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:38:07 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-58ef8e99-d02c-4794-b8fd-ec21aa7e0cfd tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ca449f68-dd83-4335-b6ba-ee845f4dadad.c16d6a15-c20a-4c57-87aa-d983cc2499d5" returned: 0 in 0.249s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-58ef8e99-d02c-4794-b8fd-ec21aa7e0cfd tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ca449f68-dd83-4335-b6ba-ee845f4dadad.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:07 devstack sudo[107649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ca449f68-dd83-4335-b6ba-ee845f4dadad.info Nov 03 20:38:07 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-69a6d1ba-c0ca-4551-9ead-11c291c67304 tempest-ProjectReaderTests-433089253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:38:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-69a6d1ba-c0ca-4551-9ead-11c291c67304 tempest-ProjectReaderTests-433089253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:38:07 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-69a6d1ba-c0ca-4551-9ead-11c291c67304 tempest-ProjectReaderTests-433089253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:38:07 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-69a6d1ba-c0ca-4551-9ead-11c291c67304 tempest-ProjectReaderTests-433089253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:38:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-69a6d1ba-c0ca-4551-9ead-11c291c67304 tempest-ProjectReaderTests-433089253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:38:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-69a6d1ba-c0ca-4551-9ead-11c291c67304 tempest-ProjectReaderTests-433089253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:07 devstack sudo[107651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:38:07 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:07 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-58ef8e99-d02c-4794-b8fd-ec21aa7e0cfd tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ca449f68-dd83-4335-b6ba-ee845f4dadad.info" returned: 0 in 0.263s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:07 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-58ef8e99-d02c-4794-b8fd-ec21aa7e0cfd tempest-ProjectMemberTests-196532882 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ca449f68-dd83-4335-b6ba-ee845f4dadad.info is being set with open permissions: ugo+rw Nov 03 20:38:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-58ef8e99-d02c-4794-b8fd-ec21aa7e0cfd tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ca449f68-dd83-4335-b6ba-ee845f4dadad.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:07 devstack sudo[107655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ca449f68-dd83-4335-b6ba-ee845f4dadad.info Nov 03 20:38:07 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:07 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:07 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-69a6d1ba-c0ca-4551-9ead-11c291c67304 tempest-ProjectReaderTests-433089253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.265s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:07 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-69a6d1ba-c0ca-4551-9ead-11c291c67304 tempest-ProjectReaderTests-433089253 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:38:07 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-69a6d1ba-c0ca-4551-9ead-11c291c67304 tempest-ProjectReaderTests-433089253 None] Deleted volume successfully. Nov 03 20:38:07 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-69a6d1ba-c0ca-4551-9ead-11c291c67304 tempest-ProjectReaderTests-433089253 None] Lock "cinder-8bb28d49-ac35-4834-963e-9e1baf088908-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:38:08 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-58ef8e99-d02c-4794-b8fd-ec21aa7e0cfd tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ca449f68-dd83-4335-b6ba-ee845f4dadad.info" returned: 0 in 0.268s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-58ef8e99-d02c-4794-b8fd-ec21aa7e0cfd tempest-ProjectMemberTests-196532882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.994s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:38:08 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-58ef8e99-d02c-4794-b8fd-ec21aa7e0cfd tempest-ProjectMemberTests-196532882 None] Create snapshot completed successfully Nov 03 20:38:08 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ec0d90af-f38f-4dfa-8563-f6acf0ed5ed6 tempest-ProjectMemberTests-196532882 None] Acquiring lock "cinder-c16d6a15-c20a-4c57-87aa-d983cc2499d5-delete_snapshot" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:38:08 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ec0d90af-f38f-4dfa-8563-f6acf0ed5ed6 tempest-ProjectMemberTests-196532882 None] Lock "cinder-c16d6a15-c20a-4c57-87aa-d983cc2499d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:38:08 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ec0d90af-f38f-4dfa-8563-f6acf0ed5ed6 tempest-ProjectMemberTests-196532882 None] Acquiring lock "cinder-quobyte-ca449f68-dd83-4335-b6ba-ee845f4dadad" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:38:08 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ec0d90af-f38f-4dfa-8563-f6acf0ed5ed6 tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-ca449f68-dd83-4335-b6ba-ee845f4dadad" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:38:08 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ec0d90af-f38f-4dfa-8563-f6acf0ed5ed6 tempest-ProjectMemberTests-196532882 None] Acquiring lock "cinder-quobyte-c16d6a15-c20a-4c57-87aa-d983cc2499d5" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:38:08 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ec0d90af-f38f-4dfa-8563-f6acf0ed5ed6 tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-c16d6a15-c20a-4c57-87aa-d983cc2499d5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:38:08 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-ec0d90af-f38f-4dfa-8563-f6acf0ed5ed6 tempest-ProjectMemberTests-196532882 None] Deleting offline snapshot c16d6a15-c20a-4c57-87aa-d983cc2499d5 of volume ca449f68-dd83-4335-b6ba-ee845f4dadad {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:38:08 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-ec0d90af-f38f-4dfa-8563-f6acf0ed5ed6 tempest-ProjectMemberTests-196532882 None] snapshot_file for this snap is: volume-ca449f68-dd83-4335-b6ba-ee845f4dadad.c16d6a15-c20a-4c57-87aa-d983cc2499d5 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:38:08 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[6521715e-b6bd-40f3-af9f-e9c364b45cba]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:38:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ec0d90af-f38f-4dfa-8563-f6acf0ed5ed6 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ca449f68-dd83-4335-b6ba-ee845f4dadad.c16d6a15-c20a-4c57-87aa-d983cc2499d5 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:08 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ca449f68-dd83-4335-b6ba-ee845f4dadad.c16d6a15-c20a-4c57-87aa-d983cc2499d5 Nov 03 20:38:08 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:08 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ec0d90af-f38f-4dfa-8563-f6acf0ed5ed6 tempest-ProjectMemberTests-196532882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ca449f68-dd83-4335-b6ba-ee845f4dadad.c16d6a15-c20a-4c57-87aa-d983cc2499d5" returned: 0 in 0.379s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:08 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-ec0d90af-f38f-4dfa-8563-f6acf0ed5ed6 tempest-ProjectMemberTests-196532882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca449f68-dd83-4335-b6ba-ee845f4dadad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:38:08 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[c982afbf-dc51-4778-b695-5c9a776b98b5]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:38:08 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ec0d90af-f38f-4dfa-8563-f6acf0ed5ed6 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ca449f68-dd83-4335-b6ba-ee845f4dadad {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:08 devstack sudo[107663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ca449f68-dd83-4335-b6ba-ee845f4dadad Nov 03 20:38:08 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:09 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ec0d90af-f38f-4dfa-8563-f6acf0ed5ed6 tempest-ProjectMemberTests-196532882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ca449f68-dd83-4335-b6ba-ee845f4dadad" returned: 0 in 0.396s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ec0d90af-f38f-4dfa-8563-f6acf0ed5ed6 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ca449f68-dd83-4335-b6ba-ee845f4dadad.c16d6a15-c20a-4c57-87aa-d983cc2499d5 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:09 devstack sudo[107668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ca449f68-dd83-4335-b6ba-ee845f4dadad.c16d6a15-c20a-4c57-87aa-d983cc2499d5 Nov 03 20:38:09 devstack sudo[107668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:09 devstack sudo[107668]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ec0d90af-f38f-4dfa-8563-f6acf0ed5ed6 tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ca449f68-dd83-4335-b6ba-ee845f4dadad.c16d6a15-c20a-4c57-87aa-d983cc2499d5" returned: 0 in 0.387s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ec0d90af-f38f-4dfa-8563-f6acf0ed5ed6 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ca449f68-dd83-4335-b6ba-ee845f4dadad.c16d6a15-c20a-4c57-87aa-d983cc2499d5 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:09 devstack sudo[107673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ca449f68-dd83-4335-b6ba-ee845f4dadad.c16d6a15-c20a-4c57-87aa-d983cc2499d5 Nov 03 20:38:09 devstack sudo[107673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:09 devstack sudo[107673]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:09 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ec0d90af-f38f-4dfa-8563-f6acf0ed5ed6 tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ca449f68-dd83-4335-b6ba-ee845f4dadad.c16d6a15-c20a-4c57-87aa-d983cc2499d5" returned: 0 in 0.271s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:09 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ec0d90af-f38f-4dfa-8563-f6acf0ed5ed6 tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-c16d6a15-c20a-4c57-87aa-d983cc2499d5" released by "_delete_snapshot" :: held 1.547s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:38:09 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ec0d90af-f38f-4dfa-8563-f6acf0ed5ed6 tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-ca449f68-dd83-4335-b6ba-ee845f4dadad" released by "delete_snapshot" :: held 1.569s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:38:09 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-ec0d90af-f38f-4dfa-8563-f6acf0ed5ed6 tempest-ProjectMemberTests-196532882 None] Created reservations ['4908d79c-90f6-4d09-96c1-2fd4b7eea275', '367f91fa-9449-4c76-b231-4373d558594d', 'cf5bedf4-d474-48c6-a14f-1e72bc7bfe98', '9cf65091-f43f-4e8c-a5df-b02faece892d'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:38:09 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-ec0d90af-f38f-4dfa-8563-f6acf0ed5ed6 tempest-ProjectMemberTests-196532882 None] Delete snapshot completed successfully. Nov 03 20:38:09 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ec0d90af-f38f-4dfa-8563-f6acf0ed5ed6 tempest-ProjectMemberTests-196532882 None] Lock "cinder-c16d6a15-c20a-4c57-87aa-d983cc2499d5-delete_snapshot" released by "delete_snapshot" :: held 1.722s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:38:10 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1e2ec6c6-216e-495e-b7b4-4a15757ff303 tempest-ProjectMemberTests-196532882 None] Acquiring lock "cinder-ca449f68-dd83-4335-b6ba-ee845f4dadad-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:38:10 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1e2ec6c6-216e-495e-b7b4-4a15757ff303 tempest-ProjectMemberTests-196532882 None] Lock "cinder-ca449f68-dd83-4335-b6ba-ee845f4dadad-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:38:10 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1e2ec6c6-216e-495e-b7b4-4a15757ff303 tempest-ProjectMemberTests-196532882 None] Acquiring lock "cinder-quobyte-ca449f68-dd83-4335-b6ba-ee845f4dadad" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:38:10 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1e2ec6c6-216e-495e-b7b4-4a15757ff303 tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-ca449f68-dd83-4335-b6ba-ee845f4dadad" acquired by "delete_volume" :: waited 0.016s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:38:10 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2c0160-9b27-4f5e-97da-ca49a47faa22]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:38:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1e2ec6c6-216e-495e-b7b4-4a15757ff303 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ca449f68-dd83-4335-b6ba-ee845f4dadad {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:10 devstack sudo[107676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ca449f68-dd83-4335-b6ba-ee845f4dadad Nov 03 20:38:10 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:10 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1e2ec6c6-216e-495e-b7b4-4a15757ff303 tempest-ProjectMemberTests-196532882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ca449f68-dd83-4335-b6ba-ee845f4dadad" returned: 0 in 0.355s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:10 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1e2ec6c6-216e-495e-b7b4-4a15757ff303 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ca449f68-dd83-4335-b6ba-ee845f4dadad {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:10 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ca449f68-dd83-4335-b6ba-ee845f4dadad Nov 03 20:38:10 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:11 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1e2ec6c6-216e-495e-b7b4-4a15757ff303 tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ca449f68-dd83-4335-b6ba-ee845f4dadad" returned: 0 in 0.252s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:11 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1e2ec6c6-216e-495e-b7b4-4a15757ff303 tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-ca449f68-dd83-4335-b6ba-ee845f4dadad" released by "delete_volume" :: held 0.670s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:38:11 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-1e2ec6c6-216e-495e-b7b4-4a15757ff303 tempest-ProjectMemberTests-196532882 None] Created reservations ['cecaa792-b980-4efa-bee2-a65123b58777', 'cca70752-685d-4f72-975a-bc1ef860f111', '34b45617-2609-46ad-861b-74d1f90f711f', '720a0d1c-b57a-4dab-8ee0-ec55c116afe9'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:38:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1e2ec6c6-216e-495e-b7b4-4a15757ff303 tempest-ProjectMemberTests-196532882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:38:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1e2ec6c6-216e-495e-b7b4-4a15757ff303 tempest-ProjectMemberTests-196532882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:38:11 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-1e2ec6c6-216e-495e-b7b4-4a15757ff303 tempest-ProjectMemberTests-196532882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:38:11 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-1e2ec6c6-216e-495e-b7b4-4a15757ff303 tempest-ProjectMemberTests-196532882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:38:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1e2ec6c6-216e-495e-b7b4-4a15757ff303 tempest-ProjectMemberTests-196532882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:38:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1e2ec6c6-216e-495e-b7b4-4a15757ff303 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:11 devstack sudo[107684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:38:11 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:11 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1e2ec6c6-216e-495e-b7b4-4a15757ff303 tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.290s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:11 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-1e2ec6c6-216e-495e-b7b4-4a15757ff303 tempest-ProjectMemberTests-196532882 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:38:11 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-1e2ec6c6-216e-495e-b7b4-4a15757ff303 tempest-ProjectMemberTests-196532882 None] Deleted volume successfully. Nov 03 20:38:11 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b8ef803-9cc5-452d-a797-6d634b20b1fa tempest-ProjectReaderTests-1519980124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:38:11 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1b8ef803-9cc5-452d-a797-6d634b20b1fa tempest-ProjectReaderTests-1519980124 None] Flow 'volume_create_manager' (b25437c7-f090-4619-b70c-28e32160ab42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:38:11 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1b8ef803-9cc5-452d-a797-6d634b20b1fa tempest-ProjectReaderTests-1519980124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (218fbb4d-540f-4b30-a0c0-cd2bb0bc8aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:11 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1b8ef803-9cc5-452d-a797-6d634b20b1fa tempest-ProjectReaderTests-1519980124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (218fbb4d-540f-4b30-a0c0-cd2bb0bc8aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:38:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1896820017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b1fe190-c2a4-4eed-95af-9d2a9f993c15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc84f22a05f74f299d81cd0b915dad09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:38:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:38:12Z,use_quota=True,user_id='26b8c0ed2b5b4133aeb4bd68172ffadc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:11 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1b8ef803-9cc5-452d-a797-6d634b20b1fa tempest-ProjectReaderTests-1519980124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eee72f3-d69e-44d6-962f-dbbc25131663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:11 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1b8ef803-9cc5-452d-a797-6d634b20b1fa tempest-ProjectReaderTests-1519980124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eee72f3-d69e-44d6-962f-dbbc25131663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:11 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1b8ef803-9cc5-452d-a797-6d634b20b1fa tempest-ProjectReaderTests-1519980124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17caa09b-dc8e-4d6f-abab-3ec272e804b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:11 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1b8ef803-9cc5-452d-a797-6d634b20b1fa tempest-ProjectReaderTests-1519980124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17caa09b-dc8e-4d6f-abab-3ec272e804b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b1fe190-c2a4-4eed-95af-9d2a9f993c15', 'volume_name': 'volume-2b1fe190-c2a4-4eed-95af-9d2a9f993c15', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:11 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1b8ef803-9cc5-452d-a797-6d634b20b1fa tempest-ProjectReaderTests-1519980124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22d6e6d1-9410-4eb1-bce7-64dd4bc120e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:11 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1b8ef803-9cc5-452d-a797-6d634b20b1fa tempest-ProjectReaderTests-1519980124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22d6e6d1-9410-4eb1-bce7-64dd4bc120e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:11 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1b8ef803-9cc5-452d-a797-6d634b20b1fa tempest-ProjectReaderTests-1519980124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5f97d76-3ce2-4e45-b5bf-e35470b7b88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:11 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-1b8ef803-9cc5-452d-a797-6d634b20b1fa tempest-ProjectReaderTests-1519980124 None] Volume 2b1fe190-c2a4-4eed-95af-9d2a9f993c15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b1fe190-c2a4-4eed-95af-9d2a9f993c15', 'volume_size': 1} Nov 03 20:38:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1b8ef803-9cc5-452d-a797-6d634b20b1fa tempest-ProjectReaderTests-1519980124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:38:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1b8ef803-9cc5-452d-a797-6d634b20b1fa tempest-ProjectReaderTests-1519980124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:38:11 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-1b8ef803-9cc5-452d-a797-6d634b20b1fa tempest-ProjectReaderTests-1519980124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:38:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1896820017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b1fe190-c2a4-4eed-95af-9d2a9f993c15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc84f22a05f74f299d81cd0b915dad09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:38:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:38:12Z,use_quota=True,user_id='26b8c0ed2b5b4133aeb4bd68172ffadc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:38:11 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-1b8ef803-9cc5-452d-a797-6d634b20b1fa tempest-ProjectReaderTests-1519980124 None] Creating volume 2b1fe190-c2a4-4eed-95af-9d2a9f993c15 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:38:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1b8ef803-9cc5-452d-a797-6d634b20b1fa tempest-ProjectReaderTests-1519980124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:38:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1b8ef803-9cc5-452d-a797-6d634b20b1fa tempest-ProjectReaderTests-1519980124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:38:11 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-1b8ef803-9cc5-452d-a797-6d634b20b1fa tempest-ProjectReaderTests-1519980124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:38:11 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-1b8ef803-9cc5-452d-a797-6d634b20b1fa tempest-ProjectReaderTests-1519980124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:38:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1b8ef803-9cc5-452d-a797-6d634b20b1fa tempest-ProjectReaderTests-1519980124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:38:11 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-1b8ef803-9cc5-452d-a797-6d634b20b1fa tempest-ProjectReaderTests-1519980124 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:38:11 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-1b8ef803-9cc5-452d-a797-6d634b20b1fa tempest-ProjectReaderTests-1519980124 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:38:11 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1b8ef803-9cc5-452d-a797-6d634b20b1fa tempest-ProjectReaderTests-1519980124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2b1fe190-c2a4-4eed-95af-9d2a9f993c15 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:11 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-1e2ec6c6-216e-495e-b7b4-4a15757ff303 tempest-ProjectMemberTests-196532882 None] Lock "cinder-ca449f68-dd83-4335-b6ba-ee845f4dadad-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:38:11 devstack sudo[107687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2b1fe190-c2a4-4eed-95af-9d2a9f993c15 1073741824 Nov 03 20:38:11 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:12 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-49ea2b99-5cd9-4ef2-b4d3-d73815209fd5 tempest-ProjectMemberTests-196532882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:38:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-49ea2b99-5cd9-4ef2-b4d3-d73815209fd5 tempest-ProjectMemberTests-196532882 None] Flow 'volume_create_manager' (17e38c1a-566b-43c0-8ae4-652422b0da2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:38:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-49ea2b99-5cd9-4ef2-b4d3-d73815209fd5 tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1576be1e-0417-4656-9b95-4bc3d243bdfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-49ea2b99-5cd9-4ef2-b4d3-d73815209fd5 tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1576be1e-0417-4656-9b95-4bc3d243bdfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:38:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1026776595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=345a4f4b-bc80-40d1-87e4-f0fb78cc6057,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd20413f6d5649da828c1f0bf51455d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:38:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:38:12Z,use_quota=True,user_id='595eaffd7e764ae6b07e6aba8405d447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-49ea2b99-5cd9-4ef2-b4d3-d73815209fd5 tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45e743ed-e402-4a24-859c-f71ba3c8d599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-49ea2b99-5cd9-4ef2-b4d3-d73815209fd5 tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45e743ed-e402-4a24-859c-f71ba3c8d599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-49ea2b99-5cd9-4ef2-b4d3-d73815209fd5 tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16939dfa-d540-4869-b605-291abcc30615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-49ea2b99-5cd9-4ef2-b4d3-d73815209fd5 tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16939dfa-d540-4869-b605-291abcc30615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '345a4f4b-bc80-40d1-87e4-f0fb78cc6057', 'volume_name': 'volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-49ea2b99-5cd9-4ef2-b4d3-d73815209fd5 tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39c3f6ac-7437-4331-91f2-250580a3a07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-49ea2b99-5cd9-4ef2-b4d3-d73815209fd5 tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39c3f6ac-7437-4331-91f2-250580a3a07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-49ea2b99-5cd9-4ef2-b4d3-d73815209fd5 tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d66c6e70-1ea5-4bae-93d9-de0ce3a83e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:12 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-49ea2b99-5cd9-4ef2-b4d3-d73815209fd5 tempest-ProjectMemberTests-196532882 None] Volume 345a4f4b-bc80-40d1-87e4-f0fb78cc6057: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057', 'volume_size': 1} Nov 03 20:38:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-49ea2b99-5cd9-4ef2-b4d3-d73815209fd5 tempest-ProjectMemberTests-196532882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:38:12 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1b8ef803-9cc5-452d-a797-6d634b20b1fa tempest-ProjectReaderTests-1519980124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2b1fe190-c2a4-4eed-95af-9d2a9f993c15 1073741824" returned: 0 in 0.456s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1b8ef803-9cc5-452d-a797-6d634b20b1fa tempest-ProjectReaderTests-1519980124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2b1fe190-c2a4-4eed-95af-9d2a9f993c15 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:12 devstack sudo[107693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2b1fe190-c2a4-4eed-95af-9d2a9f993c15 Nov 03 20:38:12 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:12 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-1b8ef803-9cc5-452d-a797-6d634b20b1fa tempest-ProjectReaderTests-1519980124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2b1fe190-c2a4-4eed-95af-9d2a9f993c15" returned: 0 in 0.249s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:12 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-1b8ef803-9cc5-452d-a797-6d634b20b1fa tempest-ProjectReaderTests-1519980124 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:38:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-1b8ef803-9cc5-452d-a797-6d634b20b1fa tempest-ProjectReaderTests-1519980124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:38:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-49ea2b99-5cd9-4ef2-b4d3-d73815209fd5 tempest-ProjectMemberTests-196532882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.296s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:38:12 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-49ea2b99-5cd9-4ef2-b4d3-d73815209fd5 tempest-ProjectMemberTests-196532882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:38:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1026776595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=345a4f4b-bc80-40d1-87e4-f0fb78cc6057,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd20413f6d5649da828c1f0bf51455d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:38:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:38:12Z,use_quota=True,user_id='595eaffd7e764ae6b07e6aba8405d447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:38:12 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-49ea2b99-5cd9-4ef2-b4d3-d73815209fd5 tempest-ProjectMemberTests-196532882 None] Creating volume 345a4f4b-bc80-40d1-87e4-f0fb78cc6057 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:38:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-49ea2b99-5cd9-4ef2-b4d3-d73815209fd5 tempest-ProjectMemberTests-196532882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:38:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-49ea2b99-5cd9-4ef2-b4d3-d73815209fd5 tempest-ProjectMemberTests-196532882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:38:12 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-49ea2b99-5cd9-4ef2-b4d3-d73815209fd5 tempest-ProjectMemberTests-196532882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:38:12 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-49ea2b99-5cd9-4ef2-b4d3-d73815209fd5 tempest-ProjectMemberTests-196532882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:38:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-49ea2b99-5cd9-4ef2-b4d3-d73815209fd5 tempest-ProjectMemberTests-196532882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:38:12 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-49ea2b99-5cd9-4ef2-b4d3-d73815209fd5 tempest-ProjectMemberTests-196532882 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:38:12 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-49ea2b99-5cd9-4ef2-b4d3-d73815209fd5 tempest-ProjectMemberTests-196532882 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:38:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-49ea2b99-5cd9-4ef2-b4d3-d73815209fd5 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1b8ef803-9cc5-452d-a797-6d634b20b1fa tempest-ProjectReaderTests-1519980124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5f97d76-3ce2-4e45-b5bf-e35470b7b88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b1fe190-c2a4-4eed-95af-9d2a9f993c15', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:12 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057 1073741824 Nov 03 20:38:12 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1b8ef803-9cc5-452d-a797-6d634b20b1fa tempest-ProjectReaderTests-1519980124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (886856c8-7003-40e0-babf-98403c193c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:12 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-1b8ef803-9cc5-452d-a797-6d634b20b1fa tempest-ProjectReaderTests-1519980124 None] Volume volume-2b1fe190-c2a4-4eed-95af-9d2a9f993c15 (2b1fe190-c2a4-4eed-95af-9d2a9f993c15): created successfully Nov 03 20:38:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1b8ef803-9cc5-452d-a797-6d634b20b1fa tempest-ProjectReaderTests-1519980124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (886856c8-7003-40e0-babf-98403c193c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-1b8ef803-9cc5-452d-a797-6d634b20b1fa tempest-ProjectReaderTests-1519980124 None] Flow 'volume_create_manager' (b25437c7-f090-4619-b70c-28e32160ab42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:38:12 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-1b8ef803-9cc5-452d-a797-6d634b20b1fa tempest-ProjectReaderTests-1519980124 None] Created volume successfully. Nov 03 20:38:12 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-49ea2b99-5cd9-4ef2-b4d3-d73815209fd5 tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057 1073741824" returned: 0 in 0.418s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-49ea2b99-5cd9-4ef2-b4d3-d73815209fd5 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:12 devstack sudo[107703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057 Nov 03 20:38:12 devstack sudo[107703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:13 devstack sudo[107703]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-49ea2b99-5cd9-4ef2-b4d3-d73815209fd5 tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057" returned: 0 in 0.241s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:13 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-49ea2b99-5cd9-4ef2-b4d3-d73815209fd5 tempest-ProjectMemberTests-196532882 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:38:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-49ea2b99-5cd9-4ef2-b4d3-d73815209fd5 tempest-ProjectMemberTests-196532882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:38:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-49ea2b99-5cd9-4ef2-b4d3-d73815209fd5 tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d66c6e70-1ea5-4bae-93d9-de0ce3a83e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-49ea2b99-5cd9-4ef2-b4d3-d73815209fd5 tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2d53691-779d-42da-8976-5beadf058567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:13 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-49ea2b99-5cd9-4ef2-b4d3-d73815209fd5 tempest-ProjectMemberTests-196532882 None] Volume volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057 (345a4f4b-bc80-40d1-87e4-f0fb78cc6057): created successfully Nov 03 20:38:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-49ea2b99-5cd9-4ef2-b4d3-d73815209fd5 tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2d53691-779d-42da-8976-5beadf058567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-49ea2b99-5cd9-4ef2-b4d3-d73815209fd5 tempest-ProjectMemberTests-196532882 None] Flow 'volume_create_manager' (17e38c1a-566b-43c0-8ae4-652422b0da2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:38:13 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-49ea2b99-5cd9-4ef2-b4d3-d73815209fd5 tempest-ProjectMemberTests-196532882 None] Created volume successfully. Nov 03 20:38:13 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ee6bb6a0-8705-4002-b1bd-3ba812661853 tempest-ProjectReaderTests-1519980124 None] Acquiring lock "cinder-2b1fe190-c2a4-4eed-95af-9d2a9f993c15-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:38:13 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ee6bb6a0-8705-4002-b1bd-3ba812661853 tempest-ProjectReaderTests-1519980124 None] Lock "cinder-2b1fe190-c2a4-4eed-95af-9d2a9f993c15-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:38:13 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ee6bb6a0-8705-4002-b1bd-3ba812661853 tempest-ProjectReaderTests-1519980124 None] Acquiring lock "cinder-quobyte-2b1fe190-c2a4-4eed-95af-9d2a9f993c15" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:38:13 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ee6bb6a0-8705-4002-b1bd-3ba812661853 tempest-ProjectReaderTests-1519980124 None] Lock "cinder-quobyte-2b1fe190-c2a4-4eed-95af-9d2a9f993c15" acquired by "delete_volume" :: waited 0.017s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:38:13 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc772707-e66f-4f7a-ad5c-f2a4e12209ff]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:38:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ee6bb6a0-8705-4002-b1bd-3ba812661853 tempest-ProjectReaderTests-1519980124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2b1fe190-c2a4-4eed-95af-9d2a9f993c15 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:14 devstack sudo[107740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2b1fe190-c2a4-4eed-95af-9d2a9f993c15 Nov 03 20:38:14 devstack sudo[107740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b19b8b7a-8e70-4260-bff6-6344f32a6764 tempest-ProjectMemberTests-196532882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:38:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b19b8b7a-8e70-4260-bff6-6344f32a6764 tempest-ProjectMemberTests-196532882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:38:14 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-b19b8b7a-8e70-4260-bff6-6344f32a6764 tempest-ProjectMemberTests-196532882 None] Creating offline snapshot 54490f61-6b71-4e6b-b5b8-ed6f5f3e1f83 of volume 345a4f4b-bc80-40d1-87e4-f0fb78cc6057 {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:38:14 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc20c77-dff0-4bee-8e79-723e835d102f]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:38:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b19b8b7a-8e70-4260-bff6-6344f32a6764 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:14 devstack sudo[107740]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ee6bb6a0-8705-4002-b1bd-3ba812661853 tempest-ProjectReaderTests-1519980124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2b1fe190-c2a4-4eed-95af-9d2a9f993c15" returned: 0 in 0.459s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ee6bb6a0-8705-4002-b1bd-3ba812661853 tempest-ProjectReaderTests-1519980124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2b1fe190-c2a4-4eed-95af-9d2a9f993c15 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:14 devstack sudo[107748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2b1fe190-c2a4-4eed-95af-9d2a9f993c15 Nov 03 20:38:14 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:14 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057 Nov 03 20:38:14 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:14 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ee6bb6a0-8705-4002-b1bd-3ba812661853 tempest-ProjectReaderTests-1519980124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-2b1fe190-c2a4-4eed-95af-9d2a9f993c15" returned: 0 in 0.268s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:14 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ee6bb6a0-8705-4002-b1bd-3ba812661853 tempest-ProjectReaderTests-1519980124 None] Lock "cinder-quobyte-2b1fe190-c2a4-4eed-95af-9d2a9f993c15" released by "delete_volume" :: held 0.773s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:38:14 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-ee6bb6a0-8705-4002-b1bd-3ba812661853 tempest-ProjectReaderTests-1519980124 None] Created reservations ['6f124a9d-ec78-41dd-9710-bbc194e5da61', 'aeeec300-adcd-4eff-9ab8-cec1246e34ec', '9d680174-21f7-41e1-b850-7be3fd9e17b9', 'a360c0d0-e2be-4ba6-b7e7-b6a7facbb0c5'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:38:14 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b19b8b7a-8e70-4260-bff6-6344f32a6764 tempest-ProjectMemberTests-196532882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057" returned: 0 in 0.381s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b19b8b7a-8e70-4260-bff6-6344f32a6764 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057.54490f61-6b71-4e6b-b5b8-ed6f5f3e1f83 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:14 devstack sudo[107756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057.54490f61-6b71-4e6b-b5b8-ed6f5f3e1f83 1G Nov 03 20:38:14 devstack sudo[107756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ee6bb6a0-8705-4002-b1bd-3ba812661853 tempest-ProjectReaderTests-1519980124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:38:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ee6bb6a0-8705-4002-b1bd-3ba812661853 tempest-ProjectReaderTests-1519980124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:38:14 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-ee6bb6a0-8705-4002-b1bd-3ba812661853 tempest-ProjectReaderTests-1519980124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:38:14 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-ee6bb6a0-8705-4002-b1bd-3ba812661853 tempest-ProjectReaderTests-1519980124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:38:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ee6bb6a0-8705-4002-b1bd-3ba812661853 tempest-ProjectReaderTests-1519980124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:38:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ee6bb6a0-8705-4002-b1bd-3ba812661853 tempest-ProjectReaderTests-1519980124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:14 devstack sudo[107758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:38:14 devstack sudo[107758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:15 devstack sudo[107758]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ee6bb6a0-8705-4002-b1bd-3ba812661853 tempest-ProjectReaderTests-1519980124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.266s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:15 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-ee6bb6a0-8705-4002-b1bd-3ba812661853 tempest-ProjectReaderTests-1519980124 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:38:15 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-ee6bb6a0-8705-4002-b1bd-3ba812661853 tempest-ProjectReaderTests-1519980124 None] Deleted volume successfully. Nov 03 20:38:15 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-ee6bb6a0-8705-4002-b1bd-3ba812661853 tempest-ProjectReaderTests-1519980124 None] Lock "cinder-2b1fe190-c2a4-4eed-95af-9d2a9f993c15-delete_volume" released by "delete_volume" :: held 1.282s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:38:15 devstack sudo[107756]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b19b8b7a-8e70-4260-bff6-6344f32a6764 tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057.54490f61-6b71-4e6b-b5b8-ed6f5f3e1f83 1G" returned: 0 in 0.469s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b19b8b7a-8e70-4260-bff6-6344f32a6764 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057.54490f61-6b71-4e6b-b5b8-ed6f5f3e1f83 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:15 devstack sudo[107767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057.54490f61-6b71-4e6b-b5b8-ed6f5f3e1f83 Nov 03 20:38:15 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:15 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-c02a0f35-9962-4a9e-93fb-ce28694cba5f tempest-ProjectReaderTests-1519980124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:38:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c02a0f35-9962-4a9e-93fb-ce28694cba5f tempest-ProjectReaderTests-1519980124 None] Flow 'volume_create_manager' (4c7875de-2c61-43fa-ae19-0c7272b22dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:38:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c02a0f35-9962-4a9e-93fb-ce28694cba5f tempest-ProjectReaderTests-1519980124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc3e5c68-c889-4b5e-8da4-bb25488b67fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c02a0f35-9962-4a9e-93fb-ce28694cba5f tempest-ProjectReaderTests-1519980124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc3e5c68-c889-4b5e-8da4-bb25488b67fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-478178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09047c4c-3b38-4141-9929-3823e9debf99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc84f22a05f74f299d81cd0b915dad09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:38:15Z,use_quota=True,user_id='26b8c0ed2b5b4133aeb4bd68172ffadc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c02a0f35-9962-4a9e-93fb-ce28694cba5f tempest-ProjectReaderTests-1519980124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aea0aa17-ea5a-43af-857d-343eabfdaf1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c02a0f35-9962-4a9e-93fb-ce28694cba5f tempest-ProjectReaderTests-1519980124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aea0aa17-ea5a-43af-857d-343eabfdaf1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c02a0f35-9962-4a9e-93fb-ce28694cba5f tempest-ProjectReaderTests-1519980124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dd9fd37-d62d-4c1f-a6e4-fcc162ea6a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c02a0f35-9962-4a9e-93fb-ce28694cba5f tempest-ProjectReaderTests-1519980124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dd9fd37-d62d-4c1f-a6e4-fcc162ea6a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09047c4c-3b38-4141-9929-3823e9debf99', 'volume_name': 'volume-09047c4c-3b38-4141-9929-3823e9debf99', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c02a0f35-9962-4a9e-93fb-ce28694cba5f tempest-ProjectReaderTests-1519980124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cb64145-f40b-416d-8f52-9a193ca697bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:15 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c02a0f35-9962-4a9e-93fb-ce28694cba5f tempest-ProjectReaderTests-1519980124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cb64145-f40b-416d-8f52-9a193ca697bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:15 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c02a0f35-9962-4a9e-93fb-ce28694cba5f tempest-ProjectReaderTests-1519980124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8612732b-dcd3-4942-a7e5-83c640c8b6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:15 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-c02a0f35-9962-4a9e-93fb-ce28694cba5f tempest-ProjectReaderTests-1519980124 None] Volume 09047c4c-3b38-4141-9929-3823e9debf99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09047c4c-3b38-4141-9929-3823e9debf99', 'volume_size': 1} Nov 03 20:38:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c02a0f35-9962-4a9e-93fb-ce28694cba5f tempest-ProjectReaderTests-1519980124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:38:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b19b8b7a-8e70-4260-bff6-6344f32a6764 tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057.54490f61-6b71-4e6b-b5b8-ed6f5f3e1f83" returned: 0 in 0.341s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:15 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-b19b8b7a-8e70-4260-bff6-6344f32a6764 tempest-ProjectMemberTests-196532882 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057.54490f61-6b71-4e6b-b5b8-ed6f5f3e1f83 is being set with open permissions: ugo+rw Nov 03 20:38:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b19b8b7a-8e70-4260-bff6-6344f32a6764 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057.54490f61-6b71-4e6b-b5b8-ed6f5f3e1f83 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:15 devstack sudo[107772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057.54490f61-6b71-4e6b-b5b8-ed6f5f3e1f83 Nov 03 20:38:15 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:15 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b19b8b7a-8e70-4260-bff6-6344f32a6764 tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057.54490f61-6b71-4e6b-b5b8-ed6f5f3e1f83" returned: 0 in 0.261s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b19b8b7a-8e70-4260-bff6-6344f32a6764 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:15 devstack sudo[107775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057.info Nov 03 20:38:15 devstack sudo[107775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:16 devstack sudo[107775]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b19b8b7a-8e70-4260-bff6-6344f32a6764 tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057.info" returned: 0 in 0.243s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:16 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-b19b8b7a-8e70-4260-bff6-6344f32a6764 tempest-ProjectMemberTests-196532882 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057.info is being set with open permissions: ugo+rw Nov 03 20:38:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b19b8b7a-8e70-4260-bff6-6344f32a6764 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:16 devstack sudo[107778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057.info Nov 03 20:38:16 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:16 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-b19b8b7a-8e70-4260-bff6-6344f32a6764 tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057.info" returned: 0 in 0.241s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-b19b8b7a-8e70-4260-bff6-6344f32a6764 tempest-ProjectMemberTests-196532882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.014s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:38:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c02a0f35-9962-4a9e-93fb-ce28694cba5f tempest-ProjectReaderTests-1519980124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.794s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:38:16 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c02a0f35-9962-4a9e-93fb-ce28694cba5f tempest-ProjectReaderTests-1519980124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-478178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09047c4c-3b38-4141-9929-3823e9debf99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc84f22a05f74f299d81cd0b915dad09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:38:15Z,use_quota=True,user_id='26b8c0ed2b5b4133aeb4bd68172ffadc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:38:16 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-c02a0f35-9962-4a9e-93fb-ce28694cba5f tempest-ProjectReaderTests-1519980124 None] Creating volume 09047c4c-3b38-4141-9929-3823e9debf99 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:38:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c02a0f35-9962-4a9e-93fb-ce28694cba5f tempest-ProjectReaderTests-1519980124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:38:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c02a0f35-9962-4a9e-93fb-ce28694cba5f tempest-ProjectReaderTests-1519980124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:38:16 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c02a0f35-9962-4a9e-93fb-ce28694cba5f tempest-ProjectReaderTests-1519980124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:38:16 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c02a0f35-9962-4a9e-93fb-ce28694cba5f tempest-ProjectReaderTests-1519980124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:38:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c02a0f35-9962-4a9e-93fb-ce28694cba5f tempest-ProjectReaderTests-1519980124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:38:16 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c02a0f35-9962-4a9e-93fb-ce28694cba5f tempest-ProjectReaderTests-1519980124 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:38:16 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-c02a0f35-9962-4a9e-93fb-ce28694cba5f tempest-ProjectReaderTests-1519980124 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:38:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c02a0f35-9962-4a9e-93fb-ce28694cba5f tempest-ProjectReaderTests-1519980124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-09047c4c-3b38-4141-9929-3823e9debf99 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:16 devstack sudo[107781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-09047c4c-3b38-4141-9929-3823e9debf99 1073741824 Nov 03 20:38:16 devstack sudo[107781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:16 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-b19b8b7a-8e70-4260-bff6-6344f32a6764 tempest-ProjectMemberTests-196532882 None] Create snapshot completed successfully Nov 03 20:38:16 devstack sudo[107781]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c02a0f35-9962-4a9e-93fb-ce28694cba5f tempest-ProjectReaderTests-1519980124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-09047c4c-3b38-4141-9929-3823e9debf99 1073741824" returned: 0 in 0.409s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c02a0f35-9962-4a9e-93fb-ce28694cba5f tempest-ProjectReaderTests-1519980124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-09047c4c-3b38-4141-9929-3823e9debf99 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:16 devstack sudo[107786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-09047c4c-3b38-4141-9929-3823e9debf99 Nov 03 20:38:16 devstack sudo[107786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:17 devstack sudo[107786]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c02a0f35-9962-4a9e-93fb-ce28694cba5f tempest-ProjectReaderTests-1519980124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-09047c4c-3b38-4141-9929-3823e9debf99" returned: 0 in 0.239s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:17 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-c02a0f35-9962-4a9e-93fb-ce28694cba5f tempest-ProjectReaderTests-1519980124 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:38:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c02a0f35-9962-4a9e-93fb-ce28694cba5f tempest-ProjectReaderTests-1519980124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:38:17 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c02a0f35-9962-4a9e-93fb-ce28694cba5f tempest-ProjectReaderTests-1519980124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8612732b-dcd3-4942-a7e5-83c640c8b6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09047c4c-3b38-4141-9929-3823e9debf99', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:17 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c02a0f35-9962-4a9e-93fb-ce28694cba5f tempest-ProjectReaderTests-1519980124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34a3918d-bf40-48bd-8eb4-63fbded7009b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:17 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-c02a0f35-9962-4a9e-93fb-ce28694cba5f tempest-ProjectReaderTests-1519980124 None] Volume volume-09047c4c-3b38-4141-9929-3823e9debf99 (09047c4c-3b38-4141-9929-3823e9debf99): created successfully Nov 03 20:38:17 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c02a0f35-9962-4a9e-93fb-ce28694cba5f tempest-ProjectReaderTests-1519980124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34a3918d-bf40-48bd-8eb4-63fbded7009b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:17 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-c02a0f35-9962-4a9e-93fb-ce28694cba5f tempest-ProjectReaderTests-1519980124 None] Flow 'volume_create_manager' (4c7875de-2c61-43fa-ae19-0c7272b22dbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:38:17 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-c02a0f35-9962-4a9e-93fb-ce28694cba5f tempest-ProjectReaderTests-1519980124 None] Created volume successfully. Nov 03 20:38:17 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2604ead0-9e07-4248-9e0b-6d0826f38144 tempest-ProjectMemberTests-196532882 None] Acquiring lock "cinder-54490f61-6b71-4e6b-b5b8-ed6f5f3e1f83-delete_snapshot" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:38:17 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2604ead0-9e07-4248-9e0b-6d0826f38144 tempest-ProjectMemberTests-196532882 None] Lock "cinder-54490f61-6b71-4e6b-b5b8-ed6f5f3e1f83-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:38:17 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2604ead0-9e07-4248-9e0b-6d0826f38144 tempest-ProjectMemberTests-196532882 None] Acquiring lock "cinder-quobyte-345a4f4b-bc80-40d1-87e4-f0fb78cc6057" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:38:17 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2604ead0-9e07-4248-9e0b-6d0826f38144 tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-345a4f4b-bc80-40d1-87e4-f0fb78cc6057" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:38:17 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2604ead0-9e07-4248-9e0b-6d0826f38144 tempest-ProjectMemberTests-196532882 None] Acquiring lock "cinder-quobyte-54490f61-6b71-4e6b-b5b8-ed6f5f3e1f83" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:38:17 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6dd50116-7586-426e-bfd8-e4f3edc8d92b tempest-ProjectReaderTests-1519980124 None] Acquiring lock "cinder-09047c4c-3b38-4141-9929-3823e9debf99-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:38:17 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2604ead0-9e07-4248-9e0b-6d0826f38144 tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-54490f61-6b71-4e6b-b5b8-ed6f5f3e1f83" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:38:17 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-2604ead0-9e07-4248-9e0b-6d0826f38144 tempest-ProjectMemberTests-196532882 None] Deleting offline snapshot 54490f61-6b71-4e6b-b5b8-ed6f5f3e1f83 of volume 345a4f4b-bc80-40d1-87e4-f0fb78cc6057 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:38:17 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-2604ead0-9e07-4248-9e0b-6d0826f38144 tempest-ProjectMemberTests-196532882 None] snapshot_file for this snap is: volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057.54490f61-6b71-4e6b-b5b8-ed6f5f3e1f83 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:38:17 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6dd50116-7586-426e-bfd8-e4f3edc8d92b tempest-ProjectReaderTests-1519980124 None] Lock "cinder-09047c4c-3b38-4141-9929-3823e9debf99-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:38:17 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a29955-fc64-47ec-a908-4d5079046e41]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:38:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2604ead0-9e07-4248-9e0b-6d0826f38144 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057.54490f61-6b71-4e6b-b5b8-ed6f5f3e1f83 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:17 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6dd50116-7586-426e-bfd8-e4f3edc8d92b tempest-ProjectReaderTests-1519980124 None] Acquiring lock "cinder-quobyte-09047c4c-3b38-4141-9929-3823e9debf99" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:38:17 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6dd50116-7586-426e-bfd8-e4f3edc8d92b tempest-ProjectReaderTests-1519980124 None] Lock "cinder-quobyte-09047c4c-3b38-4141-9929-3823e9debf99" acquired by "delete_volume" :: waited 0.014s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:38:17 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[b828789d-454e-48ec-a811-81761c9754eb]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:38:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6dd50116-7586-426e-bfd8-e4f3edc8d92b tempest-ProjectReaderTests-1519980124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-09047c4c-3b38-4141-9929-3823e9debf99 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:17 devstack sudo[107789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057.54490f61-6b71-4e6b-b5b8-ed6f5f3e1f83 Nov 03 20:38:17 devstack sudo[107789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:17 devstack sudo[107790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-09047c4c-3b38-4141-9929-3823e9debf99 Nov 03 20:38:17 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:18 devstack sudo[107789]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2604ead0-9e07-4248-9e0b-6d0826f38144 tempest-ProjectMemberTests-196532882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057.54490f61-6b71-4e6b-b5b8-ed6f5f3e1f83" returned: 0 in 0.368s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:18 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-2604ead0-9e07-4248-9e0b-6d0826f38144 tempest-ProjectMemberTests-196532882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:38:18 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[6848bace-f800-4d62-b7d0-fb3dfc967ef2]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:38:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2604ead0-9e07-4248-9e0b-6d0826f38144 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:18 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6dd50116-7586-426e-bfd8-e4f3edc8d92b tempest-ProjectReaderTests-1519980124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-09047c4c-3b38-4141-9929-3823e9debf99" returned: 0 in 0.364s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6dd50116-7586-426e-bfd8-e4f3edc8d92b tempest-ProjectReaderTests-1519980124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-09047c4c-3b38-4141-9929-3823e9debf99 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:18 devstack sudo[107800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-09047c4c-3b38-4141-9929-3823e9debf99 Nov 03 20:38:18 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:18 devstack sudo[107799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057 Nov 03 20:38:18 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:18 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6dd50116-7586-426e-bfd8-e4f3edc8d92b tempest-ProjectReaderTests-1519980124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-09047c4c-3b38-4141-9929-3823e9debf99" returned: 0 in 0.246s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:18 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6dd50116-7586-426e-bfd8-e4f3edc8d92b tempest-ProjectReaderTests-1519980124 None] Lock "cinder-quobyte-09047c4c-3b38-4141-9929-3823e9debf99" released by "delete_volume" :: held 0.655s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:38:18 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-6dd50116-7586-426e-bfd8-e4f3edc8d92b tempest-ProjectReaderTests-1519980124 None] Created reservations ['f0487437-7be0-4027-8340-75cd18041f4a', '6b0a8995-32ca-416b-bd7e-d836ab26c65e', '23964fac-1580-4520-9eb2-8fdad16cc167', '9bb01e46-4eaa-481d-8e1e-c823d9e80a60'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:38:18 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2604ead0-9e07-4248-9e0b-6d0826f38144 tempest-ProjectMemberTests-196532882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057" returned: 0 in 0.378s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2604ead0-9e07-4248-9e0b-6d0826f38144 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057.54490f61-6b71-4e6b-b5b8-ed6f5f3e1f83 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:18 devstack sudo[107807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057.54490f61-6b71-4e6b-b5b8-ed6f5f3e1f83 Nov 03 20:38:18 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6dd50116-7586-426e-bfd8-e4f3edc8d92b tempest-ProjectReaderTests-1519980124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:38:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6dd50116-7586-426e-bfd8-e4f3edc8d92b tempest-ProjectReaderTests-1519980124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:38:18 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-6dd50116-7586-426e-bfd8-e4f3edc8d92b tempest-ProjectReaderTests-1519980124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:38:18 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-6dd50116-7586-426e-bfd8-e4f3edc8d92b tempest-ProjectReaderTests-1519980124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:38:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-6dd50116-7586-426e-bfd8-e4f3edc8d92b tempest-ProjectReaderTests-1519980124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:38:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6dd50116-7586-426e-bfd8-e4f3edc8d92b tempest-ProjectReaderTests-1519980124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:18 devstack sudo[107809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:38:18 devstack sudo[107809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:18 devstack sudo[107809]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-6dd50116-7586-426e-bfd8-e4f3edc8d92b tempest-ProjectReaderTests-1519980124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.277s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:18 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-6dd50116-7586-426e-bfd8-e4f3edc8d92b tempest-ProjectReaderTests-1519980124 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:38:18 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-6dd50116-7586-426e-bfd8-e4f3edc8d92b tempest-ProjectReaderTests-1519980124 None] Deleted volume successfully. Nov 03 20:38:18 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:18 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-6dd50116-7586-426e-bfd8-e4f3edc8d92b tempest-ProjectReaderTests-1519980124 None] Lock "cinder-09047c4c-3b38-4141-9929-3823e9debf99-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:38:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2604ead0-9e07-4248-9e0b-6d0826f38144 tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057.54490f61-6b71-4e6b-b5b8-ed6f5f3e1f83" returned: 0 in 0.401s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:18 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2604ead0-9e07-4248-9e0b-6d0826f38144 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057.54490f61-6b71-4e6b-b5b8-ed6f5f3e1f83 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:18 devstack sudo[107816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057.54490f61-6b71-4e6b-b5b8-ed6f5f3e1f83 Nov 03 20:38:18 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:19 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-2604ead0-9e07-4248-9e0b-6d0826f38144 tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057.54490f61-6b71-4e6b-b5b8-ed6f5f3e1f83" returned: 0 in 0.265s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:19 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2604ead0-9e07-4248-9e0b-6d0826f38144 tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-54490f61-6b71-4e6b-b5b8-ed6f5f3e1f83" released by "_delete_snapshot" :: held 1.533s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:38:19 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2604ead0-9e07-4248-9e0b-6d0826f38144 tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-345a4f4b-bc80-40d1-87e4-f0fb78cc6057" released by "delete_snapshot" :: held 1.565s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:38:19 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-2604ead0-9e07-4248-9e0b-6d0826f38144 tempest-ProjectMemberTests-196532882 None] Created reservations ['bfeb3239-527e-4cef-a8f4-ff5acf5629fb', '01bfed0a-af88-4f6f-a06e-cd13d00bdf87', '81edc33c-1534-4045-a977-a1bfdfe0f404', '3831a343-e2e0-42a5-b504-94ea59070c25'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:38:19 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-2604ead0-9e07-4248-9e0b-6d0826f38144 tempest-ProjectMemberTests-196532882 None] Delete snapshot completed successfully. Nov 03 20:38:19 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-2604ead0-9e07-4248-9e0b-6d0826f38144 tempest-ProjectMemberTests-196532882 None] Lock "cinder-54490f61-6b71-4e6b-b5b8-ed6f5f3e1f83-delete_snapshot" released by "delete_snapshot" :: held 1.726s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:38:19 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-19e42a56-ca35-41d0-a00e-bee2b3cd9b6e tempest-ProjectMemberTests-196532882 None] Acquiring lock "cinder-345a4f4b-bc80-40d1-87e4-f0fb78cc6057-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:38:19 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-19e42a56-ca35-41d0-a00e-bee2b3cd9b6e tempest-ProjectMemberTests-196532882 None] Lock "cinder-345a4f4b-bc80-40d1-87e4-f0fb78cc6057-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:38:19 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-19e42a56-ca35-41d0-a00e-bee2b3cd9b6e tempest-ProjectMemberTests-196532882 None] Acquiring lock "cinder-quobyte-345a4f4b-bc80-40d1-87e4-f0fb78cc6057" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:38:19 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-19e42a56-ca35-41d0-a00e-bee2b3cd9b6e tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-345a4f4b-bc80-40d1-87e4-f0fb78cc6057" acquired by "delete_volume" :: waited 0.015s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:38:19 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5efbea6-2236-4cc5-a213-3e0ebc06ac3e]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:38:19 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-19e42a56-ca35-41d0-a00e-bee2b3cd9b6e tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:19 devstack sudo[107819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057 Nov 03 20:38:19 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:20 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-19e42a56-ca35-41d0-a00e-bee2b3cd9b6e tempest-ProjectMemberTests-196532882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057" returned: 0 in 0.384s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-19e42a56-ca35-41d0-a00e-bee2b3cd9b6e tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:20 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057 Nov 03 20:38:20 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:20 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-19e42a56-ca35-41d0-a00e-bee2b3cd9b6e tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-345a4f4b-bc80-40d1-87e4-f0fb78cc6057" returned: 0 in 0.261s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:20 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-19e42a56-ca35-41d0-a00e-bee2b3cd9b6e tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-345a4f4b-bc80-40d1-87e4-f0fb78cc6057" released by "delete_volume" :: held 0.720s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:38:20 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-19e42a56-ca35-41d0-a00e-bee2b3cd9b6e tempest-ProjectMemberTests-196532882 None] Created reservations ['a54524b6-cf21-4e8d-94c0-0497c64ee9ea', 'd594d6a6-39a9-4be0-8621-e82802ee0358', '703de2d4-2e9e-4693-a77a-048d0b4d5e36', '22a4ab07-40a7-4c52-97bb-eb7c424d1658'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:38:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-19e42a56-ca35-41d0-a00e-bee2b3cd9b6e tempest-ProjectMemberTests-196532882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:38:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-19e42a56-ca35-41d0-a00e-bee2b3cd9b6e tempest-ProjectMemberTests-196532882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:38:20 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-19e42a56-ca35-41d0-a00e-bee2b3cd9b6e tempest-ProjectMemberTests-196532882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:38:20 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-19e42a56-ca35-41d0-a00e-bee2b3cd9b6e tempest-ProjectMemberTests-196532882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:38:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-19e42a56-ca35-41d0-a00e-bee2b3cd9b6e tempest-ProjectMemberTests-196532882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:38:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-19e42a56-ca35-41d0-a00e-bee2b3cd9b6e tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:20 devstack sudo[107827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:38:20 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:20 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:20 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-19e42a56-ca35-41d0-a00e-bee2b3cd9b6e tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.276s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:20 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-19e42a56-ca35-41d0-a00e-bee2b3cd9b6e tempest-ProjectMemberTests-196532882 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:38:20 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-19e42a56-ca35-41d0-a00e-bee2b3cd9b6e tempest-ProjectMemberTests-196532882 None] Deleted volume successfully. Nov 03 20:38:20 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-19e42a56-ca35-41d0-a00e-bee2b3cd9b6e tempest-ProjectMemberTests-196532882 None] Lock "cinder-345a4f4b-bc80-40d1-87e4-f0fb78cc6057-delete_volume" released by "delete_volume" :: held 1.228s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:38:21 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-776df76b-5157-41d3-a1d1-9d1d1a6ab35f tempest-ProjectMemberTests-196532882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:38:21 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-776df76b-5157-41d3-a1d1-9d1d1a6ab35f tempest-ProjectMemberTests-196532882 None] Flow 'volume_create_manager' (9569a7fc-0b65-416a-911d-f1a21e7c27b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:38:21 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-776df76b-5157-41d3-a1d1-9d1d1a6ab35f tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5627cb8e-4598-46df-8323-4fb885ea231b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:21 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-776df76b-5157-41d3-a1d1-9d1d1a6ab35f tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5627cb8e-4598-46df-8323-4fb885ea231b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:38:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1961520710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba355e61-d7f8-47a5-9f8b-6eb022293a9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd20413f6d5649da828c1f0bf51455d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:38:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:38:21Z,use_quota=True,user_id='595eaffd7e764ae6b07e6aba8405d447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:21 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-776df76b-5157-41d3-a1d1-9d1d1a6ab35f tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aa099cf-53b6-4628-ae42-695797bb6497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:21 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-776df76b-5157-41d3-a1d1-9d1d1a6ab35f tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aa099cf-53b6-4628-ae42-695797bb6497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:21 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-776df76b-5157-41d3-a1d1-9d1d1a6ab35f tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b5b51a0-258c-4029-aa63-67deb7b5555a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:21 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-776df76b-5157-41d3-a1d1-9d1d1a6ab35f tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b5b51a0-258c-4029-aa63-67deb7b5555a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba355e61-d7f8-47a5-9f8b-6eb022293a9f', 'volume_name': 'volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:21 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-776df76b-5157-41d3-a1d1-9d1d1a6ab35f tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ee147f2-e041-412d-85a4-bb8bc04e9f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:21 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-776df76b-5157-41d3-a1d1-9d1d1a6ab35f tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ee147f2-e041-412d-85a4-bb8bc04e9f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:21 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-776df76b-5157-41d3-a1d1-9d1d1a6ab35f tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (003cbac1-30d4-432e-8750-7a91fc03cf73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:21 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-776df76b-5157-41d3-a1d1-9d1d1a6ab35f tempest-ProjectMemberTests-196532882 None] Volume ba355e61-d7f8-47a5-9f8b-6eb022293a9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f', 'volume_size': 1} Nov 03 20:38:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-776df76b-5157-41d3-a1d1-9d1d1a6ab35f tempest-ProjectMemberTests-196532882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:38:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-776df76b-5157-41d3-a1d1-9d1d1a6ab35f tempest-ProjectMemberTests-196532882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:38:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-776df76b-5157-41d3-a1d1-9d1d1a6ab35f tempest-ProjectMemberTests-196532882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:38:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1961520710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba355e61-d7f8-47a5-9f8b-6eb022293a9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd20413f6d5649da828c1f0bf51455d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:38:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:38:21Z,use_quota=True,user_id='595eaffd7e764ae6b07e6aba8405d447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:38:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-776df76b-5157-41d3-a1d1-9d1d1a6ab35f tempest-ProjectMemberTests-196532882 None] Creating volume ba355e61-d7f8-47a5-9f8b-6eb022293a9f {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:38:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-776df76b-5157-41d3-a1d1-9d1d1a6ab35f tempest-ProjectMemberTests-196532882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:38:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-776df76b-5157-41d3-a1d1-9d1d1a6ab35f tempest-ProjectMemberTests-196532882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:38:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-776df76b-5157-41d3-a1d1-9d1d1a6ab35f tempest-ProjectMemberTests-196532882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:38:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-776df76b-5157-41d3-a1d1-9d1d1a6ab35f tempest-ProjectMemberTests-196532882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:38:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-776df76b-5157-41d3-a1d1-9d1d1a6ab35f tempest-ProjectMemberTests-196532882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:38:21 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-776df76b-5157-41d3-a1d1-9d1d1a6ab35f tempest-ProjectMemberTests-196532882 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:38:21 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-776df76b-5157-41d3-a1d1-9d1d1a6ab35f tempest-ProjectMemberTests-196532882 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:38:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-776df76b-5157-41d3-a1d1-9d1d1a6ab35f tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:21 devstack sudo[107830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f 1073741824 Nov 03 20:38:21 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:21 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-776df76b-5157-41d3-a1d1-9d1d1a6ab35f tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f 1073741824" returned: 0 in 0.451s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:21 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-776df76b-5157-41d3-a1d1-9d1d1a6ab35f tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:21 devstack sudo[107835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f Nov 03 20:38:21 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:22 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-776df76b-5157-41d3-a1d1-9d1d1a6ab35f tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f" returned: 0 in 0.266s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:22 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-776df76b-5157-41d3-a1d1-9d1d1a6ab35f tempest-ProjectMemberTests-196532882 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:38:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-776df76b-5157-41d3-a1d1-9d1d1a6ab35f tempest-ProjectMemberTests-196532882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:38:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-776df76b-5157-41d3-a1d1-9d1d1a6ab35f tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (003cbac1-30d4-432e-8750-7a91fc03cf73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-776df76b-5157-41d3-a1d1-9d1d1a6ab35f tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5162dc61-3d1e-4422-b39d-b46590b578ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:22 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-776df76b-5157-41d3-a1d1-9d1d1a6ab35f tempest-ProjectMemberTests-196532882 None] Volume volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f (ba355e61-d7f8-47a5-9f8b-6eb022293a9f): created successfully Nov 03 20:38:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-776df76b-5157-41d3-a1d1-9d1d1a6ab35f tempest-ProjectMemberTests-196532882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5162dc61-3d1e-4422-b39d-b46590b578ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-776df76b-5157-41d3-a1d1-9d1d1a6ab35f tempest-ProjectMemberTests-196532882 None] Flow 'volume_create_manager' (9569a7fc-0b65-416a-911d-f1a21e7c27b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:38:22 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-776df76b-5157-41d3-a1d1-9d1d1a6ab35f tempest-ProjectMemberTests-196532882 None] Created volume successfully. Nov 03 20:38:22 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-51adc372-ec80-4939-9b5a-f2e94511bfca tempest-ProjectReaderTests-356636505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:38:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-51adc372-ec80-4939-9b5a-f2e94511bfca tempest-ProjectReaderTests-356636505 None] Flow 'volume_create_manager' (7a491e90-90a1-442f-bec8-a7dd9a11eebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:38:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-51adc372-ec80-4939-9b5a-f2e94511bfca tempest-ProjectReaderTests-356636505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e38d6303-0947-4bac-a02b-ef71d3092ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-51adc372-ec80-4939-9b5a-f2e94511bfca tempest-ProjectReaderTests-356636505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e38d6303-0947-4bac-a02b-ef71d3092ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:38:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-808421543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37613ae5-c602-4545-80a4-d06aaea566b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb9987d0b1e34e3f8d1f594c65123c3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:38:23Z,use_quota=True,user_id='7fe3f1cf320645019daef2879adc627c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-51adc372-ec80-4939-9b5a-f2e94511bfca tempest-ProjectReaderTests-356636505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (717a14d2-752b-46c9-835e-f635b19a5755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-51adc372-ec80-4939-9b5a-f2e94511bfca tempest-ProjectReaderTests-356636505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (717a14d2-752b-46c9-835e-f635b19a5755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-51adc372-ec80-4939-9b5a-f2e94511bfca tempest-ProjectReaderTests-356636505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (092a78fc-a522-4aa6-89fa-eee152c7918e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-51adc372-ec80-4939-9b5a-f2e94511bfca tempest-ProjectReaderTests-356636505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (092a78fc-a522-4aa6-89fa-eee152c7918e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37613ae5-c602-4545-80a4-d06aaea566b2', 'volume_name': 'volume-37613ae5-c602-4545-80a4-d06aaea566b2', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-51adc372-ec80-4939-9b5a-f2e94511bfca tempest-ProjectReaderTests-356636505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0821960f-37ad-4e6a-a5f1-e4b7ec64190f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-51adc372-ec80-4939-9b5a-f2e94511bfca tempest-ProjectReaderTests-356636505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0821960f-37ad-4e6a-a5f1-e4b7ec64190f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:22 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-51adc372-ec80-4939-9b5a-f2e94511bfca tempest-ProjectReaderTests-356636505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b5d2d6-3f2c-452a-85e6-6f986e338c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:22 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-51adc372-ec80-4939-9b5a-f2e94511bfca tempest-ProjectReaderTests-356636505 None] Volume 37613ae5-c602-4545-80a4-d06aaea566b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37613ae5-c602-4545-80a4-d06aaea566b2', 'volume_size': 1} Nov 03 20:38:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-51adc372-ec80-4939-9b5a-f2e94511bfca tempest-ProjectReaderTests-356636505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:38:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-51adc372-ec80-4939-9b5a-f2e94511bfca tempest-ProjectReaderTests-356636505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:38:22 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-51adc372-ec80-4939-9b5a-f2e94511bfca tempest-ProjectReaderTests-356636505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:38:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-808421543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37613ae5-c602-4545-80a4-d06aaea566b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb9987d0b1e34e3f8d1f594c65123c3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:38:23Z,use_quota=True,user_id='7fe3f1cf320645019daef2879adc627c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:38:22 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-51adc372-ec80-4939-9b5a-f2e94511bfca tempest-ProjectReaderTests-356636505 None] Creating volume 37613ae5-c602-4545-80a4-d06aaea566b2 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:38:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-51adc372-ec80-4939-9b5a-f2e94511bfca tempest-ProjectReaderTests-356636505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:38:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-51adc372-ec80-4939-9b5a-f2e94511bfca tempest-ProjectReaderTests-356636505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:38:22 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-51adc372-ec80-4939-9b5a-f2e94511bfca tempest-ProjectReaderTests-356636505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:38:22 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-51adc372-ec80-4939-9b5a-f2e94511bfca tempest-ProjectReaderTests-356636505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:38:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-51adc372-ec80-4939-9b5a-f2e94511bfca tempest-ProjectReaderTests-356636505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:38:22 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-51adc372-ec80-4939-9b5a-f2e94511bfca tempest-ProjectReaderTests-356636505 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:38:22 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-51adc372-ec80-4939-9b5a-f2e94511bfca tempest-ProjectReaderTests-356636505 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:38:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-51adc372-ec80-4939-9b5a-f2e94511bfca tempest-ProjectReaderTests-356636505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-37613ae5-c602-4545-80a4-d06aaea566b2 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:22 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c2fbce48-fa19-4153-8b4f-861dcfde2220 tempest-ProjectMemberTests-196532882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:38:22 devstack sudo[107839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-37613ae5-c602-4545-80a4-d06aaea566b2 1073741824 Nov 03 20:38:22 devstack sudo[107839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:23 devstack sudo[107839]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-51adc372-ec80-4939-9b5a-f2e94511bfca tempest-ProjectReaderTests-356636505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-37613ae5-c602-4545-80a4-d06aaea566b2 1073741824" returned: 0 in 0.400s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-51adc372-ec80-4939-9b5a-f2e94511bfca tempest-ProjectReaderTests-356636505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-37613ae5-c602-4545-80a4-d06aaea566b2 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:23 devstack sudo[107844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-37613ae5-c602-4545-80a4-d06aaea566b2 Nov 03 20:38:23 devstack sudo[107844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:23 devstack sudo[107844]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-51adc372-ec80-4939-9b5a-f2e94511bfca tempest-ProjectReaderTests-356636505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-37613ae5-c602-4545-80a4-d06aaea566b2" returned: 0 in 0.237s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:23 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-51adc372-ec80-4939-9b5a-f2e94511bfca tempest-ProjectReaderTests-356636505 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:38:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-51adc372-ec80-4939-9b5a-f2e94511bfca tempest-ProjectReaderTests-356636505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:38:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c2fbce48-fa19-4153-8b4f-861dcfde2220 tempest-ProjectMemberTests-196532882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.644s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:38:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-51adc372-ec80-4939-9b5a-f2e94511bfca tempest-ProjectReaderTests-356636505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b5d2d6-3f2c-452a-85e6-6f986e338c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37613ae5-c602-4545-80a4-d06aaea566b2', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-51adc372-ec80-4939-9b5a-f2e94511bfca tempest-ProjectReaderTests-356636505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7243fec8-d361-4fd3-ab2d-5d75d2db0fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:23 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-c2fbce48-fa19-4153-8b4f-861dcfde2220 tempest-ProjectMemberTests-196532882 None] Creating offline snapshot 7e6d57c5-4da6-4a0a-868f-095252da7e38 of volume ba355e61-d7f8-47a5-9f8b-6eb022293a9f {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:38:23 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-51adc372-ec80-4939-9b5a-f2e94511bfca tempest-ProjectReaderTests-356636505 None] Volume volume-37613ae5-c602-4545-80a4-d06aaea566b2 (37613ae5-c602-4545-80a4-d06aaea566b2): created successfully Nov 03 20:38:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-51adc372-ec80-4939-9b5a-f2e94511bfca tempest-ProjectReaderTests-356636505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7243fec8-d361-4fd3-ab2d-5d75d2db0fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-51adc372-ec80-4939-9b5a-f2e94511bfca tempest-ProjectReaderTests-356636505 None] Flow 'volume_create_manager' (7a491e90-90a1-442f-bec8-a7dd9a11eebf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:38:23 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[38cfa031-f193-4936-9cd0-c14635638b11]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:38:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c2fbce48-fa19-4153-8b4f-861dcfde2220 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:23 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-51adc372-ec80-4939-9b5a-f2e94511bfca tempest-ProjectReaderTests-356636505 None] Created volume successfully. Nov 03 20:38:23 devstack sudo[107847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f Nov 03 20:38:23 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:23 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-4f663401-b695-467c-8dea-f68df58bcdae tempest-ProjectReaderTests-356636505 None] Acquiring lock "cinder-37613ae5-c602-4545-80a4-d06aaea566b2-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:38:23 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-4f663401-b695-467c-8dea-f68df58bcdae tempest-ProjectReaderTests-356636505 None] Lock "cinder-37613ae5-c602-4545-80a4-d06aaea566b2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:38:23 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-4f663401-b695-467c-8dea-f68df58bcdae tempest-ProjectReaderTests-356636505 None] Acquiring lock "cinder-quobyte-37613ae5-c602-4545-80a4-d06aaea566b2" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:38:23 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-4f663401-b695-467c-8dea-f68df58bcdae tempest-ProjectReaderTests-356636505 None] Lock "cinder-quobyte-37613ae5-c602-4545-80a4-d06aaea566b2" acquired by "delete_volume" :: waited 0.021s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:38:23 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[192ba4af-3fea-432d-abc4-3752534be366]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:38:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4f663401-b695-467c-8dea-f68df58bcdae tempest-ProjectReaderTests-356636505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-37613ae5-c602-4545-80a4-d06aaea566b2 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:23 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c2fbce48-fa19-4153-8b4f-861dcfde2220 tempest-ProjectMemberTests-196532882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f" returned: 0 in 0.400s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c2fbce48-fa19-4153-8b4f-861dcfde2220 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f.7e6d57c5-4da6-4a0a-868f-095252da7e38 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:23 devstack sudo[107853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f.7e6d57c5-4da6-4a0a-868f-095252da7e38 1G Nov 03 20:38:23 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:23 devstack sudo[107852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-37613ae5-c602-4545-80a4-d06aaea566b2 Nov 03 20:38:23 devstack sudo[107852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:24 devstack sudo[107852]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4f663401-b695-467c-8dea-f68df58bcdae tempest-ProjectReaderTests-356636505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-37613ae5-c602-4545-80a4-d06aaea566b2" returned: 0 in 0.379s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4f663401-b695-467c-8dea-f68df58bcdae tempest-ProjectReaderTests-356636505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-37613ae5-c602-4545-80a4-d06aaea566b2 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:24 devstack sudo[107862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-37613ae5-c602-4545-80a4-d06aaea566b2 Nov 03 20:38:24 devstack sudo[107862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:24 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c2fbce48-fa19-4153-8b4f-861dcfde2220 tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f.7e6d57c5-4da6-4a0a-868f-095252da7e38 1G" returned: 0 in 0.406s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c2fbce48-fa19-4153-8b4f-861dcfde2220 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f.7e6d57c5-4da6-4a0a-868f-095252da7e38 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:24 devstack sudo[107865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f.7e6d57c5-4da6-4a0a-868f-095252da7e38 Nov 03 20:38:24 devstack sudo[107865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:24 devstack sudo[107862]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4f663401-b695-467c-8dea-f68df58bcdae tempest-ProjectReaderTests-356636505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-37613ae5-c602-4545-80a4-d06aaea566b2" returned: 0 in 0.251s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:24 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-4f663401-b695-467c-8dea-f68df58bcdae tempest-ProjectReaderTests-356636505 None] Lock "cinder-quobyte-37613ae5-c602-4545-80a4-d06aaea566b2" released by "delete_volume" :: held 0.676s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:38:24 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-4f663401-b695-467c-8dea-f68df58bcdae tempest-ProjectReaderTests-356636505 None] Created reservations ['1b91ef01-29ef-486f-9406-6d02a5b7d2df', 'dd0dd5e7-be23-45cc-a503-3bc71321df32', '96c78f5e-07f7-4e92-aac1-a7101b97e6e3', '324d0294-c3fd-4a61-a6c6-9fb4fe7db54a'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:38:24 devstack sudo[107865]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c2fbce48-fa19-4153-8b4f-861dcfde2220 tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f.7e6d57c5-4da6-4a0a-868f-095252da7e38" returned: 0 in 0.304s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:24 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-c2fbce48-fa19-4153-8b4f-861dcfde2220 tempest-ProjectMemberTests-196532882 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f.7e6d57c5-4da6-4a0a-868f-095252da7e38 is being set with open permissions: ugo+rw Nov 03 20:38:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c2fbce48-fa19-4153-8b4f-861dcfde2220 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f.7e6d57c5-4da6-4a0a-868f-095252da7e38 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:24 devstack sudo[107871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f.7e6d57c5-4da6-4a0a-868f-095252da7e38 Nov 03 20:38:24 devstack sudo[107871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4f663401-b695-467c-8dea-f68df58bcdae tempest-ProjectReaderTests-356636505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:38:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4f663401-b695-467c-8dea-f68df58bcdae tempest-ProjectReaderTests-356636505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:38:24 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-4f663401-b695-467c-8dea-f68df58bcdae tempest-ProjectReaderTests-356636505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:38:24 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-4f663401-b695-467c-8dea-f68df58bcdae tempest-ProjectReaderTests-356636505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:38:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-4f663401-b695-467c-8dea-f68df58bcdae tempest-ProjectReaderTests-356636505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:38:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4f663401-b695-467c-8dea-f68df58bcdae tempest-ProjectReaderTests-356636505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:24 devstack sudo[107873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:38:24 devstack sudo[107873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:24 devstack sudo[107871]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c2fbce48-fa19-4153-8b4f-861dcfde2220 tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f.7e6d57c5-4da6-4a0a-868f-095252da7e38" returned: 0 in 0.250s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c2fbce48-fa19-4153-8b4f-861dcfde2220 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:24 devstack sudo[107877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f.info Nov 03 20:38:24 devstack sudo[107873]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:24 devstack sudo[107877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-4f663401-b695-467c-8dea-f68df58bcdae tempest-ProjectReaderTests-356636505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.259s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:24 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-4f663401-b695-467c-8dea-f68df58bcdae tempest-ProjectReaderTests-356636505 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:38:24 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-4f663401-b695-467c-8dea-f68df58bcdae tempest-ProjectReaderTests-356636505 None] Deleted volume successfully. Nov 03 20:38:24 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-4f663401-b695-467c-8dea-f68df58bcdae tempest-ProjectReaderTests-356636505 None] Lock "cinder-37613ae5-c602-4545-80a4-d06aaea566b2-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:38:25 devstack sudo[107877]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c2fbce48-fa19-4153-8b4f-861dcfde2220 tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f.info" returned: 0 in 0.248s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:25 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-c2fbce48-fa19-4153-8b4f-861dcfde2220 tempest-ProjectMemberTests-196532882 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f.info is being set with open permissions: ugo+rw Nov 03 20:38:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c2fbce48-fa19-4153-8b4f-861dcfde2220 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:25 devstack sudo[107880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f.info Nov 03 20:38:25 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:25 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-06312782-f306-46c8-816b-2e51f4090267 tempest-ProjectReaderTests-356636505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:38:25 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-06312782-f306-46c8-816b-2e51f4090267 tempest-ProjectReaderTests-356636505 None] Flow 'volume_create_manager' (9a2335d0-e707-4d55-9c1f-fd7d95378634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:38:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-06312782-f306-46c8-816b-2e51f4090267 tempest-ProjectReaderTests-356636505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44355ae6-7ef7-41b5-9ca7-77a9d5f69917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-c2fbce48-fa19-4153-8b4f-861dcfde2220 tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f.info" returned: 0 in 0.297s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-c2fbce48-fa19-4153-8b4f-861dcfde2220 tempest-ProjectMemberTests-196532882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.023s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:38:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-06312782-f306-46c8-816b-2e51f4090267 tempest-ProjectReaderTests-356636505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44355ae6-7ef7-41b5-9ca7-77a9d5f69917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:38:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-385775714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a19872-f626-4933-8950-ca2a35b87e73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb9987d0b1e34e3f8d1f594c65123c3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:38:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:38:25Z,use_quota=True,user_id='7fe3f1cf320645019daef2879adc627c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-06312782-f306-46c8-816b-2e51f4090267 tempest-ProjectReaderTests-356636505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (417f6274-e3aa-4813-9ce8-aaea8c6adcad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-06312782-f306-46c8-816b-2e51f4090267 tempest-ProjectReaderTests-356636505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (417f6274-e3aa-4813-9ce8-aaea8c6adcad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-06312782-f306-46c8-816b-2e51f4090267 tempest-ProjectReaderTests-356636505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35d19d57-9210-41db-987a-efafb0a26a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-06312782-f306-46c8-816b-2e51f4090267 tempest-ProjectReaderTests-356636505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35d19d57-9210-41db-987a-efafb0a26a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19a19872-f626-4933-8950-ca2a35b87e73', 'volume_name': 'volume-19a19872-f626-4933-8950-ca2a35b87e73', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-06312782-f306-46c8-816b-2e51f4090267 tempest-ProjectReaderTests-356636505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dc02340-d240-4435-b98c-cfcfd461d456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-06312782-f306-46c8-816b-2e51f4090267 tempest-ProjectReaderTests-356636505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dc02340-d240-4435-b98c-cfcfd461d456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:25 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-06312782-f306-46c8-816b-2e51f4090267 tempest-ProjectReaderTests-356636505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaa2d602-8ae8-44af-9098-f5f9c9457f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:25 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-06312782-f306-46c8-816b-2e51f4090267 tempest-ProjectReaderTests-356636505 None] Volume 19a19872-f626-4933-8950-ca2a35b87e73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19a19872-f626-4933-8950-ca2a35b87e73', 'volume_size': 1} Nov 03 20:38:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-06312782-f306-46c8-816b-2e51f4090267 tempest-ProjectReaderTests-356636505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:38:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-06312782-f306-46c8-816b-2e51f4090267 tempest-ProjectReaderTests-356636505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:38:25 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-06312782-f306-46c8-816b-2e51f4090267 tempest-ProjectReaderTests-356636505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:38:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-385775714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a19872-f626-4933-8950-ca2a35b87e73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb9987d0b1e34e3f8d1f594c65123c3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:38:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:38:25Z,use_quota=True,user_id='7fe3f1cf320645019daef2879adc627c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:38:25 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-06312782-f306-46c8-816b-2e51f4090267 tempest-ProjectReaderTests-356636505 None] Creating volume 19a19872-f626-4933-8950-ca2a35b87e73 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:38:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-06312782-f306-46c8-816b-2e51f4090267 tempest-ProjectReaderTests-356636505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:38:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-06312782-f306-46c8-816b-2e51f4090267 tempest-ProjectReaderTests-356636505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:38:25 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-06312782-f306-46c8-816b-2e51f4090267 tempest-ProjectReaderTests-356636505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:38:25 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-06312782-f306-46c8-816b-2e51f4090267 tempest-ProjectReaderTests-356636505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:38:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-06312782-f306-46c8-816b-2e51f4090267 tempest-ProjectReaderTests-356636505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:38:25 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-06312782-f306-46c8-816b-2e51f4090267 tempest-ProjectReaderTests-356636505 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:38:25 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-06312782-f306-46c8-816b-2e51f4090267 tempest-ProjectReaderTests-356636505 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:38:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-06312782-f306-46c8-816b-2e51f4090267 tempest-ProjectReaderTests-356636505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-19a19872-f626-4933-8950-ca2a35b87e73 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:25 devstack sudo[107883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-19a19872-f626-4933-8950-ca2a35b87e73 1073741824 Nov 03 20:38:25 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:25 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-c2fbce48-fa19-4153-8b4f-861dcfde2220 tempest-ProjectMemberTests-196532882 None] Create snapshot completed successfully Nov 03 20:38:25 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-394bb14d-7178-4288-b0b0-d65956982d42 tempest-ProjectMemberTests-196532882 None] Acquiring lock "cinder-7e6d57c5-4da6-4a0a-868f-095252da7e38-delete_snapshot" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:38:25 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-394bb14d-7178-4288-b0b0-d65956982d42 tempest-ProjectMemberTests-196532882 None] Lock "cinder-7e6d57c5-4da6-4a0a-868f-095252da7e38-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:38:25 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-394bb14d-7178-4288-b0b0-d65956982d42 tempest-ProjectMemberTests-196532882 None] Acquiring lock "cinder-quobyte-ba355e61-d7f8-47a5-9f8b-6eb022293a9f" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:38:25 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-394bb14d-7178-4288-b0b0-d65956982d42 tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-ba355e61-d7f8-47a5-9f8b-6eb022293a9f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:38:25 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-394bb14d-7178-4288-b0b0-d65956982d42 tempest-ProjectMemberTests-196532882 None] Acquiring lock "cinder-quobyte-7e6d57c5-4da6-4a0a-868f-095252da7e38" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:38:25 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-394bb14d-7178-4288-b0b0-d65956982d42 tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-7e6d57c5-4da6-4a0a-868f-095252da7e38" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:38:25 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-394bb14d-7178-4288-b0b0-d65956982d42 tempest-ProjectMemberTests-196532882 None] Deleting offline snapshot 7e6d57c5-4da6-4a0a-868f-095252da7e38 of volume ba355e61-d7f8-47a5-9f8b-6eb022293a9f {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:38:25 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-394bb14d-7178-4288-b0b0-d65956982d42 tempest-ProjectMemberTests-196532882 None] snapshot_file for this snap is: volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f.7e6d57c5-4da6-4a0a-868f-095252da7e38 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:38:25 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a80c8e-9a00-4ef7-98be-33bab788c901]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:38:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-394bb14d-7178-4288-b0b0-d65956982d42 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f.7e6d57c5-4da6-4a0a-868f-095252da7e38 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:25 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-06312782-f306-46c8-816b-2e51f4090267 tempest-ProjectReaderTests-356636505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-19a19872-f626-4933-8950-ca2a35b87e73 1073741824" returned: 0 in 0.471s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-06312782-f306-46c8-816b-2e51f4090267 tempest-ProjectReaderTests-356636505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-19a19872-f626-4933-8950-ca2a35b87e73 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:26 devstack sudo[107890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-19a19872-f626-4933-8950-ca2a35b87e73 Nov 03 20:38:26 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:26 devstack sudo[107889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f.7e6d57c5-4da6-4a0a-868f-095252da7e38 Nov 03 20:38:26 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:26 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-06312782-f306-46c8-816b-2e51f4090267 tempest-ProjectReaderTests-356636505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-19a19872-f626-4933-8950-ca2a35b87e73" returned: 0 in 0.248s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:26 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-06312782-f306-46c8-816b-2e51f4090267 tempest-ProjectReaderTests-356636505 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:38:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-06312782-f306-46c8-816b-2e51f4090267 tempest-ProjectReaderTests-356636505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:38:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-06312782-f306-46c8-816b-2e51f4090267 tempest-ProjectReaderTests-356636505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaa2d602-8ae8-44af-9098-f5f9c9457f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19a19872-f626-4933-8950-ca2a35b87e73', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-06312782-f306-46c8-816b-2e51f4090267 tempest-ProjectReaderTests-356636505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5867654a-b693-43b1-8b2e-b3d6a97ce246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:26 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-06312782-f306-46c8-816b-2e51f4090267 tempest-ProjectReaderTests-356636505 None] Volume volume-19a19872-f626-4933-8950-ca2a35b87e73 (19a19872-f626-4933-8950-ca2a35b87e73): created successfully Nov 03 20:38:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-06312782-f306-46c8-816b-2e51f4090267 tempest-ProjectReaderTests-356636505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5867654a-b693-43b1-8b2e-b3d6a97ce246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:26 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-06312782-f306-46c8-816b-2e51f4090267 tempest-ProjectReaderTests-356636505 None] Flow 'volume_create_manager' (9a2335d0-e707-4d55-9c1f-fd7d95378634) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:38:26 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-06312782-f306-46c8-816b-2e51f4090267 tempest-ProjectReaderTests-356636505 None] Created volume successfully. Nov 03 20:38:26 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-394bb14d-7178-4288-b0b0-d65956982d42 tempest-ProjectMemberTests-196532882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f.7e6d57c5-4da6-4a0a-868f-095252da7e38" returned: 0 in 0.392s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:26 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-394bb14d-7178-4288-b0b0-d65956982d42 tempest-ProjectMemberTests-196532882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:38:26 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6955b78-fbe0-4017-9b46-d9e0a9423148]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:38:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-394bb14d-7178-4288-b0b0-d65956982d42 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:26 devstack sudo[107897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f Nov 03 20:38:26 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:26 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-394bb14d-7178-4288-b0b0-d65956982d42 tempest-ProjectMemberTests-196532882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f" returned: 0 in 0.351s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-394bb14d-7178-4288-b0b0-d65956982d42 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f.7e6d57c5-4da6-4a0a-868f-095252da7e38 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:26 devstack sudo[107902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f.7e6d57c5-4da6-4a0a-868f-095252da7e38 Nov 03 20:38:26 devstack sudo[107902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:27 devstack sudo[107902]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-394bb14d-7178-4288-b0b0-d65956982d42 tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f.7e6d57c5-4da6-4a0a-868f-095252da7e38" returned: 0 in 0.324s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-394bb14d-7178-4288-b0b0-d65956982d42 tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f.7e6d57c5-4da6-4a0a-868f-095252da7e38 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:27 devstack sudo[107907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f.7e6d57c5-4da6-4a0a-868f-095252da7e38 Nov 03 20:38:27 devstack sudo[107907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:27 devstack sudo[107907]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-394bb14d-7178-4288-b0b0-d65956982d42 tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f.7e6d57c5-4da6-4a0a-868f-095252da7e38" returned: 0 in 0.252s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:27 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-394bb14d-7178-4288-b0b0-d65956982d42 tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-7e6d57c5-4da6-4a0a-868f-095252da7e38" released by "_delete_snapshot" :: held 1.415s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:38:27 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-394bb14d-7178-4288-b0b0-d65956982d42 tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-ba355e61-d7f8-47a5-9f8b-6eb022293a9f" released by "delete_snapshot" :: held 1.440s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:38:27 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-394bb14d-7178-4288-b0b0-d65956982d42 tempest-ProjectMemberTests-196532882 None] Created reservations ['f860df1f-8049-4b50-8d8d-26f72b6da40b', '772faa93-2de2-4026-85ae-f6313ab10426', '6a1c776a-4074-4e76-b589-490bec5c6fe6', 'b552393d-2dce-4c14-8408-8dc85a0414ed'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:38:27 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-394bb14d-7178-4288-b0b0-d65956982d42 tempest-ProjectMemberTests-196532882 None] Delete snapshot completed successfully. Nov 03 20:38:27 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-394bb14d-7178-4288-b0b0-d65956982d42 tempest-ProjectMemberTests-196532882 None] Lock "cinder-7e6d57c5-4da6-4a0a-868f-095252da7e38-delete_snapshot" released by "delete_snapshot" :: held 1.583s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:38:27 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7d2fcade-a8ec-4a3e-8004-9eac38356b63 tempest-ProjectReaderTests-356636505 None] Acquiring lock "cinder-19a19872-f626-4933-8950-ca2a35b87e73-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:38:27 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7d2fcade-a8ec-4a3e-8004-9eac38356b63 tempest-ProjectReaderTests-356636505 None] Lock "cinder-19a19872-f626-4933-8950-ca2a35b87e73-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:38:27 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7d2fcade-a8ec-4a3e-8004-9eac38356b63 tempest-ProjectReaderTests-356636505 None] Acquiring lock "cinder-quobyte-19a19872-f626-4933-8950-ca2a35b87e73" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:38:27 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7d2fcade-a8ec-4a3e-8004-9eac38356b63 tempest-ProjectReaderTests-356636505 None] Lock "cinder-quobyte-19a19872-f626-4933-8950-ca2a35b87e73" acquired by "delete_volume" :: waited 0.015s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:38:27 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[177230d9-1133-48d5-95eb-0fde39f41b14]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:38:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7d2fcade-a8ec-4a3e-8004-9eac38356b63 tempest-ProjectReaderTests-356636505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-19a19872-f626-4933-8950-ca2a35b87e73 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:27 devstack sudo[107910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-19a19872-f626-4933-8950-ca2a35b87e73 Nov 03 20:38:27 devstack sudo[107910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:27 devstack sudo[107910]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7d2fcade-a8ec-4a3e-8004-9eac38356b63 tempest-ProjectReaderTests-356636505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-19a19872-f626-4933-8950-ca2a35b87e73" returned: 0 in 0.359s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7d2fcade-a8ec-4a3e-8004-9eac38356b63 tempest-ProjectReaderTests-356636505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-19a19872-f626-4933-8950-ca2a35b87e73 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:27 devstack sudo[107915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-19a19872-f626-4933-8950-ca2a35b87e73 Nov 03 20:38:27 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:28 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-f63e4e71-6eb2-47f0-9a1f-39b8ee995b7f tempest-ProjectMemberTests-196532882 None] Acquiring lock "cinder-ba355e61-d7f8-47a5-9f8b-6eb022293a9f-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:38:28 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-f63e4e71-6eb2-47f0-9a1f-39b8ee995b7f tempest-ProjectMemberTests-196532882 None] Lock "cinder-ba355e61-d7f8-47a5-9f8b-6eb022293a9f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:38:28 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-f63e4e71-6eb2-47f0-9a1f-39b8ee995b7f tempest-ProjectMemberTests-196532882 None] Acquiring lock "cinder-quobyte-ba355e61-d7f8-47a5-9f8b-6eb022293a9f" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:38:28 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-f63e4e71-6eb2-47f0-9a1f-39b8ee995b7f tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-ba355e61-d7f8-47a5-9f8b-6eb022293a9f" acquired by "delete_volume" :: waited 0.019s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:38:28 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0e2d15-d920-4647-b0d4-ce42066a860c]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:38:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f63e4e71-6eb2-47f0-9a1f-39b8ee995b7f tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:28 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7d2fcade-a8ec-4a3e-8004-9eac38356b63 tempest-ProjectReaderTests-356636505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-19a19872-f626-4933-8950-ca2a35b87e73" returned: 0 in 0.263s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:28 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7d2fcade-a8ec-4a3e-8004-9eac38356b63 tempest-ProjectReaderTests-356636505 None] Lock "cinder-quobyte-19a19872-f626-4933-8950-ca2a35b87e73" released by "delete_volume" :: held 0.664s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:38:28 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f Nov 03 20:38:28 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:28 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-7d2fcade-a8ec-4a3e-8004-9eac38356b63 tempest-ProjectReaderTests-356636505 None] Created reservations ['20265475-fb72-433b-9be8-ec92192e5094', '74a5c965-7f51-4378-98d4-b8185b0c2b3c', '8e53a36c-c22f-4a0a-86cf-17ed3db9b6da', '568eae11-8236-41e3-abc2-486c3a1dc7cc'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:38:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7d2fcade-a8ec-4a3e-8004-9eac38356b63 tempest-ProjectReaderTests-356636505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:38:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7d2fcade-a8ec-4a3e-8004-9eac38356b63 tempest-ProjectReaderTests-356636505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:38:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-7d2fcade-a8ec-4a3e-8004-9eac38356b63 tempest-ProjectReaderTests-356636505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:38:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-7d2fcade-a8ec-4a3e-8004-9eac38356b63 tempest-ProjectReaderTests-356636505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:38:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-7d2fcade-a8ec-4a3e-8004-9eac38356b63 tempest-ProjectReaderTests-356636505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:38:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7d2fcade-a8ec-4a3e-8004-9eac38356b63 tempest-ProjectReaderTests-356636505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:28 devstack sudo[107920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:38:28 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:28 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f63e4e71-6eb2-47f0-9a1f-39b8ee995b7f tempest-ProjectMemberTests-196532882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f" returned: 0 in 0.377s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f63e4e71-6eb2-47f0-9a1f-39b8ee995b7f tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:28 devstack sudo[107925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f Nov 03 20:38:28 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:28 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-7d2fcade-a8ec-4a3e-8004-9eac38356b63 tempest-ProjectReaderTests-356636505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.287s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:28 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-7d2fcade-a8ec-4a3e-8004-9eac38356b63 tempest-ProjectReaderTests-356636505 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:38:28 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-7d2fcade-a8ec-4a3e-8004-9eac38356b63 tempest-ProjectReaderTests-356636505 None] Deleted volume successfully. Nov 03 20:38:28 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-7d2fcade-a8ec-4a3e-8004-9eac38356b63 tempest-ProjectReaderTests-356636505 None] Lock "cinder-19a19872-f626-4933-8950-ca2a35b87e73-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:38:28 devstack cinder-volume[87248]: DEBUG oslo_service.periodic_task [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:38:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:38:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:38:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:38:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:38:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:38:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:28 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f63e4e71-6eb2-47f0-9a1f-39b8ee995b7f tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-ba355e61-d7f8-47a5-9f8b-6eb022293a9f" returned: 0 in 0.265s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:28 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:38:28 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:28 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-f63e4e71-6eb2-47f0-9a1f-39b8ee995b7f tempest-ProjectMemberTests-196532882 None] Lock "cinder-quobyte-ba355e61-d7f8-47a5-9f8b-6eb022293a9f" released by "delete_volume" :: held 0.718s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:38:28 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-f63e4e71-6eb2-47f0-9a1f-39b8ee995b7f tempest-ProjectMemberTests-196532882 None] Created reservations ['02f9552b-b15d-499f-8632-abf10365041e', '54c8ecd9-66e5-4109-b043-be34f2402cf1', 'd167443b-f2c0-46c5-bd57-21af6fc6d41d', 'cb608738-91c7-4c3b-8b95-606eb0274357'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:38:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f63e4e71-6eb2-47f0-9a1f-39b8ee995b7f tempest-ProjectMemberTests-196532882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:38:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f63e4e71-6eb2-47f0-9a1f-39b8ee995b7f tempest-ProjectMemberTests-196532882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:38:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-f63e4e71-6eb2-47f0-9a1f-39b8ee995b7f tempest-ProjectMemberTests-196532882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:38:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-f63e4e71-6eb2-47f0-9a1f-39b8ee995b7f tempest-ProjectMemberTests-196532882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:38:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-f63e4e71-6eb2-47f0-9a1f-39b8ee995b7f tempest-ProjectMemberTests-196532882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:38:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f63e4e71-6eb2-47f0-9a1f-39b8ee995b7f tempest-ProjectMemberTests-196532882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:29 devstack sudo[107931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:38:29 devstack sudo[107931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:29 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.284s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:29 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:38:29 devstack cinder-volume[87248]: DEBUG oslo_service.periodic_task [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running periodic task VolumeManager._thread_info {{(pid=87248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:38:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] thread count: 28 {{(pid=87248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:38:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] thread info: [<_MainThread(MainThread, started 124862067372160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:38:29 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-364e3205-a1f2-4df4-bcee-607267325aa4 tempest-ProjectReaderTests-356636505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:38:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-364e3205-a1f2-4df4-bcee-607267325aa4 tempest-ProjectReaderTests-356636505 None] Flow 'volume_create_manager' (a49d0640-b527-48bc-8bef-3d5a9f1e90a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:38:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-364e3205-a1f2-4df4-bcee-607267325aa4 tempest-ProjectReaderTests-356636505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9ae2629-ff45-411b-9fee-fe22e57d7fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-364e3205-a1f2-4df4-bcee-607267325aa4 tempest-ProjectReaderTests-356636505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9ae2629-ff45-411b-9fee-fe22e57d7fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1916857746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c006798e-f5ad-405b-a252-3d449fff4dd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb9987d0b1e34e3f8d1f594c65123c3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:38:29Z,use_quota=True,user_id='7fe3f1cf320645019daef2879adc627c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-364e3205-a1f2-4df4-bcee-607267325aa4 tempest-ProjectReaderTests-356636505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55f09c7b-efad-440f-8312-78b2a65da22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-364e3205-a1f2-4df4-bcee-607267325aa4 tempest-ProjectReaderTests-356636505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55f09c7b-efad-440f-8312-78b2a65da22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-364e3205-a1f2-4df4-bcee-607267325aa4 tempest-ProjectReaderTests-356636505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbd5fa17-0c54-4fa0-ac7e-8a5b0b6d8613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-364e3205-a1f2-4df4-bcee-607267325aa4 tempest-ProjectReaderTests-356636505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbd5fa17-0c54-4fa0-ac7e-8a5b0b6d8613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c006798e-f5ad-405b-a252-3d449fff4dd6', 'volume_name': 'volume-c006798e-f5ad-405b-a252-3d449fff4dd6', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:29 devstack sudo[107931]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-364e3205-a1f2-4df4-bcee-607267325aa4 tempest-ProjectReaderTests-356636505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65573cd8-f70e-4706-8be7-8597d8b29599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-364e3205-a1f2-4df4-bcee-607267325aa4 tempest-ProjectReaderTests-356636505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65573cd8-f70e-4706-8be7-8597d8b29599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-364e3205-a1f2-4df4-bcee-607267325aa4 tempest-ProjectReaderTests-356636505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6094f780-fbf3-4ba4-bdc6-f2f97543e18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:29 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-364e3205-a1f2-4df4-bcee-607267325aa4 tempest-ProjectReaderTests-356636505 None] Volume c006798e-f5ad-405b-a252-3d449fff4dd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c006798e-f5ad-405b-a252-3d449fff4dd6', 'volume_size': 1} Nov 03 20:38:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-364e3205-a1f2-4df4-bcee-607267325aa4 tempest-ProjectReaderTests-356636505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:38:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-364e3205-a1f2-4df4-bcee-607267325aa4 tempest-ProjectReaderTests-356636505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:38:29 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-364e3205-a1f2-4df4-bcee-607267325aa4 tempest-ProjectReaderTests-356636505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1916857746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c006798e-f5ad-405b-a252-3d449fff4dd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb9987d0b1e34e3f8d1f594c65123c3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:38:29Z,use_quota=True,user_id='7fe3f1cf320645019daef2879adc627c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:38:29 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-364e3205-a1f2-4df4-bcee-607267325aa4 tempest-ProjectReaderTests-356636505 None] Creating volume c006798e-f5ad-405b-a252-3d449fff4dd6 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:38:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-364e3205-a1f2-4df4-bcee-607267325aa4 tempest-ProjectReaderTests-356636505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:38:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-364e3205-a1f2-4df4-bcee-607267325aa4 tempest-ProjectReaderTests-356636505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:38:29 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-364e3205-a1f2-4df4-bcee-607267325aa4 tempest-ProjectReaderTests-356636505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:38:29 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-364e3205-a1f2-4df4-bcee-607267325aa4 tempest-ProjectReaderTests-356636505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:38:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-364e3205-a1f2-4df4-bcee-607267325aa4 tempest-ProjectReaderTests-356636505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:38:29 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-364e3205-a1f2-4df4-bcee-607267325aa4 tempest-ProjectReaderTests-356636505 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:38:29 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-364e3205-a1f2-4df4-bcee-607267325aa4 tempest-ProjectReaderTests-356636505 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:38:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-364e3205-a1f2-4df4-bcee-607267325aa4 tempest-ProjectReaderTests-356636505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-c006798e-f5ad-405b-a252-3d449fff4dd6 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-f63e4e71-6eb2-47f0-9a1f-39b8ee995b7f tempest-ProjectMemberTests-196532882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.343s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:29 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-f63e4e71-6eb2-47f0-9a1f-39b8ee995b7f tempest-ProjectMemberTests-196532882 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:38:29 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-f63e4e71-6eb2-47f0-9a1f-39b8ee995b7f tempest-ProjectMemberTests-196532882 None] Deleted volume successfully. Nov 03 20:38:29 devstack sudo[107935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-c006798e-f5ad-405b-a252-3d449fff4dd6 1073741824 Nov 03 20:38:29 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:29 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-f63e4e71-6eb2-47f0-9a1f-39b8ee995b7f tempest-ProjectMemberTests-196532882 None] Lock "cinder-ba355e61-d7f8-47a5-9f8b-6eb022293a9f-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:38:29 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-364e3205-a1f2-4df4-bcee-607267325aa4 tempest-ProjectReaderTests-356636505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-c006798e-f5ad-405b-a252-3d449fff4dd6 1073741824" returned: 0 in 0.495s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:29 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-364e3205-a1f2-4df4-bcee-607267325aa4 tempest-ProjectReaderTests-356636505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-c006798e-f5ad-405b-a252-3d449fff4dd6 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:29 devstack sudo[107941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-c006798e-f5ad-405b-a252-3d449fff4dd6 Nov 03 20:38:29 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:30 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-364e3205-a1f2-4df4-bcee-607267325aa4 tempest-ProjectReaderTests-356636505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-c006798e-f5ad-405b-a252-3d449fff4dd6" returned: 0 in 0.265s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:30 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-364e3205-a1f2-4df4-bcee-607267325aa4 tempest-ProjectReaderTests-356636505 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:38:30 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-364e3205-a1f2-4df4-bcee-607267325aa4 tempest-ProjectReaderTests-356636505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:38:30 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-364e3205-a1f2-4df4-bcee-607267325aa4 tempest-ProjectReaderTests-356636505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6094f780-fbf3-4ba4-bdc6-f2f97543e18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c006798e-f5ad-405b-a252-3d449fff4dd6', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:30 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-364e3205-a1f2-4df4-bcee-607267325aa4 tempest-ProjectReaderTests-356636505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c083ddb-6cf2-4040-8268-f79326123dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:30 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-364e3205-a1f2-4df4-bcee-607267325aa4 tempest-ProjectReaderTests-356636505 None] Volume volume-c006798e-f5ad-405b-a252-3d449fff4dd6 (c006798e-f5ad-405b-a252-3d449fff4dd6): created successfully Nov 03 20:38:30 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-364e3205-a1f2-4df4-bcee-607267325aa4 tempest-ProjectReaderTests-356636505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c083ddb-6cf2-4040-8268-f79326123dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:30 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-364e3205-a1f2-4df4-bcee-607267325aa4 tempest-ProjectReaderTests-356636505 None] Flow 'volume_create_manager' (a49d0640-b527-48bc-8bef-3d5a9f1e90a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:38:30 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-364e3205-a1f2-4df4-bcee-607267325aa4 tempest-ProjectReaderTests-356636505 None] Created volume successfully. Nov 03 20:38:31 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fd056676-a2cb-4401-892d-e7c2c145d9d9 tempest-ProjectReaderTests-356636505 None] Acquiring lock "cinder-c006798e-f5ad-405b-a252-3d449fff4dd6-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:38:31 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fd056676-a2cb-4401-892d-e7c2c145d9d9 tempest-ProjectReaderTests-356636505 None] Lock "cinder-c006798e-f5ad-405b-a252-3d449fff4dd6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:38:31 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:SELECT=195,cinder:UPDATE=307,cinder:INSERT=68,cinder:DELETE=24 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:38:31 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:SELECT=224,cinder:INSERT=88,cinder:UPDATE=249,cinder:DELETE=22 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:38:31 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fd056676-a2cb-4401-892d-e7c2c145d9d9 tempest-ProjectReaderTests-356636505 None] Acquiring lock "cinder-quobyte-c006798e-f5ad-405b-a252-3d449fff4dd6" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:38:31 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fd056676-a2cb-4401-892d-e7c2c145d9d9 tempest-ProjectReaderTests-356636505 None] Lock "cinder-quobyte-c006798e-f5ad-405b-a252-3d449fff4dd6" acquired by "delete_volume" :: waited 0.019s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:38:31 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b8f179-3f87-4979-864c-70c9e1873712]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:38:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fd056676-a2cb-4401-892d-e7c2c145d9d9 tempest-ProjectReaderTests-356636505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-c006798e-f5ad-405b-a252-3d449fff4dd6 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:31 devstack sudo[107944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-c006798e-f5ad-405b-a252-3d449fff4dd6 Nov 03 20:38:31 devstack sudo[107944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:31 devstack sudo[107944]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fd056676-a2cb-4401-892d-e7c2c145d9d9 tempest-ProjectReaderTests-356636505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-c006798e-f5ad-405b-a252-3d449fff4dd6" returned: 0 in 0.373s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:31 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fd056676-a2cb-4401-892d-e7c2c145d9d9 tempest-ProjectReaderTests-356636505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-c006798e-f5ad-405b-a252-3d449fff4dd6 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:31 devstack sudo[107949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-c006798e-f5ad-405b-a252-3d449fff4dd6 Nov 03 20:38:31 devstack sudo[107949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:32 devstack sudo[107949]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fd056676-a2cb-4401-892d-e7c2c145d9d9 tempest-ProjectReaderTests-356636505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-c006798e-f5ad-405b-a252-3d449fff4dd6" returned: 0 in 0.248s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:32 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fd056676-a2cb-4401-892d-e7c2c145d9d9 tempest-ProjectReaderTests-356636505 None] Lock "cinder-quobyte-c006798e-f5ad-405b-a252-3d449fff4dd6" released by "delete_volume" :: held 0.665s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:38:32 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-fd056676-a2cb-4401-892d-e7c2c145d9d9 tempest-ProjectReaderTests-356636505 None] Created reservations ['a5364c06-a32f-4fda-b316-ecc6970b4c10', 'ff952791-c87b-4a26-ada5-008ef5cfd405', '32cbfab2-321e-4214-bb36-b40d56caa0c7', '0aab1965-4a2f-4793-b034-41e5e5350de3'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:38:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-fd056676-a2cb-4401-892d-e7c2c145d9d9 tempest-ProjectReaderTests-356636505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:38:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-fd056676-a2cb-4401-892d-e7c2c145d9d9 tempest-ProjectReaderTests-356636505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:38:32 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-fd056676-a2cb-4401-892d-e7c2c145d9d9 tempest-ProjectReaderTests-356636505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:38:32 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-fd056676-a2cb-4401-892d-e7c2c145d9d9 tempest-ProjectReaderTests-356636505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:38:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-fd056676-a2cb-4401-892d-e7c2c145d9d9 tempest-ProjectReaderTests-356636505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:38:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fd056676-a2cb-4401-892d-e7c2c145d9d9 tempest-ProjectReaderTests-356636505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:32 devstack sudo[107952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:38:32 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:32 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:32 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-fd056676-a2cb-4401-892d-e7c2c145d9d9 tempest-ProjectReaderTests-356636505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.259s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:32 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-fd056676-a2cb-4401-892d-e7c2c145d9d9 tempest-ProjectReaderTests-356636505 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:38:32 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-fd056676-a2cb-4401-892d-e7c2c145d9d9 tempest-ProjectReaderTests-356636505 None] Deleted volume successfully. Nov 03 20:38:32 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-fd056676-a2cb-4401-892d-e7c2c145d9d9 tempest-ProjectReaderTests-356636505 None] Lock "cinder-c006798e-f5ad-405b-a252-3d449fff4dd6-delete_volume" released by "delete_volume" :: held 1.141s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:38:33 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-46e23c97-504d-4508-8aaa-93e6db3643b9 tempest-ProjectReaderTests-356636505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:38:33 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-46e23c97-504d-4508-8aaa-93e6db3643b9 tempest-ProjectReaderTests-356636505 None] Flow 'volume_create_manager' (59f61531-5a18-4ac2-bb1f-eb3b94b3cb55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:38:33 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-46e23c97-504d-4508-8aaa-93e6db3643b9 tempest-ProjectReaderTests-356636505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (477bb1e5-e502-4434-bb67-f924fdeb5791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:33 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-46e23c97-504d-4508-8aaa-93e6db3643b9 tempest-ProjectReaderTests-356636505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (477bb1e5-e502-4434-bb67-f924fdeb5791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-417549204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98f4c7bf-bfe9-4ad6-97ff-a5a7a9237f7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb9987d0b1e34e3f8d1f594c65123c3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:38:33Z,use_quota=True,user_id='7fe3f1cf320645019daef2879adc627c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:33 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-46e23c97-504d-4508-8aaa-93e6db3643b9 tempest-ProjectReaderTests-356636505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58459b78-52f1-42d0-87a0-8c086bb1607f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:33 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-46e23c97-504d-4508-8aaa-93e6db3643b9 tempest-ProjectReaderTests-356636505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58459b78-52f1-42d0-87a0-8c086bb1607f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:33 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-46e23c97-504d-4508-8aaa-93e6db3643b9 tempest-ProjectReaderTests-356636505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04e65383-87fd-4e01-89a1-a4f6a21e994f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:33 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-46e23c97-504d-4508-8aaa-93e6db3643b9 tempest-ProjectReaderTests-356636505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04e65383-87fd-4e01-89a1-a4f6a21e994f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98f4c7bf-bfe9-4ad6-97ff-a5a7a9237f7c', 'volume_name': 'volume-98f4c7bf-bfe9-4ad6-97ff-a5a7a9237f7c', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:33 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-46e23c97-504d-4508-8aaa-93e6db3643b9 tempest-ProjectReaderTests-356636505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (970d5495-8eae-404d-9d14-04b04de30739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:33 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-46e23c97-504d-4508-8aaa-93e6db3643b9 tempest-ProjectReaderTests-356636505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (970d5495-8eae-404d-9d14-04b04de30739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:33 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-46e23c97-504d-4508-8aaa-93e6db3643b9 tempest-ProjectReaderTests-356636505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11951276-93f6-4f00-a7e1-0a17eac28044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:33 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-46e23c97-504d-4508-8aaa-93e6db3643b9 tempest-ProjectReaderTests-356636505 None] Volume 98f4c7bf-bfe9-4ad6-97ff-a5a7a9237f7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98f4c7bf-bfe9-4ad6-97ff-a5a7a9237f7c', 'volume_size': 1} Nov 03 20:38:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-46e23c97-504d-4508-8aaa-93e6db3643b9 tempest-ProjectReaderTests-356636505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:38:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-46e23c97-504d-4508-8aaa-93e6db3643b9 tempest-ProjectReaderTests-356636505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:38:33 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-46e23c97-504d-4508-8aaa-93e6db3643b9 tempest-ProjectReaderTests-356636505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-417549204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98f4c7bf-bfe9-4ad6-97ff-a5a7a9237f7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb9987d0b1e34e3f8d1f594c65123c3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:38:33Z,use_quota=True,user_id='7fe3f1cf320645019daef2879adc627c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:38:33 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-46e23c97-504d-4508-8aaa-93e6db3643b9 tempest-ProjectReaderTests-356636505 None] Creating volume 98f4c7bf-bfe9-4ad6-97ff-a5a7a9237f7c {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:38:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-46e23c97-504d-4508-8aaa-93e6db3643b9 tempest-ProjectReaderTests-356636505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:38:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-46e23c97-504d-4508-8aaa-93e6db3643b9 tempest-ProjectReaderTests-356636505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:38:33 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-46e23c97-504d-4508-8aaa-93e6db3643b9 tempest-ProjectReaderTests-356636505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:38:33 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-46e23c97-504d-4508-8aaa-93e6db3643b9 tempest-ProjectReaderTests-356636505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:38:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-46e23c97-504d-4508-8aaa-93e6db3643b9 tempest-ProjectReaderTests-356636505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:38:33 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-46e23c97-504d-4508-8aaa-93e6db3643b9 tempest-ProjectReaderTests-356636505 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:38:33 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-46e23c97-504d-4508-8aaa-93e6db3643b9 tempest-ProjectReaderTests-356636505 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:38:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-46e23c97-504d-4508-8aaa-93e6db3643b9 tempest-ProjectReaderTests-356636505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-98f4c7bf-bfe9-4ad6-97ff-a5a7a9237f7c 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:33 devstack sudo[107956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-98f4c7bf-bfe9-4ad6-97ff-a5a7a9237f7c 1073741824 Nov 03 20:38:33 devstack sudo[107956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:33 devstack sudo[107956]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-46e23c97-504d-4508-8aaa-93e6db3643b9 tempest-ProjectReaderTests-356636505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-98f4c7bf-bfe9-4ad6-97ff-a5a7a9237f7c 1073741824" returned: 0 in 0.414s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-46e23c97-504d-4508-8aaa-93e6db3643b9 tempest-ProjectReaderTests-356636505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-98f4c7bf-bfe9-4ad6-97ff-a5a7a9237f7c {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:33 devstack sudo[107961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-98f4c7bf-bfe9-4ad6-97ff-a5a7a9237f7c Nov 03 20:38:33 devstack sudo[107961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:33 devstack sudo[107961]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-46e23c97-504d-4508-8aaa-93e6db3643b9 tempest-ProjectReaderTests-356636505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-98f4c7bf-bfe9-4ad6-97ff-a5a7a9237f7c" returned: 0 in 0.254s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:33 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-46e23c97-504d-4508-8aaa-93e6db3643b9 tempest-ProjectReaderTests-356636505 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:38:33 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-46e23c97-504d-4508-8aaa-93e6db3643b9 tempest-ProjectReaderTests-356636505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:38:33 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-46e23c97-504d-4508-8aaa-93e6db3643b9 tempest-ProjectReaderTests-356636505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11951276-93f6-4f00-a7e1-0a17eac28044) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98f4c7bf-bfe9-4ad6-97ff-a5a7a9237f7c', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:34 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-46e23c97-504d-4508-8aaa-93e6db3643b9 tempest-ProjectReaderTests-356636505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8c3e890-92af-4ace-9275-43729301dc78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:38:34 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-46e23c97-504d-4508-8aaa-93e6db3643b9 tempest-ProjectReaderTests-356636505 None] Volume volume-98f4c7bf-bfe9-4ad6-97ff-a5a7a9237f7c (98f4c7bf-bfe9-4ad6-97ff-a5a7a9237f7c): created successfully Nov 03 20:38:34 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-46e23c97-504d-4508-8aaa-93e6db3643b9 tempest-ProjectReaderTests-356636505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8c3e890-92af-4ace-9275-43729301dc78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:38:34 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-46e23c97-504d-4508-8aaa-93e6db3643b9 tempest-ProjectReaderTests-356636505 None] Flow 'volume_create_manager' (59f61531-5a18-4ac2-bb1f-eb3b94b3cb55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:38:34 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-46e23c97-504d-4508-8aaa-93e6db3643b9 tempest-ProjectReaderTests-356636505 None] Created volume successfully. Nov 03 20:38:35 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a9581573-6bd6-425a-938f-3528d0fb0d45 tempest-ProjectReaderTests-356636505 None] Acquiring lock "cinder-98f4c7bf-bfe9-4ad6-97ff-a5a7a9237f7c-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:38:35 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a9581573-6bd6-425a-938f-3528d0fb0d45 tempest-ProjectReaderTests-356636505 None] Lock "cinder-98f4c7bf-bfe9-4ad6-97ff-a5a7a9237f7c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:38:35 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a9581573-6bd6-425a-938f-3528d0fb0d45 tempest-ProjectReaderTests-356636505 None] Acquiring lock "cinder-quobyte-98f4c7bf-bfe9-4ad6-97ff-a5a7a9237f7c" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:38:35 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a9581573-6bd6-425a-938f-3528d0fb0d45 tempest-ProjectReaderTests-356636505 None] Lock "cinder-quobyte-98f4c7bf-bfe9-4ad6-97ff-a5a7a9237f7c" acquired by "delete_volume" :: waited 0.014s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:38:35 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1a99ea-5067-433b-9498-fec07bc67971]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:38:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a9581573-6bd6-425a-938f-3528d0fb0d45 tempest-ProjectReaderTests-356636505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-98f4c7bf-bfe9-4ad6-97ff-a5a7a9237f7c {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:35 devstack sudo[107965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-98f4c7bf-bfe9-4ad6-97ff-a5a7a9237f7c Nov 03 20:38:35 devstack sudo[107965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:35 devstack sudo[107965]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a9581573-6bd6-425a-938f-3528d0fb0d45 tempest-ProjectReaderTests-356636505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-98f4c7bf-bfe9-4ad6-97ff-a5a7a9237f7c" returned: 0 in 0.351s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a9581573-6bd6-425a-938f-3528d0fb0d45 tempest-ProjectReaderTests-356636505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-98f4c7bf-bfe9-4ad6-97ff-a5a7a9237f7c {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:35 devstack sudo[107970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-98f4c7bf-bfe9-4ad6-97ff-a5a7a9237f7c Nov 03 20:38:35 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:35 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a9581573-6bd6-425a-938f-3528d0fb0d45 tempest-ProjectReaderTests-356636505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-98f4c7bf-bfe9-4ad6-97ff-a5a7a9237f7c" returned: 0 in 0.263s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:35 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a9581573-6bd6-425a-938f-3528d0fb0d45 tempest-ProjectReaderTests-356636505 None] Lock "cinder-quobyte-98f4c7bf-bfe9-4ad6-97ff-a5a7a9237f7c" released by "delete_volume" :: held 0.660s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:38:35 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-a9581573-6bd6-425a-938f-3528d0fb0d45 tempest-ProjectReaderTests-356636505 None] Created reservations ['f4140711-4918-4824-8d7a-2ad5e7a836f6', 'a2984f1a-7215-4c4f-a0ce-17efd3bff09e', 'aed5192f-0038-4bbc-b2b6-5f2097cdbcb5', 'eb9acbbf-053b-494f-8f44-b96f42690005'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:38:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a9581573-6bd6-425a-938f-3528d0fb0d45 tempest-ProjectReaderTests-356636505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:38:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a9581573-6bd6-425a-938f-3528d0fb0d45 tempest-ProjectReaderTests-356636505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:38:35 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a9581573-6bd6-425a-938f-3528d0fb0d45 tempest-ProjectReaderTests-356636505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:38:35 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-a9581573-6bd6-425a-938f-3528d0fb0d45 tempest-ProjectReaderTests-356636505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:38:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-a9581573-6bd6-425a-938f-3528d0fb0d45 tempest-ProjectReaderTests-356636505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:38:35 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a9581573-6bd6-425a-938f-3528d0fb0d45 tempest-ProjectReaderTests-356636505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:38:35 devstack sudo[107973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:38:35 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:38:36 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root Nov 03 20:38:36 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-a9581573-6bd6-425a-938f-3528d0fb0d45 tempest-ProjectReaderTests-356636505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.258s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:38:36 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-a9581573-6bd6-425a-938f-3528d0fb0d45 tempest-ProjectReaderTests-356636505 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:38:36 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-a9581573-6bd6-425a-938f-3528d0fb0d45 tempest-ProjectReaderTests-356636505 None] Deleted volume successfully. Nov 03 20:38:36 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-a9581573-6bd6-425a-938f-3528d0fb0d45 tempest-ProjectReaderTests-356636505 None] Lock "cinder-98f4c7bf-bfe9-4ad6-97ff-a5a7a9237f7c-delete_volume" released by "delete_volume" :: held 1.122s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:38:45 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:SELECT=10,cinder:INSERT=6,cinder:UPDATE=18,cinder:DELETE=1 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:38:46 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:SELECT=13,cinder:INSERT=3,cinder:UPDATE=19,cinder:DELETE=2 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:39:12 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-150c1bda-b34f-4472-8ffd-930e5ffac1a0 tempest-SnapshotDependencyTests-1113943724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:39:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-150c1bda-b34f-4472-8ffd-930e5ffac1a0 tempest-SnapshotDependencyTests-1113943724 None] Flow 'volume_create_manager' (397e963e-ab88-4eda-9156-f1c12d182b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:39:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-150c1bda-b34f-4472-8ffd-930e5ffac1a0 tempest-SnapshotDependencyTests-1113943724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eed3cccd-de86-4129-aaa1-5b2e894698fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:39:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-150c1bda-b34f-4472-8ffd-930e5ffac1a0 tempest-SnapshotDependencyTests-1113943724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eed3cccd-de86-4129-aaa1-5b2e894698fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:39:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1708082396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49239306-e397-4220-abcb-e440b00e6e00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64f5e5ec610f45329da73f60e4e9c8d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:39:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:39:13Z,use_quota=True,user_id='36299be827e34dc5aeeba116411b1aca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:39:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-150c1bda-b34f-4472-8ffd-930e5ffac1a0 tempest-SnapshotDependencyTests-1113943724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b4e8d50-ab68-4f24-882d-ec7aa24e43ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:39:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-150c1bda-b34f-4472-8ffd-930e5ffac1a0 tempest-SnapshotDependencyTests-1113943724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b4e8d50-ab68-4f24-882d-ec7aa24e43ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:39:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-150c1bda-b34f-4472-8ffd-930e5ffac1a0 tempest-SnapshotDependencyTests-1113943724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d30faa0-f111-4fb5-87d7-8621f87db988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:39:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-150c1bda-b34f-4472-8ffd-930e5ffac1a0 tempest-SnapshotDependencyTests-1113943724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d30faa0-f111-4fb5-87d7-8621f87db988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49239306-e397-4220-abcb-e440b00e6e00', 'volume_name': 'volume-49239306-e397-4220-abcb-e440b00e6e00', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:39:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-150c1bda-b34f-4472-8ffd-930e5ffac1a0 tempest-SnapshotDependencyTests-1113943724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4ca2020-ad36-4c94-b993-569194b12d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:39:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-150c1bda-b34f-4472-8ffd-930e5ffac1a0 tempest-SnapshotDependencyTests-1113943724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4ca2020-ad36-4c94-b993-569194b12d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:39:12 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-150c1bda-b34f-4472-8ffd-930e5ffac1a0 tempest-SnapshotDependencyTests-1113943724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a40f777-4f2c-497c-892a-d286ed6e167a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:39:12 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-150c1bda-b34f-4472-8ffd-930e5ffac1a0 tempest-SnapshotDependencyTests-1113943724 None] Volume 49239306-e397-4220-abcb-e440b00e6e00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49239306-e397-4220-abcb-e440b00e6e00', 'volume_size': 1} Nov 03 20:39:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-150c1bda-b34f-4472-8ffd-930e5ffac1a0 tempest-SnapshotDependencyTests-1113943724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:39:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-150c1bda-b34f-4472-8ffd-930e5ffac1a0 tempest-SnapshotDependencyTests-1113943724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:39:12 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-150c1bda-b34f-4472-8ffd-930e5ffac1a0 tempest-SnapshotDependencyTests-1113943724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:39:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1708082396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49239306-e397-4220-abcb-e440b00e6e00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64f5e5ec610f45329da73f60e4e9c8d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:39:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:39:13Z,use_quota=True,user_id='36299be827e34dc5aeeba116411b1aca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)}" {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 20:39:12 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-150c1bda-b34f-4472-8ffd-930e5ffac1a0 tempest-SnapshotDependencyTests-1113943724 None] Creating volume 49239306-e397-4220-abcb-e440b00e6e00 {{(pid=87248) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 20:39:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-150c1bda-b34f-4472-8ffd-930e5ffac1a0 tempest-SnapshotDependencyTests-1113943724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:39:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-150c1bda-b34f-4472-8ffd-930e5ffac1a0 tempest-SnapshotDependencyTests-1113943724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:39:12 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-150c1bda-b34f-4472-8ffd-930e5ffac1a0 tempest-SnapshotDependencyTests-1113943724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:39:12 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-150c1bda-b34f-4472-8ffd-930e5ffac1a0 tempest-SnapshotDependencyTests-1113943724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:39:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-150c1bda-b34f-4472-8ffd-930e5ffac1a0 tempest-SnapshotDependencyTests-1113943724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:39:12 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-150c1bda-b34f-4472-8ffd-930e5ffac1a0 tempest-SnapshotDependencyTests-1113943724 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:39:12 devstack cinder-volume[87248]: INFO cinder.volume.drivers.remotefs [None req-150c1bda-b34f-4472-8ffd-930e5ffac1a0 tempest-SnapshotDependencyTests-1113943724 None] casted to osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 Nov 03 20:39:12 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-150c1bda-b34f-4472-8ffd-930e5ffac1a0 tempest-SnapshotDependencyTests-1113943724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00 1073741824 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:39:12 devstack sudo[107990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00 1073741824 Nov 03 20:39:12 devstack sudo[107990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:39:13 devstack sudo[107990]: pam_unix(sudo:session): session closed for user root Nov 03 20:39:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-150c1bda-b34f-4472-8ffd-930e5ffac1a0 tempest-SnapshotDependencyTests-1113943724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00 1073741824" returned: 0 in 0.404s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:39:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-150c1bda-b34f-4472-8ffd-930e5ffac1a0 tempest-SnapshotDependencyTests-1113943724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:39:13 devstack sudo[107995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00 Nov 03 20:39:13 devstack sudo[107995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:39:13 devstack sudo[107995]: pam_unix(sudo:session): session closed for user root Nov 03 20:39:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-150c1bda-b34f-4472-8ffd-930e5ffac1a0 tempest-SnapshotDependencyTests-1113943724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00" returned: 0 in 0.243s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:39:13 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-150c1bda-b34f-4472-8ffd-930e5ffac1a0 tempest-SnapshotDependencyTests-1113943724 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'} {{(pid=87248) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 20:39:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-150c1bda-b34f-4472-8ffd-930e5ffac1a0 tempest-SnapshotDependencyTests-1113943724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:39:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-150c1bda-b34f-4472-8ffd-930e5ffac1a0 tempest-SnapshotDependencyTests-1113943724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a40f777-4f2c-497c-892a-d286ed6e167a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49239306-e397-4220-abcb-e440b00e6e00', 'volume_size': 1}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:39:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-150c1bda-b34f-4472-8ffd-930e5ffac1a0 tempest-SnapshotDependencyTests-1113943724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d41a1702-0e06-4230-b740-4cc39b4b82e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:39:13 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-150c1bda-b34f-4472-8ffd-930e5ffac1a0 tempest-SnapshotDependencyTests-1113943724 None] Volume volume-49239306-e397-4220-abcb-e440b00e6e00 (49239306-e397-4220-abcb-e440b00e6e00): created successfully Nov 03 20:39:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-150c1bda-b34f-4472-8ffd-930e5ffac1a0 tempest-SnapshotDependencyTests-1113943724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d41a1702-0e06-4230-b740-4cc39b4b82e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:39:13 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-150c1bda-b34f-4472-8ffd-930e5ffac1a0 tempest-SnapshotDependencyTests-1113943724 None] Flow 'volume_create_manager' (397e963e-ab88-4eda-9156-f1c12d182b7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:39:13 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-150c1bda-b34f-4472-8ffd-930e5ffac1a0 tempest-SnapshotDependencyTests-1113943724 None] Created volume successfully. Nov 03 20:39:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ba89fe99-1ad7-40eb-a0f8-043ce620cccd tempest-SnapshotDependencyTests-1113943724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:39:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ba89fe99-1ad7-40eb-a0f8-043ce620cccd tempest-SnapshotDependencyTests-1113943724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:39:13 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-ba89fe99-1ad7-40eb-a0f8-043ce620cccd tempest-SnapshotDependencyTests-1113943724 None] Creating offline snapshot 09fccf8e-aec0-4fda-b668-2bc8ebe26e58 of volume 49239306-e397-4220-abcb-e440b00e6e00 {{(pid=87248) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 20:39:13 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4ae64c-1a61-454b-88ff-c10fdb76ed9e]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:39:13 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ba89fe99-1ad7-40eb-a0f8-043ce620cccd tempest-SnapshotDependencyTests-1113943724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:39:14 devstack sudo[107998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00 Nov 03 20:39:14 devstack sudo[107998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:39:14 devstack sudo[107998]: pam_unix(sudo:session): session closed for user root Nov 03 20:39:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ba89fe99-1ad7-40eb-a0f8-043ce620cccd tempest-SnapshotDependencyTests-1113943724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00" returned: 0 in 0.393s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:39:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ba89fe99-1ad7-40eb-a0f8-043ce620cccd tempest-SnapshotDependencyTests-1113943724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00.09fccf8e-aec0-4fda-b668-2bc8ebe26e58 1G {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:39:14 devstack sudo[108037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00.09fccf8e-aec0-4fda-b668-2bc8ebe26e58 1G Nov 03 20:39:14 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:39:14 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root Nov 03 20:39:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ba89fe99-1ad7-40eb-a0f8-043ce620cccd tempest-SnapshotDependencyTests-1113943724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00.09fccf8e-aec0-4fda-b668-2bc8ebe26e58 1G" returned: 0 in 0.412s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:39:14 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ba89fe99-1ad7-40eb-a0f8-043ce620cccd tempest-SnapshotDependencyTests-1113943724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49239306-e397-4220-abcb-e440b00e6e00 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00.09fccf8e-aec0-4fda-b668-2bc8ebe26e58 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:39:14 devstack sudo[108044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49239306-e397-4220-abcb-e440b00e6e00 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00.09fccf8e-aec0-4fda-b668-2bc8ebe26e58 Nov 03 20:39:14 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:39:15 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root Nov 03 20:39:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ba89fe99-1ad7-40eb-a0f8-043ce620cccd tempest-SnapshotDependencyTests-1113943724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49239306-e397-4220-abcb-e440b00e6e00 -F qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00.09fccf8e-aec0-4fda-b668-2bc8ebe26e58" returned: 0 in 0.281s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:39:15 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-ba89fe99-1ad7-40eb-a0f8-043ce620cccd tempest-SnapshotDependencyTests-1113943724 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00.09fccf8e-aec0-4fda-b668-2bc8ebe26e58 is being set with open permissions: ugo+rw Nov 03 20:39:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ba89fe99-1ad7-40eb-a0f8-043ce620cccd tempest-SnapshotDependencyTests-1113943724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00.09fccf8e-aec0-4fda-b668-2bc8ebe26e58 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:39:15 devstack sudo[108051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00.09fccf8e-aec0-4fda-b668-2bc8ebe26e58 Nov 03 20:39:15 devstack sudo[108051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:39:15 devstack sudo[108051]: pam_unix(sudo:session): session closed for user root Nov 03 20:39:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ba89fe99-1ad7-40eb-a0f8-043ce620cccd tempest-SnapshotDependencyTests-1113943724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00.09fccf8e-aec0-4fda-b668-2bc8ebe26e58" returned: 0 in 0.245s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:39:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ba89fe99-1ad7-40eb-a0f8-043ce620cccd tempest-SnapshotDependencyTests-1113943724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:39:15 devstack sudo[108054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00.info Nov 03 20:39:15 devstack sudo[108054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:39:15 devstack sudo[108054]: pam_unix(sudo:session): session closed for user root Nov 03 20:39:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ba89fe99-1ad7-40eb-a0f8-043ce620cccd tempest-SnapshotDependencyTests-1113943724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00.info" returned: 0 in 0.246s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:39:15 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-ba89fe99-1ad7-40eb-a0f8-043ce620cccd tempest-SnapshotDependencyTests-1113943724 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00.info is being set with open permissions: ugo+rw Nov 03 20:39:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ba89fe99-1ad7-40eb-a0f8-043ce620cccd tempest-SnapshotDependencyTests-1113943724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00.info {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:39:15 devstack sudo[108057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00.info Nov 03 20:39:15 devstack sudo[108057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:39:15 devstack sudo[108057]: pam_unix(sudo:session): session closed for user root Nov 03 20:39:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-ba89fe99-1ad7-40eb-a0f8-043ce620cccd tempest-SnapshotDependencyTests-1113943724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00.info" returned: 0 in 0.241s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:39:15 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-ba89fe99-1ad7-40eb-a0f8-043ce620cccd tempest-SnapshotDependencyTests-1113943724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.903s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:39:15 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-ba89fe99-1ad7-40eb-a0f8-043ce620cccd tempest-SnapshotDependencyTests-1113943724 None] Create snapshot completed successfully Nov 03 20:39:16 devstack cinder-volume[87248]: DEBUG cinder.volume.flows.manager.create_volume [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87248) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 20:39:16 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] Flow 'volume_create_manager' (4b5577f7-869d-402b-9407-0c48922ab442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:39:16 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4530cdd8-81fe-4a75-b68d-6440f4e9fcda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:39:16 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4530cdd8-81fe-4a75-b68d-6440f4e9fcda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T19:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29b32d8b-7a58-440b-b55c-0191fa75ede4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64f5e5ec610f45329da73f60e4e9c8d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T19:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=09fccf8e-aec0-4fda-b668-2bc8ebe26e58,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T19:39:17Z,use_quota=True,user_id='36299be827e34dc5aeeba116411b1aca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(119de40a-7a7f-4f24-a6a3-c65cba2aafa5),volume_type_id=119de40a-7a7f-4f24-a6a3-c65cba2aafa5)' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:39:16 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2c4d1bc-5b62-4bcb-8cbc-1d6a1d936316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:39:16 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2c4d1bc-5b62-4bcb-8cbc-1d6a1d936316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:39:16 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47df270d-caa2-4390-af92-7c987411617c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:39:16 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47df270d-caa2-4390-af92-7c987411617c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '29b32d8b-7a58-440b-b55c-0191fa75ede4', 'volume_name': 'volume-29b32d8b-7a58-440b-b55c-0191fa75ede4', 'volume_size': 1, 'snapshot_id': '09fccf8e-aec0-4fda-b668-2bc8ebe26e58'}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:39:16 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (214d7f56-1547-4467-8040-255daac79dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:39:16 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (214d7f56-1547-4467-8040-255daac79dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:39:16 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03e8a913-92ab-4ce6-a64d-806fa479f73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:39:16 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] Volume 29b32d8b-7a58-440b-b55c-0191fa75ede4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-29b32d8b-7a58-440b-b55c-0191fa75ede4', 'volume_size': 1, 'snapshot_id': '09fccf8e-aec0-4fda-b668-2bc8ebe26e58'} Nov 03 20:39:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:39:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:39:16 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] Acquiring lock "cinder-quobyte-09fccf8e-aec0-4fda-b668-2bc8ebe26e58-29b32d8b-7a58-440b-b55c-0191fa75ede4" by "_create_volume_from_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:39:16 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] Lock "cinder-quobyte-09fccf8e-aec0-4fda-b668-2bc8ebe26e58-29b32d8b-7a58-440b-b55c-0191fa75ede4" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:39:16 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] Creating volume 29b32d8b-7a58-440b-b55c-0191fa75ede4 from snapshot 09fccf8e-aec0-4fda-b668-2bc8ebe26e58 {{(pid=87248) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 20:39:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:39:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:39:16 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:39:16 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:39:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:39:16 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] Selected osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8 as target Quobyte volume. {{(pid=87248) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 20:39:16 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] Acquiring lock "cinder-quobyte-29b32d8b-7a58-440b-b55c-0191fa75ede4" by "_copy_volume_from_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:39:16 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] Lock "cinder-quobyte-29b32d8b-7a58-440b-b55c-0191fa75ede4" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:39:16 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] snapshot: 09fccf8e-aec0-4fda-b668-2bc8ebe26e58, volume: 29b32d8b-7a58-440b-b55c-0191fa75ede4, {{(pid=87248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 20:39:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:39:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:39:16 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:39:16 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:39:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:39:16 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f68b947-d0a7-48b1-90cd-ff2f03cf0ed5]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:39:16 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00.09fccf8e-aec0-4fda-b668-2bc8ebe26e58 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:39:16 devstack sudo[108060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00.09fccf8e-aec0-4fda-b668-2bc8ebe26e58 Nov 03 20:39:16 devstack sudo[108060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:39:17 devstack sudo[108060]: pam_unix(sudo:session): session closed for user root Nov 03 20:39:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00.09fccf8e-aec0-4fda-b668-2bc8ebe26e58" returned: 0 in 0.349s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:39:17 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49239306-e397-4220-abcb-e440b00e6e00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:39:17 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c0df02-46db-4984-bbc4-f34dce093f85]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:39:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:39:17 devstack sudo[108065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00 Nov 03 20:39:17 devstack sudo[108065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:39:17 devstack sudo[108065]: pam_unix(sudo:session): session closed for user root Nov 03 20:39:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00" returned: 0 in 0.353s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:39:17 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00 {{(pid=87248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 20:39:17 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] Creating direct copy from snapshot {{(pid=87248) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 20:39:17 devstack cinder-volume[87248]: DEBUG cinder.utils [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] Path /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-29b32d8b-7a58-440b-b55c-0191fa75ede4 not found in is_blk_device check {{(pid=87248) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 20:39:17 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-29b32d8b-7a58-440b-b55c-0191fa75ede4 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:39:17 devstack sudo[108070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-29b32d8b-7a58-440b-b55c-0191fa75ede4 Nov 03 20:39:17 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:39:23 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root Nov 03 20:39:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-29b32d8b-7a58-440b-b55c-0191fa75ede4" returned: 0 in 5.924s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:39:23 devstack cinder-volume[87248]: DEBUG cinder.image.image_utils [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] Image conversion details: src /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00, size 1024.00 MB, duration 5.92 sec, destination /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-29b32d8b-7a58-440b-b55c-0191fa75ede4 {{(pid=87248) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 20:39:23 devstack cinder-volume[87248]: INFO cinder.image.image_utils [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] Converted 1024.00 MB image at 172.83 MB/s Nov 03 20:39:23 devstack cinder-volume[87248]: WARNING cinder.volume.drivers.remotefs [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-29b32d8b-7a58-440b-b55c-0191fa75ede4 is being set with open permissions: ugo+rw Nov 03 20:39:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-29b32d8b-7a58-440b-b55c-0191fa75ede4 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:39:23 devstack sudo[108084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-29b32d8b-7a58-440b-b55c-0191fa75ede4 Nov 03 20:39:23 devstack sudo[108084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:39:23 devstack sudo[108084]: pam_unix(sudo:session): session closed for user root Nov 03 20:39:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-29b32d8b-7a58-440b-b55c-0191fa75ede4" returned: 0 in 0.235s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:39:23 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] Lock "cinder-quobyte-29b32d8b-7a58-440b-b55c-0191fa75ede4" released by "_copy_volume_from_snapshot" :: held 6.951s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:39:23 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] Lock "cinder-quobyte-09fccf8e-aec0-4fda-b668-2bc8ebe26e58-29b32d8b-7a58-440b-b55c-0191fa75ede4" released by "_create_volume_from_snapshot" :: held 7.020s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:39:23 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.037s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:39:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03e8a913-92ab-4ce6-a64d-806fa479f73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29b32d8b-7a58-440b-b55c-0191fa75ede4', 'volume_size': 1, 'snapshot_id': '09fccf8e-aec0-4fda-b668-2bc8ebe26e58'}' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:39:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd60e4c6-96bf-450e-bc40-c30644e68b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 20:39:23 devstack cinder-volume[87248]: INFO cinder.volume.flows.manager.create_volume [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] Volume volume-29b32d8b-7a58-440b-b55c-0191fa75ede4 (29b32d8b-7a58-440b-b55c-0191fa75ede4): created successfully Nov 03 20:39:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd60e4c6-96bf-450e-bc40-c30644e68b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87248) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 20:39:23 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] Flow 'volume_create_manager' (4b5577f7-869d-402b-9407-0c48922ab442) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87248) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 20:39:23 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-63b054ce-e78d-427d-9969-821274165f1d tempest-SnapshotDependencyTests-1113943724 None] Created volume successfully. Nov 03 20:39:24 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-68bbab11-814a-4f5f-97f0-7354e2716bf3 tempest-SnapshotDependencyTests-1113943724 None] Acquiring lock "cinder-09fccf8e-aec0-4fda-b668-2bc8ebe26e58-delete_snapshot" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:39:24 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-68bbab11-814a-4f5f-97f0-7354e2716bf3 tempest-SnapshotDependencyTests-1113943724 None] Lock "cinder-09fccf8e-aec0-4fda-b668-2bc8ebe26e58-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:39:24 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-68bbab11-814a-4f5f-97f0-7354e2716bf3 tempest-SnapshotDependencyTests-1113943724 None] Acquiring lock "cinder-quobyte-49239306-e397-4220-abcb-e440b00e6e00" by "delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:39:24 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-68bbab11-814a-4f5f-97f0-7354e2716bf3 tempest-SnapshotDependencyTests-1113943724 None] Lock "cinder-quobyte-49239306-e397-4220-abcb-e440b00e6e00" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:39:24 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-68bbab11-814a-4f5f-97f0-7354e2716bf3 tempest-SnapshotDependencyTests-1113943724 None] Acquiring lock "cinder-quobyte-09fccf8e-aec0-4fda-b668-2bc8ebe26e58" by "_delete_snapshot" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:39:24 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-68bbab11-814a-4f5f-97f0-7354e2716bf3 tempest-SnapshotDependencyTests-1113943724 None] Lock "cinder-quobyte-09fccf8e-aec0-4fda-b668-2bc8ebe26e58" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:39:24 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-68bbab11-814a-4f5f-97f0-7354e2716bf3 tempest-SnapshotDependencyTests-1113943724 None] Deleting offline snapshot 09fccf8e-aec0-4fda-b668-2bc8ebe26e58 of volume 49239306-e397-4220-abcb-e440b00e6e00 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 20:39:24 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-68bbab11-814a-4f5f-97f0-7354e2716bf3 tempest-SnapshotDependencyTests-1113943724 None] snapshot_file for this snap is: volume-49239306-e397-4220-abcb-e440b00e6e00.09fccf8e-aec0-4fda-b668-2bc8ebe26e58 {{(pid=87248) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 20:39:24 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[42443f7a-cb3c-40f3-a199-eb2f474a2002]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:39:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-68bbab11-814a-4f5f-97f0-7354e2716bf3 tempest-SnapshotDependencyTests-1113943724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00.09fccf8e-aec0-4fda-b668-2bc8ebe26e58 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:39:24 devstack sudo[108087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00.09fccf8e-aec0-4fda-b668-2bc8ebe26e58 Nov 03 20:39:24 devstack sudo[108087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:39:24 devstack sudo[108087]: pam_unix(sudo:session): session closed for user root Nov 03 20:39:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-68bbab11-814a-4f5f-97f0-7354e2716bf3 tempest-SnapshotDependencyTests-1113943724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00.09fccf8e-aec0-4fda-b668-2bc8ebe26e58" returned: 0 in 0.359s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:39:24 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.remotefs [None req-68bbab11-814a-4f5f-97f0-7354e2716bf3 tempest-SnapshotDependencyTests-1113943724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49239306-e397-4220-abcb-e440b00e6e00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87248) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 20:39:24 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e3aafa-2388-4e4f-8e88-c8e90c3c9acc]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:39:24 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-68bbab11-814a-4f5f-97f0-7354e2716bf3 tempest-SnapshotDependencyTests-1113943724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:39:24 devstack sudo[108092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00 Nov 03 20:39:24 devstack sudo[108092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:39:25 devstack sudo[108092]: pam_unix(sudo:session): session closed for user root Nov 03 20:39:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-68bbab11-814a-4f5f-97f0-7354e2716bf3 tempest-SnapshotDependencyTests-1113943724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00" returned: 0 in 0.520s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:39:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-68bbab11-814a-4f5f-97f0-7354e2716bf3 tempest-SnapshotDependencyTests-1113943724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00.09fccf8e-aec0-4fda-b668-2bc8ebe26e58 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:39:25 devstack sudo[108097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00.09fccf8e-aec0-4fda-b668-2bc8ebe26e58 Nov 03 20:39:25 devstack sudo[108097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:39:25 devstack sudo[108097]: pam_unix(sudo:session): session closed for user root Nov 03 20:39:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-68bbab11-814a-4f5f-97f0-7354e2716bf3 tempest-SnapshotDependencyTests-1113943724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00.09fccf8e-aec0-4fda-b668-2bc8ebe26e58" returned: 0 in 0.326s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:39:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-68bbab11-814a-4f5f-97f0-7354e2716bf3 tempest-SnapshotDependencyTests-1113943724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00.09fccf8e-aec0-4fda-b668-2bc8ebe26e58 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:39:25 devstack sudo[108102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00.09fccf8e-aec0-4fda-b668-2bc8ebe26e58 Nov 03 20:39:25 devstack sudo[108102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:39:25 devstack sudo[108102]: pam_unix(sudo:session): session closed for user root Nov 03 20:39:25 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-68bbab11-814a-4f5f-97f0-7354e2716bf3 tempest-SnapshotDependencyTests-1113943724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00.09fccf8e-aec0-4fda-b668-2bc8ebe26e58" returned: 0 in 0.239s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:39:25 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-68bbab11-814a-4f5f-97f0-7354e2716bf3 tempest-SnapshotDependencyTests-1113943724 None] Lock "cinder-quobyte-09fccf8e-aec0-4fda-b668-2bc8ebe26e58" released by "_delete_snapshot" :: held 1.543s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:39:25 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-68bbab11-814a-4f5f-97f0-7354e2716bf3 tempest-SnapshotDependencyTests-1113943724 None] Lock "cinder-quobyte-49239306-e397-4220-abcb-e440b00e6e00" released by "delete_snapshot" :: held 1.569s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:39:25 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-68bbab11-814a-4f5f-97f0-7354e2716bf3 tempest-SnapshotDependencyTests-1113943724 None] Created reservations ['96c64288-aff2-40dc-b6a7-45fade0740b9', '043f99dc-52b9-4bcf-a742-85ece67c3e86', '7d9d2719-b9b1-474e-bc6c-de26add6c5ce', 'cfddd5e5-6815-4f04-9b68-8eb570f2c13a'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:39:25 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-68bbab11-814a-4f5f-97f0-7354e2716bf3 tempest-SnapshotDependencyTests-1113943724 None] Delete snapshot completed successfully. Nov 03 20:39:25 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-68bbab11-814a-4f5f-97f0-7354e2716bf3 tempest-SnapshotDependencyTests-1113943724 None] Lock "cinder-09fccf8e-aec0-4fda-b668-2bc8ebe26e58-delete_snapshot" released by "delete_snapshot" :: held 1.690s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:39:26 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-138b7099-9239-4f46-9db8-856cd6673ebd tempest-SnapshotDependencyTests-1113943724 None] Acquiring lock "cinder-49239306-e397-4220-abcb-e440b00e6e00-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:39:26 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-138b7099-9239-4f46-9db8-856cd6673ebd tempest-SnapshotDependencyTests-1113943724 None] Lock "cinder-49239306-e397-4220-abcb-e440b00e6e00-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:39:26 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-138b7099-9239-4f46-9db8-856cd6673ebd tempest-SnapshotDependencyTests-1113943724 None] Acquiring lock "cinder-quobyte-49239306-e397-4220-abcb-e440b00e6e00" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:39:26 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-138b7099-9239-4f46-9db8-856cd6673ebd tempest-SnapshotDependencyTests-1113943724 None] Lock "cinder-quobyte-49239306-e397-4220-abcb-e440b00e6e00" acquired by "delete_volume" :: waited 0.016s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:39:26 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[d268bf38-1436-47c8-9764-fa3cb36d46aa]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:39:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-138b7099-9239-4f46-9db8-856cd6673ebd tempest-SnapshotDependencyTests-1113943724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:39:26 devstack sudo[108105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00 Nov 03 20:39:26 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:39:26 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root Nov 03 20:39:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-138b7099-9239-4f46-9db8-856cd6673ebd tempest-SnapshotDependencyTests-1113943724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00" returned: 0 in 0.359s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:39:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-138b7099-9239-4f46-9db8-856cd6673ebd tempest-SnapshotDependencyTests-1113943724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:39:26 devstack sudo[108110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00 Nov 03 20:39:26 devstack sudo[108110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:39:26 devstack sudo[108110]: pam_unix(sudo:session): session closed for user root Nov 03 20:39:26 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-138b7099-9239-4f46-9db8-856cd6673ebd tempest-SnapshotDependencyTests-1113943724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-49239306-e397-4220-abcb-e440b00e6e00" returned: 0 in 0.235s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:39:26 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-138b7099-9239-4f46-9db8-856cd6673ebd tempest-SnapshotDependencyTests-1113943724 None] Lock "cinder-quobyte-49239306-e397-4220-abcb-e440b00e6e00" released by "delete_volume" :: held 0.655s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:39:27 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-138b7099-9239-4f46-9db8-856cd6673ebd tempest-SnapshotDependencyTests-1113943724 None] Created reservations ['5fd9525d-5928-40d3-9d95-8eb4b601efca', 'aeaa7ae2-0f42-48bb-b4f7-028bf73eca34', '7a1ae88a-c939-4ee1-a1f2-dfcea1bbb06a', '6dfce706-15b9-479d-96ed-aa2808102b17'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:39:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-138b7099-9239-4f46-9db8-856cd6673ebd tempest-SnapshotDependencyTests-1113943724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:39:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-138b7099-9239-4f46-9db8-856cd6673ebd tempest-SnapshotDependencyTests-1113943724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:39:27 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-138b7099-9239-4f46-9db8-856cd6673ebd tempest-SnapshotDependencyTests-1113943724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:39:27 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-138b7099-9239-4f46-9db8-856cd6673ebd tempest-SnapshotDependencyTests-1113943724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:39:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-138b7099-9239-4f46-9db8-856cd6673ebd tempest-SnapshotDependencyTests-1113943724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:39:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-138b7099-9239-4f46-9db8-856cd6673ebd tempest-SnapshotDependencyTests-1113943724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:39:27 devstack sudo[108113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:39:27 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:39:27 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root Nov 03 20:39:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-138b7099-9239-4f46-9db8-856cd6673ebd tempest-SnapshotDependencyTests-1113943724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.235s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:39:27 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-138b7099-9239-4f46-9db8-856cd6673ebd tempest-SnapshotDependencyTests-1113943724 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:39:27 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-138b7099-9239-4f46-9db8-856cd6673ebd tempest-SnapshotDependencyTests-1113943724 None] Deleted volume successfully. Nov 03 20:39:27 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-138b7099-9239-4f46-9db8-856cd6673ebd tempest-SnapshotDependencyTests-1113943724 None] Lock "cinder-49239306-e397-4220-abcb-e440b00e6e00-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:39:27 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8ca0272e-36de-4327-afc9-5770b7cf9c48 tempest-SnapshotDependencyTests-1113943724 None] Acquiring lock "cinder-29b32d8b-7a58-440b-b55c-0191fa75ede4-delete_volume" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:39:27 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8ca0272e-36de-4327-afc9-5770b7cf9c48 tempest-SnapshotDependencyTests-1113943724 None] Lock "cinder-29b32d8b-7a58-440b-b55c-0191fa75ede4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:39:27 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8ca0272e-36de-4327-afc9-5770b7cf9c48 tempest-SnapshotDependencyTests-1113943724 None] Acquiring lock "cinder-quobyte-29b32d8b-7a58-440b-b55c-0191fa75ede4" by "delete_volume" {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 20:39:27 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8ca0272e-36de-4327-afc9-5770b7cf9c48 tempest-SnapshotDependencyTests-1113943724 None] Lock "cinder-quobyte-29b32d8b-7a58-440b-b55c-0191fa75ede4" acquired by "delete_volume" :: waited 0.015s {{(pid=87248) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 20:39:27 devstack cinder-volume[87248]: DEBUG oslo.privsep.daemon [-] privsep: reply[4525da8d-61e6-4696-9507-f8bde8945444]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 20:39:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8ca0272e-36de-4327-afc9-5770b7cf9c48 tempest-SnapshotDependencyTests-1113943724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-29b32d8b-7a58-440b-b55c-0191fa75ede4 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:39:27 devstack sudo[108116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-29b32d8b-7a58-440b-b55c-0191fa75ede4 Nov 03 20:39:27 devstack sudo[108116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:39:27 devstack sudo[108116]: pam_unix(sudo:session): session closed for user root Nov 03 20:39:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8ca0272e-36de-4327-afc9-5770b7cf9c48 tempest-SnapshotDependencyTests-1113943724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-29b32d8b-7a58-440b-b55c-0191fa75ede4" returned: 0 in 0.350s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:39:27 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8ca0272e-36de-4327-afc9-5770b7cf9c48 tempest-SnapshotDependencyTests-1113943724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-29b32d8b-7a58-440b-b55c-0191fa75ede4 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:39:27 devstack sudo[108121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-29b32d8b-7a58-440b-b55c-0191fa75ede4 Nov 03 20:39:27 devstack sudo[108121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:39:28 devstack sudo[108121]: pam_unix(sudo:session): session closed for user root Nov 03 20:39:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8ca0272e-36de-4327-afc9-5770b7cf9c48 tempest-SnapshotDependencyTests-1113943724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26/volume-29b32d8b-7a58-440b-b55c-0191fa75ede4" returned: 0 in 0.245s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:39:28 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8ca0272e-36de-4327-afc9-5770b7cf9c48 tempest-SnapshotDependencyTests-1113943724 None] Lock "cinder-quobyte-29b32d8b-7a58-440b-b55c-0191fa75ede4" released by "delete_volume" :: held 0.637s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:39:28 devstack cinder-volume[87248]: DEBUG cinder.quota [None req-8ca0272e-36de-4327-afc9-5770b7cf9c48 tempest-SnapshotDependencyTests-1113943724 None] Created reservations ['5ac03daa-912b-469e-b43d-6b6b47bb2da9', '64ab3718-2ea8-40bf-8e46-4471e02790d7', '139b8719-f53f-428e-b335-bf3c9723a801', 'e4c9f2d2-9c8d-4e8e-a8ce-1e1316b50f84'] {{(pid=87248) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 20:39:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8ca0272e-36de-4327-afc9-5770b7cf9c48 tempest-SnapshotDependencyTests-1113943724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:39:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8ca0272e-36de-4327-afc9-5770b7cf9c48 tempest-SnapshotDependencyTests-1113943724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:39:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8ca0272e-36de-4327-afc9-5770b7cf9c48 tempest-SnapshotDependencyTests-1113943724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:39:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-8ca0272e-36de-4327-afc9-5770b7cf9c48 tempest-SnapshotDependencyTests-1113943724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:39:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-8ca0272e-36de-4327-afc9-5770b7cf9c48 tempest-SnapshotDependencyTests-1113943724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:39:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8ca0272e-36de-4327-afc9-5770b7cf9c48 tempest-SnapshotDependencyTests-1113943724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:39:28 devstack sudo[108124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:39:28 devstack sudo[108124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:39:28 devstack sudo[108124]: pam_unix(sudo:session): session closed for user root Nov 03 20:39:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-8ca0272e-36de-4327-afc9-5770b7cf9c48 tempest-SnapshotDependencyTests-1113943724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.239s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:39:28 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-8ca0272e-36de-4327-afc9-5770b7cf9c48 tempest-SnapshotDependencyTests-1113943724 None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:39:28 devstack cinder-volume[87248]: INFO cinder.volume.manager [None req-8ca0272e-36de-4327-afc9-5770b7cf9c48 tempest-SnapshotDependencyTests-1113943724 None] Deleted volume successfully. Nov 03 20:39:28 devstack cinder-volume[87248]: DEBUG cinder.coordination [None req-8ca0272e-36de-4327-afc9-5770b7cf9c48 tempest-SnapshotDependencyTests-1113943724 None] Lock "cinder-29b32d8b-7a58-440b-b55c-0191fa75ede4-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=87248) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 20:39:28 devstack cinder-volume[87248]: DEBUG oslo_service.periodic_task [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:39:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 20:39:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 20:39:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8': None} {{(pid=87248) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 20:39:28 devstack cinder-volume[87248]: DEBUG cinder.volume.drivers.quobyte [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-caac24fd-839d-46ca-8191-e6e344cb41b8'] {{(pid=87248) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 20:39:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.lockutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87248) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 20:39:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 20:39:28 devstack sudo[108127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26 Nov 03 20:39:28 devstack sudo[108127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 20:39:28 devstack sudo[108127]: pam_unix(sudo:session): session closed for user root Nov 03 20:39:28 devstack cinder-volume[87248]: DEBUG oslo_concurrency.processutils [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0b3f3fafd9b5f474e8d66a15d7e17a26" returned: 0 in 0.244s {{(pid=87248) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 20:39:28 devstack cinder-volume[87248]: DEBUG cinder.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Notifying Schedulers of capabilities ... {{(pid=87248) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 20:39:29 devstack cinder-volume[87248]: DEBUG oslo_service.periodic_task [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] Running periodic task VolumeManager._thread_info {{(pid=87248) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 20:39:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] thread count: 28 {{(pid=87248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 20:39:29 devstack cinder-volume[87248]: DEBUG cinder.volume.manager [None req-75bb8419-d580-4b33-80cd-c2aba37639aa None None] thread info: [<_MainThread(MainThread, started 124862067372160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87248) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 20:39:38 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:SELECT=24,cinder:UPDATE=33,cinder:INSERT=8,cinder:DELETE=1 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 20:39:38 devstack cinder-volume[87248]: DEBUG dbcounter [-] [87248] Writing DB stats cinder:SELECT=25,cinder:UPDATE=25,cinder:DELETE=4,cinder:INSERT=7 {{(pid=87248) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}